2024-04-23T18:05:13.631 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-23T18:05:13.631 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} --name leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi --owner scheduled_leonidus@teuthology --verbose --archive /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106 -- /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106/orig.config.yaml 2024-04-23T18:05:13.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T18:05:13.769 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} email: null first_in_suite: false job_id: '7670106' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 57e0caf76fdb7ab8b1358588f292d08519163844 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5182 sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_57e0caf76fdb7ab8b1358588f292d08519163844/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: 57e0caf76fdb7ab8b1358588f292d08519163844 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZtr0m8d33EhsKYbt/vGaaly0Q+oAZBb5N0HYqm04HtbCag5Ao1aZSMZQaneAGQjkqYRqjuKqPdPdFVI33iaTY= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOeKXnyjjUyMYlvak24BbLLLbgL9Z9qk+MC5i+7V7bETo8Oh6Y6qTrBHmbduA7HtedvKZjnB8AjcWZGUfbkrRwo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - quiescer: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_17:44:29 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-23T18:05:13.769 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_57e0caf76fdb7ab8b1358588f292d08519163844/qa; will attempt to use it 2024-04-23T18:05:13.770 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_57e0caf76fdb7ab8b1358588f292d08519163844/qa/tasks 2024-04-23T18:05:13.770 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-23T18:05:13.772 INFO:teuthology.task.internal:Checking packages... 2024-04-23T18:05:13.795 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd69f13d827952bb07bb9b7973bca14f97d764d6f' 2024-04-23T18:05:13.795 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T18:05:13.795 INFO:teuthology.packaging:ref: None 2024-04-23T18:05:13.795 INFO:teuthology.packaging:tag: None 2024-04-23T18:05:13.795 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-23T18:05:13.795 INFO:teuthology.packaging:sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T18:05:13.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lusov-quiescer 2024-04-23T18:05:14.087 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T18:05:14.088 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-23T18:05:14.095 INFO:teuthology.task.internal:no buildpackages task found 2024-04-23T18:05:14.095 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-23T18:05:14.101 INFO:teuthology.task.internal:Saving configuration 2024-04-23T18:05:14.122 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-23T18:05:14.128 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-23T18:05:14.151 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 17:59:35.223204', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOtg0XWA12afOvz/uSCL0idAoZF7erLnBP9dn7QFMjsO'} 2024-04-23T18:05:14.170 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 17:59:35.221405', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP//Al1rPzM1SQ2PL7UfKkwH/9RuX9vIW8/lUvPgN/ik'} 2024-04-23T18:05:14.171 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-23T18:05:14.176 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-23T18:05:14.176 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-23T18:05:14.176 INFO:teuthology.run_tasks:Running task console_log... 2024-04-23T18:05:14.283 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8e5d9480d0>, signals=[15]) 2024-04-23T18:05:14.283 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-23T18:05:14.290 INFO:teuthology.task.internal:Opening connections... 2024-04-23T18:05:14.290 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:05:14.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:05:14.373 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T18:05:14.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:05:14.452 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-23T18:05:14.459 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2024-04-23T18:05:14.464 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2024-04-23T18:05:14.464 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-04-23T18:05:14.514 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-23T18:05:14.514 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="Ubuntu" 2024-04-23T18:05:14.514 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="22.04" 2024-04-23T18:05:14.514 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-23T18:05:14.514 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_CODENAME=jammy 2024-04-23T18:05:14.514 INFO:teuthology.orchestra.run.smithi028.stdout:ID=ubuntu 2024-04-23T18:05:14.514 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE=debian 2024-04-23T18:05:14.514 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-23T18:05:14.514 INFO:teuthology.orchestra.run.smithi028.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-23T18:05:14.514 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-23T18:05:14.514 INFO:teuthology.orchestra.run.smithi028.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-23T18:05:14.515 INFO:teuthology.orchestra.run.smithi028.stdout:UBUNTU_CODENAME=jammy 2024-04-23T18:05:14.515 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-04-23T18:05:14.537 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-04-23T18:05:14.542 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-04-23T18:05:14.542 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-23T18:05:14.587 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-23T18:05:14.587 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2024-04-23T18:05:14.587 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="22.04" 2024-04-23T18:05:14.587 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-23T18:05:14.587 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=jammy 2024-04-23T18:05:14.587 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2024-04-23T18:05:14.587 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2024-04-23T18:05:14.587 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-23T18:05:14.587 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-23T18:05:14.588 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-23T18:05:14.588 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-23T18:05:14.588 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=jammy 2024-04-23T18:05:14.588 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-23T18:05:14.603 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-23T18:05:14.613 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-23T18:05:14.618 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-23T18:05:14.619 DEBUG:teuthology.orchestra.run.smithi028:> test '!' -e /home/ubuntu/cephtest 2024-04-23T18:05:14.621 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-04-23T18:05:14.634 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-23T18:05:14.640 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-23T18:05:14.641 DEBUG:teuthology.orchestra.run.smithi028:> test -z $(ls -A /var/lib/ceph) 2024-04-23T18:05:14.668 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-04-23T18:05:14.700 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-23T18:05:14.749 INFO:teuthology.run_tasks:Running task kernel... 2024-04-23T18:05:14.765 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-23T18:05:14.766 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-23T18:05:14.766 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-23T18:05:14.766 DEBUG:teuthology.orchestra.run.smithi028:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T18:05:14.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:05:14.771 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-23T18:05:15.073 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T18:05:15.073 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-23T18:05:15.073 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-04-23T18:05:15.079 INFO:teuthology.orchestra.run.smithi028.stdout:5.15.0-56-generic 2024-04-23T18:05:15.079 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T18:05:15.080 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-23T18:05:15.080 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-23T18:05:15.080 DEBUG:teuthology.orchestra.run.smithi028:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-23T18:05:15.147 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-23T18:05:15.280 INFO:teuthology.orchestra.run.smithi028.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-23T18:05:15.280 INFO:teuthology.orchestra.run.smithi028.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-23T18:05:15.280 INFO:teuthology.orchestra.run.smithi028.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-23T18:05:15.280 INFO:teuthology.orchestra.run.smithi028.stderr:hint: 2024-04-23T18:05:15.280 INFO:teuthology.orchestra.run.smithi028.stderr:hint: git config --global init.defaultBranch 2024-04-23T18:05:15.280 INFO:teuthology.orchestra.run.smithi028.stderr:hint: 2024-04-23T18:05:15.280 INFO:teuthology.orchestra.run.smithi028.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-23T18:05:15.280 INFO:teuthology.orchestra.run.smithi028.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-23T18:05:15.280 INFO:teuthology.orchestra.run.smithi028.stderr:hint: 2024-04-23T18:05:15.281 INFO:teuthology.orchestra.run.smithi028.stderr:hint: git branch -m 2024-04-23T18:05:15.281 INFO:teuthology.orchestra.run.smithi028.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-23T18:05:15.283 DEBUG:teuthology.orchestra.run.smithi028:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-23T18:05:15.353 DEBUG:teuthology.orchestra.run.smithi028:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-23T18:05:15.408 DEBUG:teuthology.orchestra.run.smithi028:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-23T18:07:44.264 INFO:teuthology.orchestra.run.smithi028.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-23T18:07:44.264 INFO:teuthology.orchestra.run.smithi028.stderr: * [new branch] main -> origin/main 2024-04-23T18:07:44.291 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190312 -> 20190312 2024-04-23T18:07:44.292 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190416 -> 20190416 2024-04-23T18:07:44.292 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190514 -> 20190514 2024-04-23T18:07:44.292 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190618 -> 20190618 2024-04-23T18:07:44.292 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190717 -> 20190717 2024-04-23T18:07:44.292 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190815 -> 20190815 2024-04-23T18:07:44.292 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20190923 -> 20190923 2024-04-23T18:07:44.292 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20191022 -> 20191022 2024-04-23T18:07:44.300 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20191215 -> 20191215 2024-04-23T18:07:44.301 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200122 -> 20200122 2024-04-23T18:07:44.301 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200316 -> 20200316 2024-04-23T18:07:44.301 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200421 -> 20200421 2024-04-23T18:07:44.301 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200519 -> 20200519 2024-04-23T18:07:44.301 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200619 -> 20200619 2024-04-23T18:07:44.302 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200721 -> 20200721 2024-04-23T18:07:44.302 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200817 -> 20200817 2024-04-23T18:07:44.302 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20200918 -> 20200918 2024-04-23T18:07:44.302 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20201022 -> 20201022 2024-04-23T18:07:44.302 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20201118 -> 20201118 2024-04-23T18:07:44.302 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20201218 -> 20201218 2024-04-23T18:07:44.303 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210208 -> 20210208 2024-04-23T18:07:44.303 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210315 -> 20210315 2024-04-23T18:07:44.303 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210511 -> 20210511 2024-04-23T18:07:44.303 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210716 -> 20210716 2024-04-23T18:07:44.303 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210818 -> 20210818 2024-04-23T18:07:44.303 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20210919 -> 20210919 2024-04-23T18:07:44.304 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20211027 -> 20211027 2024-04-23T18:07:44.304 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20211216 -> 20211216 2024-04-23T18:07:44.304 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220209 -> 20220209 2024-04-23T18:07:44.304 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220310 -> 20220310 2024-04-23T18:07:44.304 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220411 -> 20220411 2024-04-23T18:07:44.304 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220509 -> 20220509 2024-04-23T18:07:44.304 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220610 -> 20220610 2024-04-23T18:07:44.305 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220708 -> 20220708 2024-04-23T18:07:44.305 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220815 -> 20220815 2024-04-23T18:07:44.305 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20220913 -> 20220913 2024-04-23T18:07:44.305 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20221012 -> 20221012 2024-04-23T18:07:44.305 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20221109 -> 20221109 2024-04-23T18:07:44.306 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20221214 -> 20221214 2024-04-23T18:07:44.306 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230117 -> 20230117 2024-04-23T18:07:44.306 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230210 -> 20230210 2024-04-23T18:07:44.306 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230310 -> 20230310 2024-04-23T18:07:44.306 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230404 -> 20230404 2024-04-23T18:07:44.306 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230515 -> 20230515 2024-04-23T18:07:44.307 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230625 -> 20230625 2024-04-23T18:07:44.307 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230804 -> 20230804 2024-04-23T18:07:44.307 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20230919 -> 20230919 2024-04-23T18:07:44.307 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20231030 -> 20231030 2024-04-23T18:07:44.307 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20231111 -> 20231111 2024-04-23T18:07:44.308 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20231211 -> 20231211 2024-04-23T18:07:44.308 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20240115 -> 20240115 2024-04-23T18:07:44.308 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20240220 -> 20240220 2024-04-23T18:07:44.308 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20240312 -> 20240312 2024-04-23T18:07:44.308 INFO:teuthology.orchestra.run.smithi028.stderr: * [new tag] 20240410 -> 20240410 2024-04-23T18:07:48.791 INFO:teuthology.orchestra.run.smithi028.stderr:Updating files: 44% (1497/3381) Updating files: 45% (1522/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 58% (1978/3381) Updating files: 59% (1995/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 68% (2332/3381) Updating files: 69% (2333/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 82% (2783/3381) Updating files: 83% (2807/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-23T18:07:48.796 INFO:teuthology.orchestra.run.smithi028.stdout:HEAD is now at a7acbf5c Merge branch 'robot/pr-0-1713880828' into 'main' 2024-04-23T18:07:48.820 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-23T18:07:48.820 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-23T18:07:48.973 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-23T18:07:48.974 DEBUG:teuthology.orchestra.run.smithi028:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-23T18:07:48.977 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi028.front.sepia.ceph.com to complete... 2024-04-23T18:07:54.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23 18:07:53 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-23T18:07:54.174 INFO:teuthology.orchestra.run.smithi028.stderr:FINISHED --2024-04-23 18:07:53-- 2024-04-23T18:07:54.174 INFO:teuthology.orchestra.run.smithi028.stderr:Total wall clock time: 5.2s 2024-04-23T18:07:54.174 INFO:teuthology.orchestra.run.smithi028.stderr:Downloaded: 1 files, 43M in 4.9s (8.73 MB/s) 2024-04-23T18:07:54.178 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-23T18:07:54.179 DEBUG:teuthology.orchestra.run.smithi028:> sudo dpkg -i /tmp/linux-image.deb 2024-04-23T18:07:54.371 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-23T18:07:56.370 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-23T18:07:56.373 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-23T18:07:56.504 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-23T18:08:00.265 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-23T18:08:00.369 INFO:teuthology.orchestra.run.smithi028.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-23T18:08:22.705 INFO:teuthology.orchestra.run.smithi028.stderr:Sourcing file `/etc/default/grub' 2024-04-23T18:08:22.720 INFO:teuthology.orchestra.run.smithi028.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T18:08:22.748 INFO:teuthology.orchestra.run.smithi028.stderr:Generating grub configuration file ... 2024-04-23T18:08:23.062 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-23T18:08:23.081 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-23T18:08:23.393 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T18:08:23.403 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T18:08:23.471 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T18:08:23.476 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T18:08:23.614 INFO:teuthology.orchestra.run.smithi028.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T18:08:23.614 INFO:teuthology.orchestra.run.smithi028.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T18:08:23.615 INFO:teuthology.orchestra.run.smithi028.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T18:08:23.652 INFO:teuthology.orchestra.run.smithi028.stderr:done 2024-04-23T18:08:23.821 DEBUG:teuthology.orchestra.run.smithi028:> dpkg-deb -c /tmp/linux-image.deb 2024-04-23T18:08:23.869 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-23T18:08:23.869 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-23T18:08:23.869 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-23T18:08:23.889 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-23T18:08:23.889 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-23T18:08:23.913 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-23T18:08:23.913 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-23T18:08:23.914 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-23T18:08:23.917 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-23T18:08:23.917 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-23T18:08:23.917 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-23T18:08:23.917 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-23T18:08:23.917 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-23T18:08:23.917 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-23T18:08:23.918 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-23T18:08:23.919 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-23T18:08:23.919 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-23T18:08:23.919 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-23T18:08:23.919 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-23T18:08:23.919 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-23T18:08:23.919 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-23T18:08:23.919 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-23T18:08:23.919 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-23T18:08:23.919 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-23T18:08:23.919 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-23T18:08:23.937 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-23T18:08:23.938 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-23T18:08:23.938 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-23T18:08:23.938 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-23T18:08:23.938 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-23T18:08:23.938 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-23T18:08:23.938 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-23T18:08:23.938 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-23T18:08:23.938 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-23T18:08:23.938 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-23T18:08:23.938 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-23T18:08:23.938 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-23T18:08:23.939 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-23T18:08:23.940 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-23T18:08:23.941 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-23T18:08:23.942 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-23T18:08:23.943 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-23T18:08:23.944 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-23T18:08:23.945 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-23T18:08:23.946 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-23T18:08:23.947 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-23T18:08:23.948 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-23T18:08:23.948 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-23T18:08:23.948 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-23T18:08:23.948 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-23T18:08:23.948 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-23T18:08:23.948 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-23T18:08:23.983 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-23T18:08:23.983 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-23T18:08:23.983 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-23T18:08:23.983 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-23T18:08:23.983 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-23T18:08:23.983 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-23T18:08:23.983 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-23T18:08:23.983 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-23T18:08:23.983 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-23T18:08:23.984 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-23T18:08:23.985 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-23T18:08:23.986 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-23T18:08:23.987 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-23T18:08:23.988 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-23T18:08:23.989 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-23T18:08:23.990 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-23T18:08:23.991 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-23T18:08:23.992 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-23T18:08:23.993 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-23T18:08:23.994 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-23T18:08:23.995 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-23T18:08:23.996 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-23T18:08:23.997 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-23T18:08:23.998 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-23T18:08:23.998 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-23T18:08:23.998 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-23T18:08:23.998 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-23T18:08:23.998 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-23T18:08:23.998 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-23T18:08:23.998 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-23T18:08:23.998 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-23T18:08:23.998 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-23T18:08:23.998 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-23T18:08:23.999 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-23T18:08:24.000 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-23T18:08:24.001 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-23T18:08:24.002 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-23T18:08:24.003 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-23T18:08:24.004 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-23T18:08:24.005 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-23T18:08:24.006 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-23T18:08:24.007 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-23T18:08:24.008 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-23T18:08:24.009 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-23T18:08:24.010 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-23T18:08:24.011 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-23T18:08:24.012 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-23T18:08:24.013 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-23T18:08:24.014 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-23T18:08:24.037 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-23T18:08:24.037 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-23T18:08:24.037 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-23T18:08:24.037 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-23T18:08:24.037 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-23T18:08:24.038 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-23T18:08:24.039 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-23T18:08:24.040 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-23T18:08:24.041 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-23T18:08:24.042 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-23T18:08:24.043 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-23T18:08:24.044 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-23T18:08:24.045 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-23T18:08:24.046 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-23T18:08:24.047 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-23T18:08:24.047 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-23T18:08:24.047 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-23T18:08:24.047 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-23T18:08:24.047 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-23T18:08:24.047 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-23T18:08:24.049 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-23T18:08:24.049 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-23T18:08:24.049 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-23T18:08:24.049 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-23T18:08:24.050 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-23T18:08:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-23T18:08:24.052 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-23T18:08:24.053 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-23T18:08:24.054 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-23T18:08:24.055 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-23T18:08:24.056 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-23T18:08:24.057 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-23T18:08:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-23T18:08:24.059 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-23T18:08:24.060 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-23T18:08:24.061 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-23T18:08:24.062 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-23T18:08:24.063 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-23T18:08:24.064 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-23T18:08:24.064 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-23T18:08:24.091 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-23T18:08:24.091 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-23T18:08:24.091 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-23T18:08:24.092 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-23T18:08:24.093 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-23T18:08:24.094 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-23T18:08:24.095 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-23T18:08:24.096 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-23T18:08:24.097 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-23T18:08:24.098 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-23T18:08:24.099 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-23T18:08:24.100 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-23T18:08:24.101 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-23T18:08:24.102 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-23T18:08:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-23T18:08:24.104 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-23T18:08:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-23T18:08:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-23T18:08:24.107 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-23T18:08:24.108 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-23T18:08:24.109 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-23T18:08:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-23T18:08:24.111 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-23T18:08:24.112 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-23T18:08:24.113 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-23T18:08:24.114 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-23T18:08:24.115 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-23T18:08:24.116 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-23T18:08:24.117 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-23T18:08:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-23T18:08:24.119 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-23T18:08:24.119 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-23T18:08:24.119 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-23T18:08:24.119 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-23T18:08:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-23T18:08:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-23T18:08:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-23T18:08:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-23T18:08:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-23T18:08:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-23T18:08:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-23T18:08:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-23T18:08:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-23T18:08:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-23T18:08:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-23T18:08:24.155 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-23T18:08:24.156 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-23T18:08:24.157 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-23T18:08:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-23T18:08:24.159 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-23T18:08:24.160 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-23T18:08:24.160 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-23T18:08:24.160 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-23T18:08:24.160 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-23T18:08:24.160 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-23T18:08:24.160 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-23T18:08:24.160 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-23T18:08:24.160 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-23T18:08:24.160 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-23T18:08:24.161 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-23T18:08:24.162 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-23T18:08:24.163 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-23T18:08:24.164 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-23T18:08:24.165 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-23T18:08:24.166 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-23T18:08:24.167 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-23T18:08:24.168 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-23T18:08:24.169 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-23T18:08:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-23T18:08:24.171 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-23T18:08:24.172 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-23T18:08:24.173 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-23T18:08:24.174 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-23T18:08:24.175 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-23T18:08:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-23T18:08:24.177 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-23T18:08:24.178 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-23T18:08:24.179 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-23T18:08:24.180 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-23T18:08:24.181 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-23T18:08:24.182 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-23T18:08:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-23T18:08:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-23T18:08:24.185 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-23T18:08:24.186 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-23T18:08:24.187 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-23T18:08:24.188 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-23T18:08:24.188 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-23T18:08:24.188 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-23T18:08:24.188 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-23T18:08:24.188 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-23T18:08:24.188 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-23T18:08:24.196 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-23T18:08:24.196 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-23T18:08:24.196 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-23T18:08:24.196 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-23T18:08:24.196 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-23T18:08:24.196 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-23T18:08:24.196 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-23T18:08:24.196 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-23T18:08:24.197 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-23T18:08:24.198 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-23T18:08:24.199 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-23T18:08:24.200 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-23T18:08:24.201 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-23T18:08:24.202 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-23T18:08:24.203 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-23T18:08:24.204 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-23T18:08:24.205 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-23T18:08:24.206 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-23T18:08:24.206 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-23T18:08:24.206 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-23T18:08:24.206 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-23T18:08:24.206 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-23T18:08:24.206 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-23T18:08:24.207 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-23T18:08:24.207 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-23T18:08:24.207 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-23T18:08:24.207 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-23T18:08:24.207 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-23T18:08:24.207 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-23T18:08:24.207 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-23T18:08:24.208 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-23T18:08:24.208 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-23T18:08:24.208 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-23T18:08:24.208 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-23T18:08:24.208 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-23T18:08:24.208 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-23T18:08:24.208 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-23T18:08:24.208 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-23T18:08:24.208 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-23T18:08:24.208 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-23T18:08:24.208 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-23T18:08:24.214 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-23T18:08:24.214 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-23T18:08:24.214 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-23T18:08:24.214 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-23T18:08:24.214 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-23T18:08:24.214 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-23T18:08:24.214 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-23T18:08:24.214 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-23T18:08:24.214 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-23T18:08:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-23T18:08:24.216 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-23T18:08:24.216 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-23T18:08:24.216 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-23T18:08:24.216 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-23T18:08:24.216 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-23T18:08:24.216 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-23T18:08:24.216 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-23T18:08:24.216 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-23T18:08:24.216 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-23T18:08:24.219 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-23T18:08:24.219 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-23T18:08:24.219 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-23T18:08:24.219 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-23T18:08:24.219 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-23T18:08:24.219 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-23T18:08:24.219 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-23T18:08:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-23T18:08:24.221 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-23T18:08:24.223 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-23T18:08:24.224 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-23T18:08:24.225 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-23T18:08:24.226 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-23T18:08:24.226 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-23T18:08:24.238 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-23T18:08:24.238 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-23T18:08:24.238 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-23T18:08:24.238 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-23T18:08:24.238 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-23T18:08:24.238 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-23T18:08:24.238 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-23T18:08:24.238 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-23T18:08:24.238 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-23T18:08:24.238 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-23T18:08:24.239 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-23T18:08:24.240 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-23T18:08:24.241 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-23T18:08:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-23T18:08:24.243 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-23T18:08:24.244 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-23T18:08:24.245 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-23T18:08:24.246 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-23T18:08:24.247 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-23T18:08:24.248 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-23T18:08:24.249 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-23T18:08:24.250 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-23T18:08:24.250 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-23T18:08:24.250 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-23T18:08:24.250 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-23T18:08:24.250 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-23T18:08:24.250 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-23T18:08:24.250 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-23T18:08:24.250 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-23T18:08:24.270 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-23T18:08:24.270 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-23T18:08:24.270 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-23T18:08:24.270 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-23T18:08:24.270 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-23T18:08:24.270 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-23T18:08:24.270 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-23T18:08:24.270 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-23T18:08:24.270 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-23T18:08:24.270 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-23T18:08:24.270 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-23T18:08:24.271 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-23T18:08:24.272 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-23T18:08:24.273 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-23T18:08:24.274 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-23T18:08:24.275 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-23T18:08:24.276 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-23T18:08:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-23T18:08:24.278 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-23T18:08:24.279 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-23T18:08:24.280 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-23T18:08:24.281 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-23T18:08:24.282 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-23T18:08:24.283 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-23T18:08:24.284 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-23T18:08:24.285 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-23T18:08:24.286 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-23T18:08:24.286 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-23T18:08:24.286 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-23T18:08:24.286 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-23T18:08:24.286 INFO:teuthology.orchestra.run.smithi028.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-23T18:08:24.286 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-23T18:08:24.286 INFO:teuthology.orchestra.run.smithi028.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-23T18:08:24.291 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-23T18:08:24.291 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-23T18:08:24.292 DEBUG:teuthology.orchestra.run.smithi028:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-23T18:08:24.320 INFO:teuthology.orchestra.run.smithi028.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-23T18:08:24.321 INFO:teuthology.orchestra.run.smithi028.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-23T18:08:24.321 INFO:teuthology.orchestra.run.smithi028.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-23T18:08:24.321 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-23T18:08:24.321 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-23T18:08:24.322 DEBUG:teuthology.orchestra.run.smithi028:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-23T18:08:24.364 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi028.front.sepia.ceph.com to complete... 2024-04-23T18:08:24.882 INFO:teuthology.orchestra.run.smithi028.stderr:Sourcing file `/etc/default/grub' 2024-04-23T18:08:24.884 INFO:teuthology.orchestra.run.smithi028.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T18:08:24.889 INFO:teuthology.orchestra.run.smithi028.stderr:Generating grub configuration file ... 2024-04-23T18:08:25.059 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-23T18:08:25.064 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-23T18:08:25.282 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T18:08:25.288 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T18:08:25.334 INFO:teuthology.orchestra.run.smithi028.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T18:08:25.340 INFO:teuthology.orchestra.run.smithi028.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T18:08:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T18:08:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T18:08:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T18:08:25.466 INFO:teuthology.orchestra.run.smithi028.stderr:done 2024-04-23T18:08:56.570 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-23T18:08:56.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-23T18:08:56.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:09:15.038 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-23T18:09:24.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-23T18:09:24.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:10:24.043 DEBUG:teuthology.orchestra.remote:timed out 2024-04-23T18:10:36.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-23T18:10:36.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:10:36.337 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-04-23T18:10:37.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-23T18:10:37.036 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-23T18:10:37.036 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-04-23T18:10:37.089 INFO:teuthology.orchestra.run.smithi028.stdout:6.9.0-rc3-g806ec36b2112 2024-04-23T18:10:37.089 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-23T18:10:37.090 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T18:10:37.090 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-23T18:10:38.090 DEBUG:teuthology.parallel:result is None 2024-04-23T18:10:38.091 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-23T18:10:38.102 INFO:teuthology.task.internal:Creating test directory... 2024-04-23T18:10:38.102 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T18:10:38.106 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T18:10:38.113 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-23T18:10:38.120 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-23T18:10:38.133 INFO:teuthology.task.internal:Creating archive directory... 2024-04-23T18:10:38.133 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T18:10:38.155 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T18:10:38.177 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-23T18:10:38.184 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-23T18:10:38.184 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T18:10:38.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:10:38.216 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T18:10:38.220 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T18:10:38.282 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:10:38.301 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:10:38.310 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:10:38.320 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:10:38.323 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-23T18:10:38.330 INFO:teuthology.task.internal:Configuring sudo... 2024-04-23T18:10:38.331 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T18:10:38.334 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T18:10:38.370 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-23T18:10:38.380 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-23T18:10:38.380 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T18:10:38.399 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T18:10:38.416 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T18:10:38.461 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T18:10:38.513 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:10:38.513 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T18:10:38.586 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T18:10:38.592 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T18:10:38.641 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:10:38.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T18:10:38.708 DEBUG:teuthology.orchestra.run.smithi028:> sudo service rsyslog restart 2024-04-23T18:10:38.711 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-04-23T18:10:38.826 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-23T18:10:38.837 INFO:teuthology.task.internal:Starting timer... 2024-04-23T18:10:38.837 INFO:teuthology.run_tasks:Running task pcp... 2024-04-23T18:10:38.878 INFO:teuthology.run_tasks:Running task selinux... 2024-04-23T18:10:38.887 DEBUG:teuthology.task.selinux:Excluding smithi028: OS 'ubuntu' does not support SELinux 2024-04-23T18:10:38.887 DEBUG:teuthology.task.selinux:Excluding smithi137: OS 'ubuntu' does not support SELinux 2024-04-23T18:10:38.887 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-23T18:10:38.887 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-23T18:10:38.887 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-23T18:10:38.887 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-23T18:10:38.896 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-23T18:10:38.914 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-23T18:10:38.916 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi028.front.sepia.ceph.com,smithi137.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-23T18:18:23.300 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi028.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com')] 2024-04-23T18:18:23.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-23T18:18:23.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:18:23.383 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-04-23T18:18:23.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-23T18:18:23.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-23T18:18:23.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:18:23.609 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-23T18:18:23.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-23T18:18:23.707 INFO:teuthology.run_tasks:Running task clock... 2024-04-23T18:18:23.718 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-23T18:18:23.718 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T18:18:23.719 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T18:18:23.722 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T18:18:23.722 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T18:18:23.758 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-23T18:18:23.759 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: Command line: ntpd -gq 2024-04-23T18:18:23.759 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: ---------------------------------------------------- 2024-04-23T18:18:23.759 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: ntp-4 is maintained by Network Time Foundation, 2024-04-23T18:18:23.759 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-23T18:18:23.759 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: corporation. Support and training for ntp-4 are 2024-04-23T18:18:23.759 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: available at https://www.nwtime.org/support 2024-04-23T18:18:23.759 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: ---------------------------------------------------- 2024-04-23T18:18:23.760 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: proto: precision = 0.043 usec (-24) 2024-04-23T18:18:23.760 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: basedate set to 2022-02-04 2024-04-23T18:18:23.760 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: gps base set to 2022-02-06 (week 2196) 2024-04-23T18:18:23.760 INFO:teuthology.orchestra.run.smithi028.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T18:18:23.761 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T18:18:23.761 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: restrict ::: KOD does nothing without LIMITED. 2024-04-23T18:18:23.761 INFO:teuthology.orchestra.run.smithi028.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-23T18:18:23.762 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: Listen and drop on 0 v6wildcard [::]:123 2024-04-23T18:18:23.762 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-23T18:18:23.762 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: Listen normally on 2 lo 127.0.0.1:123 2024-04-23T18:18:23.762 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: Listen normally on 3 ens1f0 172.21.15.28:123 2024-04-23T18:18:23.762 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: Listen normally on 4 lo [::1]:123 2024-04-23T18:18:23.762 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:ca3c%2]:123 2024-04-23T18:18:23.762 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:23 ntpd[17165]: Listening on routing socket on fd #22 for interface updates 2024-04-23T18:18:23.777 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-23T18:18:23.777 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: Command line: ntpd -gq 2024-04-23T18:18:23.777 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: ---------------------------------------------------- 2024-04-23T18:18:23.777 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: ntp-4 is maintained by Network Time Foundation, 2024-04-23T18:18:23.777 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-23T18:18:23.777 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: corporation. Support and training for ntp-4 are 2024-04-23T18:18:23.777 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: available at https://www.nwtime.org/support 2024-04-23T18:18:23.778 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: ---------------------------------------------------- 2024-04-23T18:18:23.778 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: proto: precision = 0.070 usec (-24) 2024-04-23T18:18:23.778 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: basedate set to 2022-02-04 2024-04-23T18:18:23.778 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: gps base set to 2022-02-06 (week 2196) 2024-04-23T18:18:23.778 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T18:18:23.778 INFO:teuthology.orchestra.run.smithi137.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T18:18:23.778 INFO:teuthology.orchestra.run.smithi137.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-23T18:18:23.779 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: restrict ::: KOD does nothing without LIMITED. 2024-04-23T18:18:23.780 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: Listen and drop on 0 v6wildcard [::]:123 2024-04-23T18:18:23.780 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-23T18:18:23.780 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: Listen normally on 2 lo 127.0.0.1:123 2024-04-23T18:18:23.780 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: Listen normally on 3 enp3s0f1 172.21.15.137:123 2024-04-23T18:18:23.780 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: Listen normally on 4 lo [::1]:123 2024-04-23T18:18:23.780 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8137%5]:123 2024-04-23T18:18:23.780 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:23 ntpd[17627]: Listening on routing socket on fd #22 for interface updates 2024-04-23T18:18:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:24 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:24 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:24 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:24 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:24 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:24 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:25.776 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:25 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:25 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:25 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:25 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:25 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:25.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:25 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:26.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:26 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:26.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:26 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:26.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:26 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:26.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:26 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:26.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:26 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:26.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:26 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:26.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:26 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:26.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:26 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:26.776 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:26 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:26.776 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:26 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:26.776 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:26 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:26.776 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:26 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:26.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:26 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:26.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:26 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:27.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:27 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:27.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:27 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:27.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:27 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:27.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:27 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:27.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:27 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:27.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:27 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:27.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:27.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:27.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:27.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:27.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:27.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:27.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:27.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:27.778 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:27.778 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:27.778 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:27.778 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:27.778 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:27.778 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:27 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:28.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:28.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:28.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:28.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:28.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:28.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:28.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:28.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:28.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:28.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:28.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:28.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:28 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:28.776 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:28 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:28.776 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:28 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:28.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:28 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:28.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:28 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:28.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:28 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:28.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:28 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:29.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:29 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:29.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:29 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:29.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:29 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:29.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:29 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:29.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:29 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:29.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:29 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:29.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:29.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:29.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:29.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:29.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:29.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:29.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:29.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:29.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:29.778 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:29.778 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:29.778 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:29 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:30.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:30 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:30.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:30 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:30.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:30 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:30.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:30 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:30.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:30 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:30.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:30 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:30.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:30 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:30.760 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:30 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:30.760 INFO:teuthology.orchestra.run.smithi028.stdout:23 Apr 18:18:30 ntpd[17165]: ntpd: time slew -0.001412 s 2024-04-23T18:18:30.761 INFO:teuthology.orchestra.run.smithi028.stdout:ntpd: time slew -0.001412s 2024-04-23T18:18:30.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:30 ntpd[17165]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-23T18:18:30.761 INFO:teuthology.orchestra.run.smithi028.stderr:23 Apr 18:18:30 ntpd[17165]: can't open /var/log/ntpstats/loopstats.20240423: Permission denied 2024-04-23T18:18:30.776 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:30 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:30.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:30 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:30.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:30 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:30.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:30 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:30.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:30 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:30.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:30 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:30.853 INFO:teuthology.orchestra.run.smithi028.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T18:18:30.853 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================== 2024-04-23T18:18:30.853 INFO:teuthology.orchestra.run.smithi028.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:18:30.853 INFO:teuthology.orchestra.run.smithi028.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:18:30.853 INFO:teuthology.orchestra.run.smithi028.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:18:30.853 INFO:teuthology.orchestra.run.smithi028.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:18:31.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:31 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:31.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:31 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:31.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:31 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:31.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:31 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:31.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:31 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T18:18:31.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:31 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T18:18:31.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:31 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T18:18:31.777 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:31 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T18:18:31.778 INFO:teuthology.orchestra.run.smithi137.stdout:23 Apr 18:18:31 ntpd[17627]: ntpd: time slew -0.003241 s 2024-04-23T18:18:31.778 INFO:teuthology.orchestra.run.smithi137.stdout:ntpd: time slew -0.003241s 2024-04-23T18:18:31.778 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:31 ntpd[17627]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-23T18:18:31.778 INFO:teuthology.orchestra.run.smithi137.stderr:23 Apr 18:18:31 ntpd[17627]: can't open /var/log/ntpstats/loopstats.20240423: Permission denied 2024-04-23T18:18:31.853 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T18:18:31.853 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-04-23T18:18:31.853 INFO:teuthology.orchestra.run.smithi137.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:18:31.853 INFO:teuthology.orchestra.run.smithi137.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:18:31.853 INFO:teuthology.orchestra.run.smithi137.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:18:31.853 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T18:18:31.854 INFO:teuthology.run_tasks:Running task install... 2024-04-23T18:18:31.862 DEBUG:teuthology.task.install:project ceph 2024-04-23T18:18:31.863 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}} 2024-04-23T18:18:31.863 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'} 2024-04-23T18:18:31.863 INFO:teuthology.task.install:Using flavor: default 2024-04-23T18:18:31.868 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-23T18:18:31.868 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-23T18:18:31.868 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-key list | grep Ceph 2024-04-23T18:18:31.869 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-key list | grep Ceph 2024-04-23T18:18:31.962 INFO:teuthology.orchestra.run.smithi137.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-23T18:18:31.976 INFO:teuthology.orchestra.run.smithi028.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-23T18:18:31.992 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-23T18:18:31.992 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph.com (release key) 2024-04-23T18:18:31.993 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-23T18:18:31.993 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-23T18:18:31.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T18:18:32.029 INFO:teuthology.orchestra.run.smithi028.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-23T18:18:32.029 INFO:teuthology.orchestra.run.smithi028.stdout:uid [ unknown] Ceph.com (release key) 2024-04-23T18:18:32.030 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-23T18:18:32.030 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-23T18:18:32.030 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T18:18:32.170 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default/ 2024-04-23T18:18:32.171 INFO:teuthology.task.install.deb:Package version is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T18:18:32.225 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default/ 2024-04-23T18:18:32.225 INFO:teuthology.task.install.deb:Package version is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T18:18:32.277 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:18:32.278 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-23T18:18:32.298 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-get update 2024-04-23T18:18:32.330 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:18:32.330 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-23T18:18:32.344 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-04-23T18:18:32.491 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T18:18:32.491 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T18:18:32.499 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T18:18:32.515 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T18:18:32.515 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T18:18:32.519 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T18:18:32.527 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T18:18:32.547 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T18:18:32.562 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy InRelease 2024-04-23T18:18:32.583 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-23T18:18:32.591 INFO:teuthology.orchestra.run.smithi028.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy InRelease 2024-04-23T18:18:32.605 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-23T18:18:32.626 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-23T18:18:32.627 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-23T18:18:32.653 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-23T18:18:32.664 INFO:teuthology.orchestra.run.smithi028.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-23T18:18:32.701 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-23T18:18:32.790 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-23T18:18:32.868 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 29.3 kB in 0s (85.0 kB/s) 2024-04-23T18:18:33.105 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 29.3 kB in 1s (50.5 kB/s) 2024-04-23T18:18:33.854 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-04-23T18:18:33.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3156-gd69f13d8-1jammy cephadm=19.0.0-3156-gd69f13d8-1jammy ceph-mds=19.0.0-3156-gd69f13d8-1jammy ceph-mgr=19.0.0-3156-gd69f13d8-1jammy ceph-common=19.0.0-3156-gd69f13d8-1jammy ceph-fuse=19.0.0-3156-gd69f13d8-1jammy ceph-test=19.0.0-3156-gd69f13d8-1jammy ceph-volume=19.0.0-3156-gd69f13d8-1jammy radosgw=19.0.0-3156-gd69f13d8-1jammy python3-rados=19.0.0-3156-gd69f13d8-1jammy python3-rgw=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy python3-rbd=19.0.0-3156-gd69f13d8-1jammy libcephfs2=19.0.0-3156-gd69f13d8-1jammy libcephfs-dev=19.0.0-3156-gd69f13d8-1jammy librados2=19.0.0-3156-gd69f13d8-1jammy librbd1=19.0.0-3156-gd69f13d8-1jammy rbd-fuse=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy cephfs-shell=19.0.0-3156-gd69f13d8-1jammy cephfs-top=19.0.0-3156-gd69f13d8-1jammy cephfs-mirror=19.0.0-3156-gd69f13d8-1jammy 2024-04-23T18:18:33.923 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-04-23T18:18:34.109 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-04-23T18:18:34.109 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-04-23T18:18:34.121 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2024-04-23T18:18:34.136 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3156-gd69f13d8-1jammy cephadm=19.0.0-3156-gd69f13d8-1jammy ceph-mds=19.0.0-3156-gd69f13d8-1jammy ceph-mgr=19.0.0-3156-gd69f13d8-1jammy ceph-common=19.0.0-3156-gd69f13d8-1jammy ceph-fuse=19.0.0-3156-gd69f13d8-1jammy ceph-test=19.0.0-3156-gd69f13d8-1jammy ceph-volume=19.0.0-3156-gd69f13d8-1jammy radosgw=19.0.0-3156-gd69f13d8-1jammy python3-rados=19.0.0-3156-gd69f13d8-1jammy python3-rgw=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy python3-rbd=19.0.0-3156-gd69f13d8-1jammy libcephfs2=19.0.0-3156-gd69f13d8-1jammy libcephfs-dev=19.0.0-3156-gd69f13d8-1jammy librados2=19.0.0-3156-gd69f13d8-1jammy librbd1=19.0.0-3156-gd69f13d8-1jammy rbd-fuse=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy cephfs-shell=19.0.0-3156-gd69f13d8-1jammy cephfs-top=19.0.0-3156-gd69f13d8-1jammy cephfs-mirror=19.0.0-3156-gd69f13d8-1jammy 2024-04-23T18:18:34.213 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2024-04-23T18:18:34.289 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T18:18:34.289 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T18:18:34.289 INFO:teuthology.orchestra.run.smithi137.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T18:18:34.290 INFO:teuthology.orchestra.run.smithi137.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T18:18:34.290 INFO:teuthology.orchestra.run.smithi137.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-23T18:18:34.290 INFO:teuthology.orchestra.run.smithi137.stdout: python2.7-minimal 2024-04-23T18:18:34.290 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T18:18:34.291 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-04-23T18:18:34.291 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-23T18:18:34.291 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-23T18:18:34.292 INFO:teuthology.orchestra.run.smithi137.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T18:18:34.292 INFO:teuthology.orchestra.run.smithi137.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-23T18:18:34.292 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-23T18:18:34.292 INFO:teuthology.orchestra.run.smithi137.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-23T18:18:34.292 INFO:teuthology.orchestra.run.smithi137.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-23T18:18:34.292 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-23T18:18:34.292 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-23T18:18:34.292 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-23T18:18:34.293 INFO:teuthology.orchestra.run.smithi137.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-23T18:18:34.294 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-04-23T18:18:34.294 INFO:teuthology.orchestra.run.smithi137.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-23T18:18:34.294 INFO:teuthology.orchestra.run.smithi137.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-23T18:18:34.294 INFO:teuthology.orchestra.run.smithi137.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-23T18:18:34.294 INFO:teuthology.orchestra.run.smithi137.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-23T18:18:34.294 INFO:teuthology.orchestra.run.smithi137.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-23T18:18:34.294 INFO:teuthology.orchestra.run.smithi137.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-23T18:18:34.294 INFO:teuthology.orchestra.run.smithi137.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-23T18:18:34.294 INFO:teuthology.orchestra.run.smithi137.stdout:Recommended packages: 2024-04-23T18:18:34.295 INFO:teuthology.orchestra.run.smithi137.stdout: btrfs-tools 2024-04-23T18:18:34.392 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2024-04-23T18:18:34.392 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2024-04-23T18:18:34.402 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-04-23T18:18:34.402 INFO:teuthology.orchestra.run.smithi137.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-23T18:18:34.402 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-23T18:18:34.402 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-23T18:18:34.402 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-23T18:18:34.402 INFO:teuthology.orchestra.run.smithi137.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T18:18:34.402 INFO:teuthology.orchestra.run.smithi137.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-23T18:18:34.402 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-23T18:18:34.402 INFO:teuthology.orchestra.run.smithi137.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-23T18:18:34.403 INFO:teuthology.orchestra.run.smithi137.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-23T18:18:34.404 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-23T18:18:34.404 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-23T18:18:34.404 INFO:teuthology.orchestra.run.smithi137.stdout: socat unzip xmlstarlet zip 2024-04-23T18:18:34.545 INFO:teuthology.orchestra.run.smithi137.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-23T18:18:34.545 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 182 MB of archives. 2024-04-23T18:18:34.545 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-23T18:18:34.545 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3156-gd69f13d8-1jammy [3,555 kB] 2024-04-23T18:18:34.571 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T18:18:34.571 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T18:18:34.571 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T18:18:34.571 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T18:18:34.571 INFO:teuthology.orchestra.run.smithi028.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T18:18:34.571 INFO:teuthology.orchestra.run.smithi028.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T18:18:34.572 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T18:18:34.572 INFO:teuthology.orchestra.run.smithi028.stdout:The following additional packages will be installed: 2024-04-23T18:18:34.572 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-23T18:18:34.573 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-23T18:18:34.573 INFO:teuthology.orchestra.run.smithi028.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T18:18:34.573 INFO:teuthology.orchestra.run.smithi028.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-23T18:18:34.573 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-23T18:18:34.573 INFO:teuthology.orchestra.run.smithi028.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-23T18:18:34.573 INFO:teuthology.orchestra.run.smithi028.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-23T18:18:34.573 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-23T18:18:34.574 INFO:teuthology.orchestra.run.smithi028.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-23T18:18:34.575 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-23T18:18:34.575 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-23T18:18:34.575 INFO:teuthology.orchestra.run.smithi028.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-23T18:18:34.575 INFO:teuthology.orchestra.run.smithi028.stdout:Suggested packages: 2024-04-23T18:18:34.575 INFO:teuthology.orchestra.run.smithi028.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-23T18:18:34.575 INFO:teuthology.orchestra.run.smithi028.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-23T18:18:34.575 INFO:teuthology.orchestra.run.smithi028.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-23T18:18:34.575 INFO:teuthology.orchestra.run.smithi028.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-23T18:18:34.575 INFO:teuthology.orchestra.run.smithi028.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-23T18:18:34.575 INFO:teuthology.orchestra.run.smithi028.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-23T18:18:34.576 INFO:teuthology.orchestra.run.smithi028.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-23T18:18:34.576 INFO:teuthology.orchestra.run.smithi028.stdout:Recommended packages: 2024-04-23T18:18:34.576 INFO:teuthology.orchestra.run.smithi028.stdout: btrfs-tools 2024-04-23T18:18:34.591 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-23T18:18:34.674 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-23T18:18:34.721 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-23T18:18:34.732 INFO:teuthology.orchestra.run.smithi028.stdout:The following NEW packages will be installed: 2024-04-23T18:18:34.732 INFO:teuthology.orchestra.run.smithi028.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-23T18:18:34.732 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-23T18:18:34.732 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-23T18:18:34.732 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-23T18:18:34.732 INFO:teuthology.orchestra.run.smithi028.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T18:18:34.732 INFO:teuthology.orchestra.run.smithi028.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-23T18:18:34.732 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-23T18:18:34.733 INFO:teuthology.orchestra.run.smithi028.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-23T18:18:34.734 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-23T18:18:34.735 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-23T18:18:34.735 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-23T18:18:34.735 INFO:teuthology.orchestra.run.smithi028.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-23T18:18:34.735 INFO:teuthology.orchestra.run.smithi028.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-23T18:18:34.735 INFO:teuthology.orchestra.run.smithi028.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-23T18:18:34.735 INFO:teuthology.orchestra.run.smithi028.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-23T18:18:34.735 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-23T18:18:34.735 INFO:teuthology.orchestra.run.smithi028.stdout: socat unzip xmlstarlet zip 2024-04-23T18:18:34.931 INFO:teuthology.orchestra.run.smithi028.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-23T18:18:34.931 INFO:teuthology.orchestra.run.smithi028.stdout:Need to get 182 MB of archives. 2024-04-23T18:18:34.931 INFO:teuthology.orchestra.run.smithi028.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-23T18:18:34.931 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-23T18:18:34.936 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-23T18:18:35.014 INFO:teuthology.orchestra.run.smithi028.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-23T18:18:35.037 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3156-gd69f13d8-1jammy [3,224 kB] 2024-04-23T18:18:35.059 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-23T18:18:35.061 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-23T18:18:35.088 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-23T18:18:35.093 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3156-gd69f13d8-1jammy [3,555 kB] 2024-04-23T18:18:35.168 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-23T18:18:35.261 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-23T18:18:35.355 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-23T18:18:35.365 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3156-gd69f13d8-1jammy [712 kB] 2024-04-23T18:18:35.368 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-23T18:18:35.419 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-23T18:18:35.436 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3156-gd69f13d8-1jammy [356 kB] 2024-04-23T18:18:35.475 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3156-gd69f13d8-1jammy [32.8 kB] 2024-04-23T18:18:35.477 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3156-gd69f13d8-1jammy [180 kB] 2024-04-23T18:18:35.478 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-23T18:18:35.490 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-23T18:18:35.495 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3156-gd69f13d8-1jammy [66.9 kB] 2024-04-23T18:18:35.500 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3156-gd69f13d8-1jammy [330 kB] 2024-04-23T18:18:35.533 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3156-gd69f13d8-1jammy [6,894 kB] 2024-04-23T18:18:35.533 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-23T18:18:35.547 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-23T18:18:35.593 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-23T18:18:35.603 INFO:teuthology.orchestra.run.smithi028.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-23T18:18:35.630 INFO:teuthology.orchestra.run.smithi028.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-23T18:18:35.638 INFO:teuthology.orchestra.run.smithi028.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-23T18:18:35.712 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-23T18:18:35.803 INFO:teuthology.orchestra.run.smithi028.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-23T18:18:36.190 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3156-gd69f13d8-1jammy [112 kB] 2024-04-23T18:18:36.193 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3156-gd69f13d8-1jammy [466 kB] 2024-04-23T18:18:36.225 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3156-gd69f13d8-1jammy [25.8 MB] 2024-04-23T18:18:36.287 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-23T18:18:36.302 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-23T18:18:36.318 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-23T18:18:36.327 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-23T18:18:36.327 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-23T18:18:36.343 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-23T18:18:36.382 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-23T18:18:36.389 INFO:teuthology.orchestra.run.smithi028.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-23T18:18:36.395 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-23T18:18:36.399 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-23T18:18:36.399 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-23T18:18:36.406 INFO:teuthology.orchestra.run.smithi028.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-23T18:18:36.422 INFO:teuthology.orchestra.run.smithi028.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-23T18:18:36.431 INFO:teuthology.orchestra.run.smithi028.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-23T18:18:36.431 INFO:teuthology.orchestra.run.smithi028.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-23T18:18:36.447 INFO:teuthology.orchestra.run.smithi028.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-23T18:18:36.484 INFO:teuthology.orchestra.run.smithi028.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-23T18:18:36.497 INFO:teuthology.orchestra.run.smithi028.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-23T18:18:36.501 INFO:teuthology.orchestra.run.smithi028.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-23T18:18:36.501 INFO:teuthology.orchestra.run.smithi028.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-23T18:18:36.570 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-23T18:18:36.652 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-23T18:18:36.667 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-23T18:18:36.673 INFO:teuthology.orchestra.run.smithi028.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-23T18:18:36.734 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-23T18:18:36.758 INFO:teuthology.orchestra.run.smithi028.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-23T18:18:36.765 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-23T18:18:36.777 INFO:teuthology.orchestra.run.smithi028.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-23T18:18:36.785 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-23T18:18:36.807 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-23T18:18:36.840 INFO:teuthology.orchestra.run.smithi028.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-23T18:18:36.883 INFO:teuthology.orchestra.run.smithi028.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-23T18:18:36.904 INFO:teuthology.orchestra.run.smithi028.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-23T18:18:36.929 INFO:teuthology.orchestra.run.smithi028.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-23T18:18:37.006 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-23T18:18:37.021 INFO:teuthology.orchestra.run.smithi137.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-23T18:18:37.028 INFO:teuthology.orchestra.run.smithi137.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-23T18:18:37.034 INFO:teuthology.orchestra.run.smithi137.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-23T18:18:37.121 INFO:teuthology.orchestra.run.smithi028.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-23T18:18:37.140 INFO:teuthology.orchestra.run.smithi028.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-23T18:18:37.150 INFO:teuthology.orchestra.run.smithi028.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-23T18:18:37.158 INFO:teuthology.orchestra.run.smithi028.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-23T18:18:37.228 INFO:teuthology.orchestra.run.smithi137.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-23T18:18:37.311 INFO:teuthology.orchestra.run.smithi137.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-23T18:18:37.327 INFO:teuthology.orchestra.run.smithi137.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-23T18:18:37.363 INFO:teuthology.orchestra.run.smithi028.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-23T18:18:37.446 INFO:teuthology.orchestra.run.smithi028.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-23T18:18:37.460 INFO:teuthology.orchestra.run.smithi028.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-23T18:18:37.486 INFO:teuthology.orchestra.run.smithi028.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3156-gd69f13d8-1jammy [3,224 kB] 2024-04-23T18:18:37.512 INFO:teuthology.orchestra.run.smithi137.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-23T18:18:37.563 INFO:teuthology.orchestra.run.smithi137.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-23T18:18:37.577 INFO:teuthology.orchestra.run.smithi137.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-23T18:18:37.636 INFO:teuthology.orchestra.run.smithi028.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-23T18:18:37.685 INFO:teuthology.orchestra.run.smithi028.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-23T18:18:37.698 INFO:teuthology.orchestra.run.smithi028.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-23T18:18:37.735 INFO:teuthology.orchestra.run.smithi137.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-23T18:18:37.736 INFO:teuthology.orchestra.run.smithi137.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-23T18:18:37.741 INFO:teuthology.orchestra.run.smithi137.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-23T18:18:37.746 INFO:teuthology.orchestra.run.smithi137.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-23T18:18:37.760 INFO:teuthology.orchestra.run.smithi137.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-23T18:18:37.857 INFO:teuthology.orchestra.run.smithi028.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-23T18:18:37.857 INFO:teuthology.orchestra.run.smithi028.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-23T18:18:37.862 INFO:teuthology.orchestra.run.smithi028.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-23T18:18:37.867 INFO:teuthology.orchestra.run.smithi028.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-23T18:18:37.881 INFO:teuthology.orchestra.run.smithi028.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-23T18:18:37.945 INFO:teuthology.orchestra.run.smithi137.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-23T18:18:38.068 INFO:teuthology.orchestra.run.smithi028.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-23T18:18:38.198 INFO:teuthology.orchestra.run.smithi137.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-23T18:18:38.311 INFO:teuthology.orchestra.run.smithi137.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-23T18:18:38.334 INFO:teuthology.orchestra.run.smithi028.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-23T18:18:38.359 INFO:teuthology.orchestra.run.smithi137.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-23T18:18:38.469 INFO:teuthology.orchestra.run.smithi028.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-23T18:18:38.511 INFO:teuthology.orchestra.run.smithi028.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-23T18:18:38.600 INFO:teuthology.orchestra.run.smithi137.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3156-gd69f13d8-1jammy [5,094 kB] 2024-04-23T18:18:38.603 INFO:teuthology.orchestra.run.smithi028.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-23T18:18:38.619 INFO:teuthology.orchestra.run.smithi028.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-23T18:18:38.631 INFO:teuthology.orchestra.run.smithi028.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-23T18:18:38.677 INFO:teuthology.orchestra.run.smithi028.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-23T18:18:38.845 INFO:teuthology.orchestra.run.smithi137.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-23T18:18:38.962 INFO:teuthology.orchestra.run.smithi028.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-23T18:18:38.963 INFO:teuthology.orchestra.run.smithi028.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-23T18:18:38.965 INFO:teuthology.orchestra.run.smithi028.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-23T18:18:38.988 INFO:teuthology.orchestra.run.smithi137.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-23T18:18:38.994 INFO:teuthology.orchestra.run.smithi137.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3156-gd69f13d8-1jammy [244 kB] 2024-04-23T18:18:39.018 INFO:teuthology.orchestra.run.smithi137.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-23T18:18:39.018 INFO:teuthology.orchestra.run.smithi137.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T18:18:39.029 INFO:teuthology.orchestra.run.smithi137.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3156-gd69f13d8-1jammy [1,527 kB] 2024-04-23T18:18:39.187 INFO:teuthology.orchestra.run.smithi137.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3156-gd69f13d8-1jammy [6,260 kB] 2024-04-23T18:18:39.270 INFO:teuthology.orchestra.run.smithi028.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3156-gd69f13d8-1jammy [712 kB] 2024-04-23T18:18:39.305 INFO:teuthology.orchestra.run.smithi137.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-23T18:18:39.621 INFO:teuthology.orchestra.run.smithi028.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3156-gd69f13d8-1jammy [356 kB] 2024-04-23T18:18:39.633 INFO:teuthology.orchestra.run.smithi028.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-23T18:18:39.815 INFO:teuthology.orchestra.run.smithi028.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3156-gd69f13d8-1jammy [32.8 kB] 2024-04-23T18:18:39.819 INFO:teuthology.orchestra.run.smithi028.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3156-gd69f13d8-1jammy [180 kB] 2024-04-23T18:18:39.831 INFO:teuthology.orchestra.run.smithi137.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3156-gd69f13d8-1jammy [22.8 MB] 2024-04-23T18:18:39.901 INFO:teuthology.orchestra.run.smithi028.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3156-gd69f13d8-1jammy [66.9 kB] 2024-04-23T18:18:39.974 INFO:teuthology.orchestra.run.smithi028.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3156-gd69f13d8-1jammy [330 kB] 2024-04-23T18:18:39.981 INFO:teuthology.orchestra.run.smithi028.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-23T18:18:40.137 INFO:teuthology.orchestra.run.smithi028.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3156-gd69f13d8-1jammy [6,894 kB] 2024-04-23T18:18:40.406 INFO:teuthology.orchestra.run.smithi028.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-23T18:18:40.416 INFO:teuthology.orchestra.run.smithi028.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-23T18:18:40.416 INFO:teuthology.orchestra.run.smithi028.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-23T18:18:40.488 INFO:teuthology.orchestra.run.smithi028.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-23T18:18:40.488 INFO:teuthology.orchestra.run.smithi028.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-23T18:18:40.489 INFO:teuthology.orchestra.run.smithi028.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-23T18:18:40.490 INFO:teuthology.orchestra.run.smithi028.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-23T18:18:40.491 INFO:teuthology.orchestra.run.smithi028.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-23T18:18:40.492 INFO:teuthology.orchestra.run.smithi028.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-23T18:18:40.656 INFO:teuthology.orchestra.run.smithi028.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-23T18:18:40.861 INFO:teuthology.orchestra.run.smithi028.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-23T18:18:41.186 INFO:teuthology.orchestra.run.smithi028.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-23T18:18:41.246 INFO:teuthology.orchestra.run.smithi028.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-23T18:18:41.270 INFO:teuthology.orchestra.run.smithi028.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-23T18:18:41.278 INFO:teuthology.orchestra.run.smithi028.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-23T18:18:41.330 INFO:teuthology.orchestra.run.smithi028.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-23T18:18:41.360 INFO:teuthology.orchestra.run.smithi028.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-23T18:18:41.362 INFO:teuthology.orchestra.run.smithi028.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-23T18:18:41.368 INFO:teuthology.orchestra.run.smithi028.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-23T18:18:41.371 INFO:teuthology.orchestra.run.smithi028.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-23T18:18:41.570 INFO:teuthology.orchestra.run.smithi028.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-23T18:18:41.823 INFO:teuthology.orchestra.run.smithi028.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-23T18:18:41.961 INFO:teuthology.orchestra.run.smithi137.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3156-gd69f13d8-1jammy [14.0 kB] 2024-04-23T18:18:41.961 INFO:teuthology.orchestra.run.smithi137.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [870 kB] 2024-04-23T18:18:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3156-gd69f13d8-1jammy [2,435 kB] 2024-04-23T18:18:42.082 INFO:teuthology.orchestra.run.smithi137.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3156-gd69f13d8-1jammy [791 kB] 2024-04-23T18:18:42.097 INFO:teuthology.orchestra.run.smithi028.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-23T18:18:42.100 INFO:teuthology.orchestra.run.smithi028.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-23T18:18:42.116 INFO:teuthology.orchestra.run.smithi028.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-23T18:18:42.119 INFO:teuthology.orchestra.run.smithi137.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3156-gd69f13d8-1jammy [148 kB] 2024-04-23T18:18:42.122 INFO:teuthology.orchestra.run.smithi028.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-23T18:18:42.128 INFO:teuthology.orchestra.run.smithi137.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3156-gd69f13d8-1jammy [2,324 kB] 2024-04-23T18:18:42.163 INFO:teuthology.orchestra.run.smithi028.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-23T18:18:42.178 INFO:teuthology.orchestra.run.smithi028.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-23T18:18:42.257 INFO:teuthology.orchestra.run.smithi137.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3156-gd69f13d8-1jammy [8,625 kB] 2024-04-23T18:18:42.267 INFO:teuthology.orchestra.run.smithi028.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-23T18:18:42.269 INFO:teuthology.orchestra.run.smithi028.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-23T18:18:42.270 INFO:teuthology.orchestra.run.smithi028.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-23T18:18:42.452 INFO:teuthology.orchestra.run.smithi028.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-23T18:18:42.729 INFO:teuthology.orchestra.run.smithi028.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-23T18:18:42.764 INFO:teuthology.orchestra.run.smithi137.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3156-gd69f13d8-1jammy [14.2 kB] 2024-04-23T18:18:42.765 INFO:teuthology.orchestra.run.smithi137.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3156-gd69f13d8-1jammy [51.6 MB] 2024-04-23T18:18:43.038 INFO:teuthology.orchestra.run.smithi028.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3156-gd69f13d8-1jammy [112 kB] 2024-04-23T18:18:43.087 INFO:teuthology.orchestra.run.smithi028.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3156-gd69f13d8-1jammy [466 kB] 2024-04-23T18:18:43.209 INFO:teuthology.orchestra.run.smithi028.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3156-gd69f13d8-1jammy [25.8 MB] 2024-04-23T18:18:43.247 INFO:teuthology.orchestra.run.smithi137.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-23T18:18:43.294 INFO:teuthology.orchestra.run.smithi137.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-23T18:18:43.413 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 2024-04-23T18:18:43.578 INFO:teuthology.orchestra.run.smithi137.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-23T18:18:43.579 INFO:teuthology.orchestra.run.smithi137.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-23T18:18:43.835 INFO:teuthology.orchestra.run.smithi137.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-23T18:18:44.200 INFO:teuthology.orchestra.run.smithi137.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-23T18:18:44.210 INFO:teuthology.orchestra.run.smithi137.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-23T18:18:44.211 INFO:teuthology.orchestra.run.smithi137.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-23T18:18:44.279 INFO:teuthology.orchestra.run.smithi137.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-23T18:18:44.280 INFO:teuthology.orchestra.run.smithi137.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-23T18:18:44.281 INFO:teuthology.orchestra.run.smithi137.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-23T18:18:44.283 INFO:teuthology.orchestra.run.smithi137.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-23T18:18:44.448 INFO:teuthology.orchestra.run.smithi137.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-23T18:18:44.575 INFO:teuthology.orchestra.run.smithi137.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-23T18:18:44.630 INFO:teuthology.orchestra.run.smithi137.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-23T18:18:44.689 INFO:teuthology.orchestra.run.smithi137.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-23T18:18:44.887 INFO:teuthology.orchestra.run.smithi137.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-23T18:18:44.925 INFO:teuthology.orchestra.run.smithi137.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-23T18:18:44.947 INFO:teuthology.orchestra.run.smithi137.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-23T18:18:44.954 INFO:teuthology.orchestra.run.smithi137.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-23T18:18:44.998 INFO:teuthology.orchestra.run.smithi137.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-23T18:18:45.023 INFO:teuthology.orchestra.run.smithi137.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-23T18:18:45.025 INFO:teuthology.orchestra.run.smithi137.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-23T18:18:45.206 INFO:teuthology.orchestra.run.smithi137.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-23T18:18:45.437 INFO:teuthology.orchestra.run.smithi137.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-23T18:18:45.946 INFO:teuthology.orchestra.run.smithi137.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T18:18:45.948 INFO:teuthology.orchestra.run.smithi137.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3156-gd69f13d8-1jammy [232 kB] 2024-04-23T18:18:45.953 INFO:teuthology.orchestra.run.smithi137.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3156-gd69f13d8-1jammy [33.9 kB] 2024-04-23T18:18:45.954 INFO:teuthology.orchestra.run.smithi137.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3156-gd69f13d8-1jammy [23.4 kB] 2024-04-23T18:18:46.012 INFO:teuthology.orchestra.run.smithi137.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3156-gd69f13d8-1jammy [38.9 kB] 2024-04-23T18:18:46.013 INFO:teuthology.orchestra.run.smithi137.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3156-gd69f13d8-1jammy [13.6 MB] 2024-04-23T18:18:46.437 INFO:teuthology.orchestra.run.smithi137.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [91.6 kB] 2024-04-23T18:18:46.616 INFO:teuthology.orchestra.run.smithi137.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-23T18:18:46.679 INFO:teuthology.orchestra.run.smithi137.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-23T18:18:47.328 INFO:teuthology.orchestra.run.smithi137.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-23T18:18:47.333 INFO:teuthology.orchestra.run.smithi137.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-23T18:18:47.380 INFO:teuthology.orchestra.run.smithi137.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-23T18:18:47.395 INFO:teuthology.orchestra.run.smithi137.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-23T18:18:47.525 INFO:teuthology.orchestra.run.smithi137.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-23T18:18:47.574 INFO:teuthology.orchestra.run.smithi137.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-23T18:18:48.021 INFO:teuthology.orchestra.run.smithi028.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3156-gd69f13d8-1jammy [5,094 kB] 2024-04-23T18:18:48.135 INFO:teuthology.orchestra.run.smithi137.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-23T18:18:48.479 INFO:teuthology.orchestra.run.smithi028.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3156-gd69f13d8-1jammy [244 kB] 2024-04-23T18:18:48.491 INFO:teuthology.orchestra.run.smithi028.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T18:18:48.500 INFO:teuthology.orchestra.run.smithi028.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3156-gd69f13d8-1jammy [1,527 kB] 2024-04-23T18:18:48.610 INFO:teuthology.orchestra.run.smithi137.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-23T18:18:48.633 INFO:teuthology.orchestra.run.smithi028.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3156-gd69f13d8-1jammy [6,260 kB] 2024-04-23T18:18:48.794 INFO:teuthology.orchestra.run.smithi137.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-23T18:18:49.068 INFO:teuthology.orchestra.run.smithi137.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-23T18:18:49.093 INFO:teuthology.orchestra.run.smithi137.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-23T18:18:49.158 INFO:teuthology.orchestra.run.smithi028.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3156-gd69f13d8-1jammy [22.8 MB] 2024-04-23T18:18:49.345 INFO:teuthology.orchestra.run.smithi137.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-23T18:18:49.963 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 181 MB in 15s (12.2 MB/s) 2024-04-23T18:18:50.083 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-23T18:18:50.125 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-04-23T18:18:50.129 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-23T18:18:50.165 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-23T18:18:50.435 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-23T18:18:50.455 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-23T18:18:50.493 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T18:18:50.573 INFO:teuthology.orchestra.run.smithi028.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3156-gd69f13d8-1jammy [14.0 kB] 2024-04-23T18:18:50.573 INFO:teuthology.orchestra.run.smithi028.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [870 kB] 2024-04-23T18:18:50.615 INFO:teuthology.orchestra.run.smithi028.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3156-gd69f13d8-1jammy [2,435 kB] 2024-04-23T18:18:50.734 INFO:teuthology.orchestra.run.smithi028.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3156-gd69f13d8-1jammy [791 kB] 2024-04-23T18:18:50.773 INFO:teuthology.orchestra.run.smithi028.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3156-gd69f13d8-1jammy [148 kB] 2024-04-23T18:18:50.789 INFO:teuthology.orchestra.run.smithi028.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3156-gd69f13d8-1jammy [2,324 kB] 2024-04-23T18:18:50.854 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cmd2. 2024-04-23T18:18:50.874 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-23T18:18:50.900 INFO:teuthology.orchestra.run.smithi028.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3156-gd69f13d8-1jammy [8,625 kB] 2024-04-23T18:18:50.938 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-23T18:18:51.303 INFO:teuthology.orchestra.run.smithi028.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3156-gd69f13d8-1jammy [14.2 kB] 2024-04-23T18:18:51.303 INFO:teuthology.orchestra.run.smithi028.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3156-gd69f13d8-1jammy [51.6 MB] 2024-04-23T18:18:51.332 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-23T18:18:51.353 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-23T18:18:51.432 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T18:18:51.811 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-23T18:18:51.831 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-23T18:18:51.869 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T18:18:52.163 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-23T18:18:52.184 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-23T18:18:52.213 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T18:18:52.742 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-23T18:18:52.763 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:18:52.809 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:18:53.203 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-23T18:18:53.215 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:18:53.229 INFO:teuthology.orchestra.run.smithi028.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T18:18:53.230 INFO:teuthology.orchestra.run.smithi028.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3156-gd69f13d8-1jammy [232 kB] 2024-04-23T18:18:53.232 INFO:teuthology.orchestra.run.smithi028.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3156-gd69f13d8-1jammy [33.9 kB] 2024-04-23T18:18:53.233 INFO:teuthology.orchestra.run.smithi028.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3156-gd69f13d8-1jammy [23.4 kB] 2024-04-23T18:18:53.233 INFO:teuthology.orchestra.run.smithi028.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3156-gd69f13d8-1jammy [38.9 kB] 2024-04-23T18:18:53.233 INFO:teuthology.orchestra.run.smithi028.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3156-gd69f13d8-1jammy [13.6 MB] 2024-04-23T18:18:53.253 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:18:53.590 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-23T18:18:53.611 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:18:53.648 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:18:53.681 INFO:teuthology.orchestra.run.smithi028.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [91.6 kB] 2024-04-23T18:18:54.010 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-23T18:18:54.031 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-23T18:18:54.068 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T18:18:54.342 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 182 MB in 19s (9,589 kB/s) 2024-04-23T18:18:54.345 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librados2. 2024-04-23T18:18:54.357 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../010-librados2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:18:54.387 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:18:54.480 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-23T18:18:54.551 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-23T18:18:54.554 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-23T18:18:54.595 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-23T18:18:54.881 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-23T18:18:54.895 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-23T18:18:54.939 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T18:18:55.098 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librbd1. 2024-04-23T18:18:55.119 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../011-librbd1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:18:55.173 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:18:55.375 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cmd2. 2024-04-23T18:18:55.390 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-23T18:18:55.434 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-23T18:18:55.643 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs2. 2024-04-23T18:18:55.664 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:18:55.701 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:18:55.770 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-23T18:18:55.785 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-23T18:18:55.870 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T18:18:56.003 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rados. 2024-04-23T18:18:56.024 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:18:56.053 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:18:56.207 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-23T18:18:56.222 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-23T18:18:56.265 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T18:18:56.442 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-23T18:18:56.463 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:18:56.556 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:18:56.593 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-23T18:18:56.608 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-23T18:18:56.651 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T18:18:56.834 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cephfs. 2024-04-23T18:18:56.854 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:18:56.892 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:18:57.079 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-23T18:18:57.094 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:18:57.139 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:18:57.211 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-23T18:18:57.223 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:18:57.261 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:18:57.589 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-prettytable. 2024-04-23T18:18:57.610 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-23T18:18:57.639 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-23T18:18:57.649 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-23T18:18:57.664 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:18:57.707 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:18:57.950 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rbd. 2024-04-23T18:18:57.971 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:18:58.008 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:18:58.026 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-23T18:18:58.042 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T18:18:58.084 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:18:58.403 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-23T18:18:58.423 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-23T18:18:58.446 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-23T18:18:58.461 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-23T18:18:58.486 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T18:18:58.504 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T18:18:58.772 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-23T18:18:58.790 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librados2. 2024-04-23T18:18:58.793 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-23T18:18:58.806 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../010-librados2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:18:58.840 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:18:58.846 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T18:18:59.116 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-23T18:18:59.128 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-23T18:18:59.199 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T18:18:59.259 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librbd1. 2024-04-23T18:18:59.275 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../011-librbd1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:18:59.318 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:18:59.570 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua5.1. 2024-04-23T18:18:59.591 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-23T18:18:59.628 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-23T18:18:59.745 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libcephfs2. 2024-04-23T18:18:59.760 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:18:59.803 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:18:59.981 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-any. 2024-04-23T18:19:00.002 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-23T18:19:00.064 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rados. 2024-04-23T18:19:00.079 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:00.114 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:00.164 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-23T18:19:00.367 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-23T18:19:00.382 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:00.416 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:00.458 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package zip. 2024-04-23T18:19:00.470 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-23T18:19:00.500 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking zip (3.0-12build2) ... 2024-04-23T18:19:00.644 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cephfs. 2024-04-23T18:19:00.659 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:00.702 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:00.853 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package unzip. 2024-04-23T18:19:00.874 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-23T18:19:00.953 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-23T18:19:01.038 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-23T18:19:01.054 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:01.096 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:01.365 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package luarocks. 2024-04-23T18:19:01.386 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-23T18:19:01.423 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-23T18:19:01.424 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-prettytable. 2024-04-23T18:19:01.440 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-23T18:19:01.497 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-23T18:19:01.752 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rbd. 2024-04-23T18:19:01.767 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:01.801 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:01.839 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librgw2. 2024-04-23T18:19:01.860 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../027-librgw2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:01.897 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:02.088 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-23T18:19:02.103 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-23T18:19:02.154 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T18:19:02.432 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-23T18:19:02.447 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-23T18:19:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rgw. 2024-04-23T18:19:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:02.490 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T18:19:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:02.776 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-23T18:19:02.791 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-23T18:19:02.834 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T18:19:02.911 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-23T18:19:02.932 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-23T18:19:02.969 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T18:19:03.154 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua5.1. 2024-04-23T18:19:03.169 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-23T18:19:03.212 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-23T18:19:03.314 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libradosstriper1. 2024-04-23T18:19:03.335 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:03.405 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:03.517 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-any. 2024-04-23T18:19:03.532 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-23T18:19:03.575 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-23T18:19:03.828 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package zip. 2024-04-23T18:19:03.843 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-23T18:19:03.886 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking zip (3.0-12build2) ... 2024-04-23T18:19:03.900 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-common. 2024-04-23T18:19:03.922 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:03.967 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:04.197 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package unzip. 2024-04-23T18:19:04.213 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-23T18:19:04.255 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-23T18:19:04.609 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package luarocks. 2024-04-23T18:19:04.624 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-23T18:19:04.694 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-23T18:19:05.041 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librgw2. 2024-04-23T18:19:05.056 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../027-librgw2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:05.099 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:05.355 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-base. 2024-04-23T18:19:05.376 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:05.422 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:05.577 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rgw. 2024-04-23T18:19:05.592 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:05.635 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:05.996 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-23T18:19:06.011 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-23T18:19:06.051 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-23T18:19:06.054 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T18:19:06.072 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-23T18:19:06.109 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-23T18:19:06.307 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libradosstriper1. 2024-04-23T18:19:06.322 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:06.357 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:06.437 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cheroot. 2024-04-23T18:19:06.458 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-23T18:19:06.495 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T18:19:06.957 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-23T18:19:06.978 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-23T18:19:07.015 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-23T18:19:07.318 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-23T18:19:07.339 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-23T18:19:07.376 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-23T18:19:07.578 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-common. 2024-04-23T18:19:07.593 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:07.627 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:07.888 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-23T18:19:07.909 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-23T18:19:08.379 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-23T18:19:08.749 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-base. 2024-04-23T18:19:08.764 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:08.808 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:08.891 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-tempora. 2024-04-23T18:19:08.912 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-23T18:19:08.949 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-23T18:19:09.285 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-portend. 2024-04-23T18:19:09.306 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-23T18:19:09.311 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-23T18:19:09.326 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-23T18:19:09.343 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-23T18:19:09.361 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-23T18:19:09.646 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-23T18:19:09.663 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cheroot. 2024-04-23T18:19:09.667 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-23T18:19:09.679 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-23T18:19:09.704 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-23T18:19:09.722 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T18:19:10.032 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-23T18:19:10.053 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-23T18:19:10.066 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-23T18:19:10.082 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-23T18:19:10.090 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-23T18:19:10.133 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-23T18:19:10.436 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-23T18:19:10.451 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-23T18:19:10.494 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-23T18:19:10.736 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-natsort. 2024-04-23T18:19:10.751 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-23T18:19:10.771 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-23T18:19:10.785 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-23T18:19:10.787 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-23T18:19:10.821 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-23T18:19:11.080 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-logutils. 2024-04-23T18:19:11.101 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-23T18:19:11.124 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-tempora. 2024-04-23T18:19:11.130 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-23T18:19:11.139 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-23T18:19:11.182 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-23T18:19:11.425 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-23T18:19:11.445 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-23T18:19:11.485 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-portend. 2024-04-23T18:19:11.491 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-23T18:19:11.500 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-23T18:19:11.543 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-23T18:19:11.821 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-23T18:19:11.836 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-mako. 2024-04-23T18:19:11.837 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-23T18:19:11.856 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-23T18:19:11.871 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-23T18:19:11.894 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T18:19:12.140 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-23T18:19:12.156 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-23T18:19:12.198 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-23T18:19:12.255 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-23T18:19:12.268 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-23T18:19:12.305 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-23T18:19:12.552 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-natsort. 2024-04-23T18:19:12.567 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-23T18:19:12.610 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-23T18:19:12.658 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-23T18:19:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-23T18:19:12.742 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-23T18:19:12.922 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-logutils. 2024-04-23T18:19:12.937 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-23T18:19:12.980 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-23T18:19:13.019 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webob. 2024-04-23T18:19:13.031 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-23T18:19:13.102 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-23T18:19:13.266 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-23T18:19:13.281 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-23T18:19:13.324 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-23T18:19:13.464 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-waitress. 2024-04-23T18:19:13.485 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-23T18:19:13.517 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T18:19:13.569 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-mako. 2024-04-23T18:19:13.584 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-23T18:19:13.618 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T18:19:13.877 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-tempita. 2024-04-23T18:19:13.898 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-23T18:19:13.905 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-23T18:19:13.921 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-23T18:19:13.935 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T18:19:13.954 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-23T18:19:14.247 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-paste. 2024-04-23T18:19:14.249 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-23T18:19:14.265 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-23T18:19:14.268 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-23T18:19:14.305 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T18:19:14.307 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-23T18:19:14.610 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-webob. 2024-04-23T18:19:14.616 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-23T18:19:14.626 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-23T18:19:14.628 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-23T18:19:14.666 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T18:19:14.668 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-23T18:19:15.002 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-23T18:19:15.023 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-23T18:19:15.037 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-waitress. 2024-04-23T18:19:15.053 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-23T18:19:15.060 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-23T18:19:15.099 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T18:19:15.397 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webtest. 2024-04-23T18:19:15.415 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-tempita. 2024-04-23T18:19:15.418 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-23T18:19:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-23T18:19:15.455 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-23T18:19:15.465 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T18:19:15.751 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-paste. 2024-04-23T18:19:15.767 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-23T18:19:15.791 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pecan. 2024-04-23T18:19:15.810 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T18:19:15.812 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-23T18:19:15.849 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T18:19:16.088 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-23T18:19:16.103 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-23T18:19:16.137 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T18:19:16.196 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-certifi. 2024-04-23T18:19:16.217 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-23T18:19:16.287 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-23T18:19:16.448 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-23T18:19:16.464 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-23T18:19:16.506 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-23T18:19:16.596 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-idna. 2024-04-23T18:19:16.617 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-23T18:19:16.657 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-23T18:19:16.810 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-webtest. 2024-04-23T18:19:16.825 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-23T18:19:16.868 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-23T18:19:16.993 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-urllib3. 2024-04-23T18:19:17.014 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-23T18:19:17.051 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T18:19:17.196 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pecan. 2024-04-23T18:19:17.211 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-23T18:19:17.254 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T18:19:17.388 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-requests. 2024-04-23T18:19:17.409 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-23T18:19:17.446 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T18:19:17.642 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-certifi. 2024-04-23T18:19:17.657 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-23T18:19:17.700 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-23T18:19:17.790 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-23T18:19:17.811 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-23T18:19:17.848 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T18:19:17.986 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-idna. 2024-04-23T18:19:18.001 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-23T18:19:18.036 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-23T18:19:18.160 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-23T18:19:18.181 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:18.218 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:18.322 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-urllib3. 2024-04-23T18:19:18.337 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-23T18:19:18.380 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T18:19:18.632 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-23T18:19:18.652 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:18.689 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:18.700 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-requests. 2024-04-23T18:19:18.715 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-23T18:19:18.758 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T18:19:19.034 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-23T18:19:19.055 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-23T18:19:19.077 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-23T18:19:19.092 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-23T18:19:19.093 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-23T18:19:19.135 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T18:19:19.422 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-23T18:19:19.428 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-openssl. 2024-04-23T18:19:19.437 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:19.450 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-23T18:19:19.480 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:19.520 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-23T18:19:19.810 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-23T18:19:19.825 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:19.859 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:19.873 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr. 2024-04-23T18:19:19.893 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:19.922 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:20.179 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-23T18:19:20.195 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-23T18:19:20.237 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-23T18:19:20.376 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mon. 2024-04-23T18:19:20.397 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:20.442 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:20.540 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-openssl. 2024-04-23T18:19:20.555 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-23T18:19:20.598 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-23T18:19:20.934 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr. 2024-04-23T18:19:20.950 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:20.992 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:21.267 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-osd. 2024-04-23T18:19:21.287 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:21.312 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mon. 2024-04-23T18:19:21.328 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:21.329 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:21.378 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:21.941 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-osd. 2024-04-23T18:19:21.956 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:21.998 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:22.424 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph. 2024-04-23T18:19:22.445 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../068-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:22.482 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:22.835 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-fuse. 2024-04-23T18:19:22.855 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:22.893 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:22.952 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph. 2024-04-23T18:19:22.967 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../068-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:23.010 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:23.288 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-fuse. 2024-04-23T18:19:23.297 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mds. 2024-04-23T18:19:23.303 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:23.318 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:23.337 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:23.355 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:23.682 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mds. 2024-04-23T18:19:23.697 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:23.740 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:23.800 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephadm. 2024-04-23T18:19:23.821 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../071-cephadm_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:23.866 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:24.118 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephadm. 2024-04-23T18:19:24.133 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../071-cephadm_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:24.176 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:24.220 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-23T18:19:24.241 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-23T18:19:24.278 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-23T18:19:24.487 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-23T18:19:24.502 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-23T18:19:24.545 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-23T18:19:24.631 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-23T18:19:24.652 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T18:19:24.689 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T18:19:24.856 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-23T18:19:24.871 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T18:19:24.914 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T18:19:25.719 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-babel. 2024-04-23T18:19:25.740 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T18:19:25.794 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T18:19:25.902 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-babel. 2024-04-23T18:19:25.917 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T18:19:25.960 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T18:19:26.147 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jinja2. 2024-04-23T18:19:26.168 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-23T18:19:26.226 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T18:19:26.263 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jinja2. 2024-04-23T18:19:26.273 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-23T18:19:26.313 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T18:19:26.533 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-23T18:19:26.545 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:26.616 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:26.691 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-23T18:19:26.702 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:26.741 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:26.962 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-23T18:19:26.983 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-23T18:19:27.011 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-23T18:19:27.069 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-23T18:19:27.083 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-23T18:19:27.127 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-23T18:19:27.339 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-routes. 2024-04-23T18:19:27.360 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-23T18:19:27.397 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T18:19:27.430 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-routes. 2024-04-23T18:19:27.442 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-23T18:19:27.480 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T18:19:27.751 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-23T18:19:27.772 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:27.808 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:27.833 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-23T18:19:27.846 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:27.882 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:29.146 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-23T18:19:29.158 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-23T18:19:29.187 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T18:19:29.264 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-23T18:19:29.286 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-23T18:19:29.355 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T18:19:29.657 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-joblib. 2024-04-23T18:19:29.669 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-23T18:19:29.707 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T18:19:29.901 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-joblib. 2024-04-23T18:19:29.922 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-23T18:19:29.959 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T18:19:30.038 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-23T18:19:30.048 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-23T18:19:30.171 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-23T18:19:30.421 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-23T18:19:30.442 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-23T18:19:30.499 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-sklearn. 2024-04-23T18:19:30.515 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-23T18:19:30.556 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T18:19:30.589 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-23T18:19:30.909 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn. 2024-04-23T18:19:30.930 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-23T18:19:30.967 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T18:19:31.207 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-23T18:19:31.220 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:31.257 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:31.976 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-23T18:19:31.998 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:32.034 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:32.202 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cachetools. 2024-04-23T18:19:32.216 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-23T18:19:32.268 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-23T18:19:32.596 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-23T18:19:32.610 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-23T18:19:32.654 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-23T18:19:32.941 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-23T18:19:32.955 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-23T18:19:33.037 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cachetools. 2024-04-23T18:19:33.058 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-23T18:19:33.104 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-23T18:19:33.215 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T18:19:33.407 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-23T18:19:33.428 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-23T18:19:33.473 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-23T18:19:33.476 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rsa. 2024-04-23T18:19:33.491 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-23T18:19:33.526 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-23T18:19:33.843 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-23T18:19:33.847 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-google-auth. 2024-04-23T18:19:33.861 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-23T18:19:33.864 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-23T18:19:33.901 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T18:19:33.905 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-23T18:19:34.225 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-23T18:19:34.237 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rsa. 2024-04-23T18:19:34.239 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-23T18:19:34.259 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-23T18:19:34.283 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T18:19:34.295 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-23T18:19:34.594 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-websocket. 2024-04-23T18:19:34.612 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-23T18:19:34.649 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-google-auth. 2024-04-23T18:19:34.652 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-23T18:19:34.671 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-23T18:19:34.707 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-23T18:19:34.947 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-23T18:19:34.962 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-23T18:19:34.997 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T18:19:35.061 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-23T18:19:35.082 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-23T18:19:35.127 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T18:19:35.472 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-websocket. 2024-04-23T18:19:35.493 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-23T18:19:35.538 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-23T18:19:35.618 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-23T18:19:35.633 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:35.694 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:35.875 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-23T18:19:35.896 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-23T18:19:35.933 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T18:19:35.996 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-23T18:19:36.010 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-23T18:19:36.054 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T18:19:36.341 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-23T18:19:36.354 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T18:19:36.382 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T18:19:36.626 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package jq. 2024-04-23T18:19:36.639 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T18:19:36.655 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-23T18:19:36.668 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:36.693 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-23T18:19:36.697 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:36.958 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-23T18:19:36.971 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package socat. 2024-04-23T18:19:36.979 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-23T18:19:36.984 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-23T18:19:37.008 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T18:19:37.029 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-23T18:19:37.315 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package xmlstarlet. 2024-04-23T18:19:37.328 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-23T18:19:37.373 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-23T18:19:37.377 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-23T18:19:37.399 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T18:19:37.444 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T18:19:37.719 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-test. 2024-04-23T18:19:37.730 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package jq. 2024-04-23T18:19:37.731 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:37.742 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T18:19:37.771 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:37.780 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-23T18:19:38.032 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package socat. 2024-04-23T18:19:38.054 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-23T18:19:38.082 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-23T18:19:38.377 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package xmlstarlet. 2024-04-23T18:19:38.389 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-23T18:19:38.419 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-23T18:19:38.823 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-test. 2024-04-23T18:19:38.836 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:38.873 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:39.825 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-volume. 2024-04-23T18:19:39.838 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:39.883 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:40.271 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-23T18:19:40.284 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:40.328 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:40.640 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-colorama. 2024-04-23T18:19:40.653 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-23T18:19:40.698 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-23T18:19:41.001 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-shell. 2024-04-23T18:19:41.014 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:41.059 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:41.287 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-top. 2024-04-23T18:19:41.300 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:41.310 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-volume. 2024-04-23T18:19:41.333 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:41.345 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:41.377 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:41.597 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-23T18:19:41.611 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:41.655 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:41.950 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-23T18:19:41.964 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-23T18:19:42.008 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T18:19:42.015 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-23T18:19:42.037 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:42.073 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:42.346 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-23T18:19:42.359 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-23T18:19:42.401 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-colorama. 2024-04-23T18:19:42.412 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-23T18:19:42.423 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-23T18:19:42.467 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-23T18:19:42.737 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephfs-shell. 2024-04-23T18:19:42.750 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package nvme-cli. 2024-04-23T18:19:42.758 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:42.763 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-23T18:19:42.803 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:42.808 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T18:19:43.064 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephfs-top. 2024-04-23T18:19:43.086 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T18:19:43.122 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:43.197 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package pkg-config. 2024-04-23T18:19:43.210 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-23T18:19:43.246 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T18:19:43.400 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-23T18:19:43.412 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:43.449 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:43.516 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-23T18:19:43.530 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-23T18:19:43.574 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-23T18:19:43.802 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-23T18:19:43.824 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-23T18:19:43.868 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T18:19:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-23T18:19:43.965 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-23T18:19:44.002 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-23T18:19:44.215 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-23T18:19:44.228 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-23T18:19:44.265 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-23T18:19:44.280 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pastescript. 2024-04-23T18:19:44.293 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-23T18:19:44.346 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-23T18:19:44.650 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pluggy. 2024-04-23T18:19:44.663 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-23T18:19:44.677 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package nvme-cli. 2024-04-23T18:19:44.699 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-23T18:19:44.708 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-23T18:19:44.777 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T18:19:45.044 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-psutil. 2024-04-23T18:19:45.058 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-23T18:19:45.102 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-23T18:19:45.233 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package pkg-config. 2024-04-23T18:19:45.254 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-23T18:19:45.299 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T18:19:45.422 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-py. 2024-04-23T18:19:45.436 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-23T18:19:45.480 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-23T18:19:45.560 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-23T18:19:45.581 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-23T18:19:45.626 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-23T18:19:45.809 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pygments. 2024-04-23T18:19:45.822 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-23T18:19:45.866 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T18:19:46.096 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-23T18:19:46.109 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-23T18:19:46.180 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-23T18:19:46.312 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-23T18:19:46.326 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-23T18:19:46.362 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-23T18:19:46.432 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastescript. 2024-04-23T18:19:46.454 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-23T18:19:46.516 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-23T18:19:46.673 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-toml. 2024-04-23T18:19:46.687 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-23T18:19:46.731 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-23T18:19:46.811 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pluggy. 2024-04-23T18:19:46.832 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-23T18:19:46.910 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-23T18:19:47.018 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pytest. 2024-04-23T18:19:47.031 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-23T18:19:47.075 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T18:19:47.289 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-psutil. 2024-04-23T18:19:47.310 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-23T18:19:47.355 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-23T18:19:47.429 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-simplejson. 2024-04-23T18:19:47.443 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-23T18:19:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-23T18:19:47.725 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-py. 2024-04-23T18:19:47.746 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-23T18:19:47.765 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-23T18:19:47.779 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-23T18:19:47.791 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-23T18:19:47.823 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-23T18:19:48.169 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pygments. 2024-04-23T18:19:48.191 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-23T18:19:48.236 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T18:19:48.778 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package radosgw. 2024-04-23T18:19:48.782 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-23T18:19:48.791 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../122-radosgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:48.804 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-23T18:19:48.835 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:48.848 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-23T18:19:49.151 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-toml. 2024-04-23T18:19:49.173 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-23T18:19:49.209 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-23T18:19:49.422 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package rbd-fuse. 2024-04-23T18:19:49.435 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:49.472 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:49.537 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pytest. 2024-04-23T18:19:49.559 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-23T18:19:49.603 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T18:19:49.775 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-23T18:19:49.991 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplejson. 2024-04-23T18:19:50.019 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-23T18:19:50.086 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T18:19:50.090 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-23T18:19:50.203 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T18:19:50.360 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-23T18:19:50.376 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-23T18:19:50.451 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-23T18:19:50.467 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-23T18:19:50.869 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-23T18:19:51.247 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package radosgw. 2024-04-23T18:19:51.269 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../122-radosgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:51.313 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:51.470 INFO:teuthology.orchestra.run.smithi028.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-23T18:19:51.529 INFO:teuthology.orchestra.run.smithi028.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-23T18:19:51.572 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:52.082 INFO:teuthology.orchestra.run.smithi028.stdout:Adding system user cephadm....done 2024-04-23T18:19:52.150 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-fuse. 2024-04-23T18:19:52.162 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T18:19:52.199 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:52.202 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T18:19:52.488 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-23T18:19:52.535 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-23T18:19:52.756 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-23T18:19:52.855 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T18:19:52.881 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-23T18:19:52.981 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T18:19:53.158 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-23T18:19:53.267 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-23T18:19:53.425 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T18:19:53.526 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-23T18:19:53.623 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-23T18:19:53.828 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T18:19:54.138 INFO:teuthology.orchestra.run.smithi137.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-23T18:19:54.214 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-23T18:19:54.215 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:54.482 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-23T18:19:54.758 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-23T18:19:54.783 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user cephadm....done 2024-04-23T18:19:54.938 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T18:19:55.042 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-23T18:19:55.215 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-23T18:19:55.269 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-23T18:19:55.516 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-23T18:19:55.536 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-23T18:19:55.634 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-23T18:19:55.813 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-23T18:19:55.877 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-23T18:19:56.089 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:56.138 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T18:19:56.273 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-23T18:19:56.365 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T18:19:56.491 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T18:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T18:19:56.600 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-23T18:19:56.860 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T18:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-23T18:19:56.969 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-23T18:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-23T18:19:57.237 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-23T18:19:57.606 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-23T18:19:57.651 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-23T18:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-23T18:19:57.715 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T18:19:57.841 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-23T18:19:57.946 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-23T18:19:58.215 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-23T18:19:58.225 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T18:19:58.326 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-23T18:19:58.499 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-23T18:19:58.577 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T18:19:58.767 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-23T18:19:58.862 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-23T18:19:59.001 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:19:59.188 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up zip (3.0-12build2) ... 2024-04-23T18:19:59.302 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T18:19:59.314 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T18:19:59.478 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T18:19:59.604 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-23T18:19:59.864 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T18:19:59.990 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-23T18:20:00.041 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T18:20:00.274 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-23T18:20:00.342 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T18:20:00.468 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-23T18:20:00.586 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T18:20:00.642 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-23T18:20:00.697 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-23T18:20:00.760 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T18:20:00.912 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-23T18:20:00.928 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-23T18:20:01.288 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T18:20:01.339 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-23T18:20:01.414 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-23T18:20:01.631 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T18:20:01.707 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T18:20:01.974 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-23T18:20:02.033 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T18:20:02.300 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up zip (3.0-12build2) ... 2024-04-23T18:20:02.325 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-23T18:20:02.418 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T18:20:02.627 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T18:20:02.995 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-23T18:20:03.079 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T18:20:03.263 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-23T18:20:03.330 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T18:20:03.397 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:03.456 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-23T18:20:03.582 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T18:20:03.740 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-idna (3.3-1) ... 2024-04-23T18:20:03.916 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-23T18:20:04.091 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T18:20:04.339 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-23T18:20:04.602 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T18:20:04.986 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T18:20:05.296 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-23T18:20:05.406 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T18:20:05.639 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T18:20:05.657 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:20:05.791 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-23T18:20:06.016 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-23T18:20:06.042 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T18:20:06.143 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-23T18:20:06.261 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T18:20:06.291 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-23T18:20:06.417 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:06.571 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-23T18:20:06.769 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-idna (3.3-1) ... 2024-04-23T18:20:06.847 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-23T18:20:07.115 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:20:07.178 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T18:20:07.241 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-23T18:20:07.559 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-23T18:20:07.818 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-23T18:20:08.078 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-23T18:20:08.345 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-23T18:20:08.350 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T18:20:08.610 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:20:08.613 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-23T18:20:08.745 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-23T18:20:08.906 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T18:20:09.029 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T18:20:09.048 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-23T18:20:09.163 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-23T18:20:09.323 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T18:20:09.341 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T18:20:09.467 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T18:20:09.641 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-23T18:20:09.768 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-23T18:20:09.892 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-23T18:20:10.070 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-23T18:20:10.176 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:20:10.286 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-23T18:20:10.346 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T18:20:10.463 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-23T18:20:10.589 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T18:20:10.603 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-23T18:20:10.678 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-23T18:20:10.888 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-23T18:20:10.933 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T18:20:11.034 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T18:20:11.156 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-23T18:20:11.424 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-23T18:20:11.435 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-23T18:20:11.691 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-23T18:20:11.711 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-23T18:20:11.837 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-23T18:20:11.993 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T18:20:12.113 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:20:12.143 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-23T18:20:12.239 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T18:20:12.453 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T18:20:12.571 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T18:20:12.574 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T18:20:12.917 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T18:20:12.989 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-23T18:20:13.185 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-23T18:20:13.306 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-23T18:20:13.446 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-23T18:20:13.566 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T18:20:13.692 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-23T18:20:13.722 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-23T18:20:13.841 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T18:20:13.932 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-23T18:20:14.007 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T18:20:14.228 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T18:20:14.370 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T18:20:14.475 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-23T18:20:14.772 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-23T18:20:14.852 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-23T18:20:15.040 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-23T18:20:15.145 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T18:20:15.166 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-23T18:20:15.467 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T18:20:15.514 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T18:20:15.626 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T18:20:15.640 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:15.766 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:15.875 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-23T18:20:15.969 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T18:20:16.171 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:16.262 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T18:20:16.313 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:16.447 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-23T18:20:16.580 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-23T18:20:16.766 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:16.841 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-23T18:20:16.891 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:17.001 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:17.109 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-23T18:20:17.204 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T18:20:17.204 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T18:20:17.402 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T18:20:17.661 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-23T18:20:17.877 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:18.015 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:18.090 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-23T18:20:18.146 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:18.272 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:18.373 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T18:20:18.406 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T18:20:18.784 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T18:20:18.910 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:19.028 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:19.162 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-23T18:20:19.532 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:19.658 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:19.752 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:19.783 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-23T18:20:19.853 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:19.979 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:20.093 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:20.104 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:20.239 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:20.244 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:20.340 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:20.370 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:20.583 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T18:20:20.583 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T18:20:20.868 INFO:teuthology.orchestra.run.smithi028.stdout:Adding group ceph....done 2024-04-23T18:20:21.139 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:21.245 INFO:teuthology.orchestra.run.smithi028.stdout:Adding system user ceph....done 2024-04-23T18:20:21.298 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:21.397 INFO:teuthology.orchestra.run.smithi028.stdout:Setting system user ceph properties....done 2024-04-23T18:20:21.416 INFO:teuthology.orchestra.run.smithi028.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-23T18:20:21.424 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:21.550 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:21.569 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-23T18:20:21.701 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T18:20:21.969 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-23T18:20:22.633 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:22.858 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T18:20:22.858 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T18:20:22.862 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:23.014 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:23.140 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:23.266 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:23.417 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:23.476 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:23.543 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:23.601 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:24.127 INFO:teuthology.orchestra.run.smithi137.stdout:Adding group ceph....done 2024-04-23T18:20:24.141 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:20:24.141 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:20:24.570 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user ceph....done 2024-04-23T18:20:24.763 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:24.782 INFO:teuthology.orchestra.run.smithi137.stdout:Setting system user ceph properties....done 2024-04-23T18:20:24.804 INFO:teuthology.orchestra.run.smithi137.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-23T18:20:24.941 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-23T18:20:25.158 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-23T18:20:25.319 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-23T18:20:25.823 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:25.919 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:26.037 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T18:20:26.037 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T18:20:26.135 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T18:20:26.135 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T18:20:26.666 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:26.691 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:26.869 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T18:20:26.869 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T18:20:26.967 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:27.501 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:27.547 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:20:27.547 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:20:27.835 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T18:20:27.835 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T18:20:28.233 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:28.444 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:28.570 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:28.700 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-23T18:20:28.712 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:28.938 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T18:20:28.939 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T18:20:29.244 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:29.491 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T18:20:29.491 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T18:20:29.580 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:29.723 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:29.849 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:29.984 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:30.021 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:30.266 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T18:20:30.266 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T18:20:30.446 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T18:20:30.546 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T18:20:30.675 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T18:20:30.755 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:31.212 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T18:20:31.212 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T18:20:31.715 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:31.827 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T18:20:31.875 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:32.026 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:32.240 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T18:20:32.240 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T18:20:32.528 INFO:teuthology.orchestra.run.smithi028.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T18:20:32.532 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-23T18:20:32.608 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2024-04-23T18:20:32.752 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:32.788 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2024-04-23T18:20:32.788 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2024-04-23T18:20:32.887 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:32.969 INFO:teuthology.orchestra.run.smithi028.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-23T18:20:32.969 INFO:teuthology.orchestra.run.smithi028.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-23T18:20:32.969 INFO:teuthology.orchestra.run.smithi028.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-23T18:20:32.969 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T18:20:32.969 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T18:20:32.969 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T18:20:32.970 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T18:20:32.970 INFO:teuthology.orchestra.run.smithi028.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T18:20:32.970 INFO:teuthology.orchestra.run.smithi028.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T18:20:32.970 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T18:20:32.971 INFO:teuthology.orchestra.run.smithi028.stdout:The following additional packages will be installed: 2024-04-23T18:20:32.971 INFO:teuthology.orchestra.run.smithi028.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-23T18:20:32.971 INFO:teuthology.orchestra.run.smithi028.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-23T18:20:32.971 INFO:teuthology.orchestra.run.smithi028.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-23T18:20:32.971 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-23T18:20:32.971 INFO:teuthology.orchestra.run.smithi028.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T18:20:32.972 INFO:teuthology.orchestra.run.smithi028.stdout:Suggested packages: 2024-04-23T18:20:32.973 INFO:teuthology.orchestra.run.smithi028.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-23T18:20:32.973 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-23T18:20:32.973 INFO:teuthology.orchestra.run.smithi028.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-23T18:20:33.027 INFO:teuthology.orchestra.run.smithi028.stdout:The following NEW packages will be installed: 2024-04-23T18:20:33.027 INFO:teuthology.orchestra.run.smithi028.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-23T18:20:33.027 INFO:teuthology.orchestra.run.smithi028.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-23T18:20:33.028 INFO:teuthology.orchestra.run.smithi028.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-23T18:20:33.028 INFO:teuthology.orchestra.run.smithi028.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-23T18:20:33.028 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-23T18:20:33.028 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-23T18:20:33.028 INFO:teuthology.orchestra.run.smithi028.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T18:20:33.029 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages will be upgraded: 2024-04-23T18:20:33.030 INFO:teuthology.orchestra.run.smithi028.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-23T18:20:33.046 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:33.106 INFO:teuthology.orchestra.run.smithi028.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-23T18:20:33.107 INFO:teuthology.orchestra.run.smithi028.stdout:Need to get 55.7 MB of archives. 2024-04-23T18:20:33.107 INFO:teuthology.orchestra.run.smithi028.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-23T18:20:33.107 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-23T18:20:33.197 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T18:20:33.352 INFO:teuthology.orchestra.run.smithi028.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-23T18:20:33.362 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-23T18:20:33.421 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-23T18:20:33.422 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-23T18:20:33.422 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-23T18:20:33.435 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-23T18:20:33.436 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-23T18:20:33.438 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-23T18:20:33.439 INFO:teuthology.orchestra.run.smithi028.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-23T18:20:33.440 INFO:teuthology.orchestra.run.smithi028.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-23T18:20:33.441 INFO:teuthology.orchestra.run.smithi028.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-23T18:20:33.454 INFO:teuthology.orchestra.run.smithi028.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-23T18:20:33.472 INFO:teuthology.orchestra.run.smithi028.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-23T18:20:33.472 INFO:teuthology.orchestra.run.smithi028.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-23T18:20:33.474 INFO:teuthology.orchestra.run.smithi028.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-23T18:20:33.651 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T18:20:33.776 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T18:20:33.860 INFO:teuthology.orchestra.run.smithi028.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-23T18:20:33.869 INFO:teuthology.orchestra.run.smithi028.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-23T18:20:33.869 INFO:teuthology.orchestra.run.smithi028.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-23T18:20:33.873 INFO:teuthology.orchestra.run.smithi028.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-23T18:20:33.873 INFO:teuthology.orchestra.run.smithi028.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-23T18:20:33.879 INFO:teuthology.orchestra.run.smithi028.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-23T18:20:33.881 INFO:teuthology.orchestra.run.smithi028.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-23T18:20:33.929 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T18:20:33.940 INFO:teuthology.orchestra.run.smithi028.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-23T18:20:33.940 INFO:teuthology.orchestra.run.smithi028.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-23T18:20:33.968 INFO:teuthology.orchestra.run.smithi028.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-23T18:20:33.969 INFO:teuthology.orchestra.run.smithi028.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-23T18:20:33.981 INFO:teuthology.orchestra.run.smithi028.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-23T18:20:34.014 INFO:teuthology.orchestra.run.smithi028.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-23T18:20:34.020 INFO:teuthology.orchestra.run.smithi028.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-23T18:20:34.021 INFO:teuthology.orchestra.run.smithi028.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-23T18:20:34.021 INFO:teuthology.orchestra.run.smithi028.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-23T18:20:34.022 INFO:teuthology.orchestra.run.smithi028.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-23T18:20:34.044 INFO:teuthology.orchestra.run.smithi028.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-23T18:20:34.050 INFO:teuthology.orchestra.run.smithi028.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-23T18:20:34.320 INFO:teuthology.orchestra.run.smithi028.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-23T18:20:34.320 INFO:teuthology.orchestra.run.smithi028.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-23T18:20:34.320 INFO:teuthology.orchestra.run.smithi028.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-23T18:20:34.321 INFO:teuthology.orchestra.run.smithi028.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-23T18:20:34.321 INFO:teuthology.orchestra.run.smithi028.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-23T18:20:34.321 INFO:teuthology.orchestra.run.smithi028.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-23T18:20:34.340 INFO:teuthology.orchestra.run.smithi028.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-23T18:20:34.340 INFO:teuthology.orchestra.run.smithi028.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-23T18:20:34.734 INFO:teuthology.orchestra.run.smithi028.stdout:Preconfiguring packages ... 2024-04-23T18:20:34.812 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T18:20:34.884 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 55.7 MB in 1s (42.8 MB/s) 2024-04-23T18:20:35.133 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-23T18:20:35.136 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T18:20:35.283 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T18:20:35.489 INFO:teuthology.orchestra.run.smithi137.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T18:20:35.491 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-23T18:20:35.588 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-04-23T18:20:35.789 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-04-23T18:20:35.790 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-04-23T18:20:35.924 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-23T18:20:35.976 INFO:teuthology.orchestra.run.smithi137.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-23T18:20:35.976 INFO:teuthology.orchestra.run.smithi137.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-23T18:20:35.977 INFO:teuthology.orchestra.run.smithi137.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-23T18:20:35.977 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T18:20:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T18:20:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T18:20:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T18:20:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-23T18:20:35.977 INFO:teuthology.orchestra.run.smithi137.stdout: python2.7-minimal 2024-04-23T18:20:35.977 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T18:20:35.978 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-04-23T18:20:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-23T18:20:35.978 INFO:teuthology.orchestra.run.smithi137.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-23T18:20:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-23T18:20:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-23T18:20:35.979 INFO:teuthology.orchestra.run.smithi137.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T18:20:35.980 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-04-23T18:20:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-23T18:20:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-23T18:20:35.980 INFO:teuthology.orchestra.run.smithi137.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-23T18:20:36.019 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-04-23T18:20:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-23T18:20:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-23T18:20:36.020 INFO:teuthology.orchestra.run.smithi137.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-23T18:20:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-23T18:20:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-23T18:20:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-23T18:20:36.021 INFO:teuthology.orchestra.run.smithi137.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T18:20:36.022 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages will be upgraded: 2024-04-23T18:20:36.022 INFO:teuthology.orchestra.run.smithi137.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-23T18:20:36.085 INFO:teuthology.orchestra.run.smithi137.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-23T18:20:36.085 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 55.7 MB of archives. 2024-04-23T18:20:36.085 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-23T18:20:36.085 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-23T18:20:36.287 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-23T18:20:36.294 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-23T18:20:36.345 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-23T18:20:36.346 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-23T18:20:36.347 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-23T18:20:36.361 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-23T18:20:36.362 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-23T18:20:36.364 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-23T18:20:36.366 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-23T18:20:36.366 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-23T18:20:36.368 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-23T18:20:36.382 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-23T18:20:36.397 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-23T18:20:36.397 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-23T18:20:36.399 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-23T18:20:36.839 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-23T18:20:36.841 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-23T18:20:36.842 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-23T18:20:36.845 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-23T18:20:36.846 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-23T18:20:36.852 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-23T18:20:36.854 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-23T18:20:36.864 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-23T18:20:36.864 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-23T18:20:36.892 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-23T18:20:36.892 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-23T18:20:36.904 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-23T18:20:36.945 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-23T18:20:36.951 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-23T18:20:36.951 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-23T18:20:36.952 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-23T18:20:36.953 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-23T18:20:36.967 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-23T18:20:36.970 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-23T18:20:37.188 INFO:teuthology.orchestra.run.smithi028.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-23T18:20:37.319 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-23T18:20:37.320 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-23T18:20:37.320 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-23T18:20:37.320 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-23T18:20:37.320 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-23T18:20:37.320 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-23T18:20:37.335 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-23T18:20:37.335 INFO:teuthology.orchestra.run.smithi137.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-23T18:20:37.432 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package flex. 2024-04-23T18:20:37.508 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-23T18:20:37.511 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-23T18:20:37.555 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-23T18:20:37.740 INFO:teuthology.orchestra.run.smithi137.stdout:Preconfiguring packages ... 2024-04-23T18:20:37.919 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 55.7 MB in 1s (42.7 MB/s) 2024-04-23T18:20:38.117 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T18:20:38.226 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-04-23T18:20:38.231 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T18:20:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-23T18:20:38.376 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T18:20:38.703 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T18:20:39.235 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-23T18:20:39.239 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T18:20:39.344 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T18:20:39.421 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-23T18:20:39.748 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T18:20:39.909 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T18:20:40.217 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T18:20:40.474 INFO:teuthology.orchestra.run.smithi137.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-23T18:20:40.526 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package bison. 2024-04-23T18:20:40.606 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-23T18:20:40.610 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-23T18:20:40.645 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T18:20:40.775 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package flex. 2024-04-23T18:20:40.864 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-04-23T18:20:40.869 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-23T18:20:40.923 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-23T18:20:40.995 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-23T18:20:41.011 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-23T18:20:41.112 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T18:20:41.432 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package dump. 2024-04-23T18:20:41.448 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-23T18:20:41.491 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking dump (0.4b47-3) ... 2024-04-23T18:20:41.516 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T18:20:41.696 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-23T18:20:41.761 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package indent. 2024-04-23T18:20:41.777 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:20:41.828 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T18:20:42.089 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-23T18:20:42.105 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-23T18:20:42.147 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T18:20:42.162 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T18:20:42.451 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-23T18:20:42.468 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-23T18:20:42.509 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T18:20:42.718 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-04-23T18:20:42.723 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T18:20:42.737 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-23T18:20:42.753 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-23T18:20:42.795 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T18:20:42.886 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T18:20:43.132 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-23T18:20:43.148 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-23T18:20:43.190 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T18:20:43.298 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T18:20:43.417 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T18:20:43.443 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-23T18:20:43.459 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-23T18:20:43.501 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T18:20:43.762 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libjson-perl. 2024-04-23T18:20:43.775 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T18:20:43.779 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-23T18:20:43.812 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-23T18:20:44.057 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-23T18:20:44.073 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-23T18:20:44.115 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T18:20:44.221 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package bison. 2024-04-23T18:20:44.310 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-04-23T18:20:44.315 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-23T18:20:44.371 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T18:20:45.435 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-23T18:20:45.451 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T18:20:45.493 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T18:20:45.672 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-23T18:20:45.694 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-23T18:20:45.721 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-23T18:20:45.737 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T18:20:45.763 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T18:20:45.779 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T18:20:46.107 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-23T18:20:46.123 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T18:20:46.125 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package dump. 2024-04-23T18:20:46.147 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-23T18:20:46.165 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T18:20:46.191 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking dump (0.4b47-3) ... 2024-04-23T18:20:46.512 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package indent. 2024-04-23T18:20:46.534 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:20:46.578 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T18:20:46.865 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-23T18:20:46.870 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-23T18:20:46.886 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-23T18:20:46.887 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-23T18:20:46.919 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T18:20:46.939 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T18:20:47.231 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-23T18:20:47.247 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T18:20:47.285 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-23T18:20:47.289 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T18:20:47.307 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-23T18:20:47.352 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T18:20:47.663 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-23T18:20:47.676 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-23T18:20:47.676 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-23T18:20:47.692 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:20:47.713 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T18:20:47.734 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:20:48.066 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-23T18:20:48.070 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-23T18:20:48.087 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:20:48.089 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-23T18:20:48.120 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T18:20:48.124 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T18:20:48.386 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-23T18:20:48.398 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-23T18:20:48.407 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-23T18:20:48.423 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:20:48.435 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T18:20:48.465 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T18:20:48.692 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-23T18:20:48.707 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjson-perl. 2024-04-23T18:20:48.709 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T18:20:48.729 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-23T18:20:48.773 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T18:20:48.773 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-23T18:20:49.126 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-23T18:20:49.149 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-23T18:20:49.185 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T18:20:49.279 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-23T18:20:49.295 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-23T18:20:49.337 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T18:20:49.632 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package modemmanager. 2024-04-23T18:20:49.649 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T18:20:49.682 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T18:20:50.331 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package network-manager. 2024-04-23T18:20:50.347 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T18:20:50.398 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-23T18:20:50.996 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ppp. 2024-04-23T18:20:51.013 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-23T18:20:51.164 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-23T18:20:51.186 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T18:20:51.230 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T18:20:51.359 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T18:20:51.525 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-23T18:20:51.547 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T18:20:51.592 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T18:20:51.819 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package pptp-linux. 2024-04-23T18:20:51.834 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-23T18:20:51.877 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-23T18:20:51.928 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-23T18:20:51.950 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T18:20:51.994 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T18:20:52.130 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-23T18:20:52.146 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-23T18:20:52.188 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-23T18:20:52.381 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-23T18:20:52.403 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-23T18:20:52.447 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T18:20:52.491 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-23T18:20:52.507 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-23T18:20:52.541 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client-common (238) ... 2024-04-23T18:20:52.809 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-23T18:20:52.831 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T18:20:52.879 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-23T18:20:52.897 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:20:52.908 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T18:20:52.937 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:20:53.262 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-23T18:20:53.284 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:20:53.328 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:20:53.533 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-common. 2024-04-23T18:20:53.550 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-23T18:20:53.611 INFO:teuthology.orchestra.run.smithi028.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-23T18:20:53.641 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-common (238) ... 2024-04-23T18:20:53.714 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-23T18:20:53.737 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:20:53.781 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T18:20:54.115 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-14. 2024-04-23T18:20:54.132 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:20:54.134 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-23T18:20:54.147 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:20:54.177 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:20:54.201 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T18:20:54.453 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-23T18:20:54.475 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T18:20:54.511 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T18:20:55.132 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-23T18:20:55.154 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-23T18:20:55.212 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T18:20:55.419 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql. 2024-04-23T18:20:55.435 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-23T18:20:55.477 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql (14+238) ... 2024-04-23T18:20:55.593 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package modemmanager. 2024-04-23T18:20:55.615 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T18:20:55.660 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T18:20:55.704 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client. 2024-04-23T18:20:55.720 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-23T18:20:55.754 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client (14+238) ... 2024-04-23T18:20:55.964 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-23T18:20:55.980 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-23T18:20:56.023 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-23T18:20:56.367 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package tcl8.6. 2024-04-23T18:20:56.384 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-23T18:20:56.469 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T18:20:56.726 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package network-manager. 2024-04-23T18:20:56.748 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T18:20:56.770 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package tcl. 2024-04-23T18:20:56.787 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-23T18:20:56.833 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-23T18:20:56.834 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-23T18:20:57.131 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package wpasupplicant. 2024-04-23T18:20:57.148 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-23T18:20:57.181 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T18:20:57.383 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ppp. 2024-04-23T18:20:57.406 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-23T18:20:57.518 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-23T18:20:57.535 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-23T18:20:57.577 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-23T18:20:57.693 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T18:20:57.988 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-23T18:20:58.005 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-23T18:20:58.055 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package pptp-linux. 2024-04-23T18:20:58.055 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T18:20:58.077 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-23T18:20:58.121 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-23T18:20:58.324 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client-common (238) ... 2024-04-23T18:20:58.407 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-23T18:20:58.420 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-23T18:20:58.457 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-23T18:20:58.544 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-23T18:20:58.670 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T18:20:58.777 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-23T18:20:58.796 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:20:58.799 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-23T18:20:58.843 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-client-common (238) ... 2024-04-23T18:20:58.922 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T18:20:59.057 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T18:20:59.148 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-23T18:20:59.166 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:20:59.169 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:20:59.214 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:20:59.860 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-common. 2024-04-23T18:20:59.883 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-23T18:20:59.944 INFO:teuthology.orchestra.run.smithi137.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-23T18:20:59.991 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-common (238) ... 2024-04-23T18:21:00.115 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-23T18:21:00.222 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T18:21:00.476 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-14. 2024-04-23T18:21:00.497 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T18:21:00.544 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:21:00.607 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T18:21:00.608 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T18:21:01.249 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T18:21:01.350 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T18:21:01.485 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T18:21:01.645 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-23T18:21:01.770 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T18:21:01.905 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T18:21:02.031 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T18:21:02.045 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql. 2024-04-23T18:21:02.058 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-23T18:21:02.103 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql (14+238) ... 2024-04-23T18:21:02.149 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T18:21:02.338 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-client. 2024-04-23T18:21:02.351 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-23T18:21:02.380 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-client (14+238) ... 2024-04-23T18:21:02.666 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-23T18:21:02.688 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-23T18:21:02.732 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-23T18:21:02.888 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T18:21:03.013 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up dump (0.4b47-3) ... 2024-04-23T18:21:03.077 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package tcl8.6. 2024-04-23T18:21:03.099 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-23T18:21:03.108 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-23T18:21:03.143 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T18:21:03.173 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T18:21:03.274 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T18:21:03.383 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-23T18:21:03.471 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package tcl. 2024-04-23T18:21:03.493 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-23T18:21:03.509 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-23T18:21:03.542 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-23T18:21:03.636 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T18:21:03.725 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-23T18:21:03.795 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T18:21:03.891 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package wpasupplicant. 2024-04-23T18:21:03.913 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-23T18:21:03.921 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T18:21:03.957 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T18:21:04.098 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T18:21:04.232 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T18:21:04.333 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-23T18:21:04.378 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-23T18:21:04.400 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-23T18:21:04.444 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-23T18:21:04.484 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client (14+238) ... 2024-04-23T18:21:04.619 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-23T18:21:04.856 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-23T18:21:04.878 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-23T18:21:04.931 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T18:21:05.224 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:05.225 INFO:teuthology.orchestra.run.smithi028.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-23T18:21:05.225 INFO:teuthology.orchestra.run.smithi028.stdout:which means they are currently configured by ifupdown: 2024-04-23T18:21:05.225 INFO:teuthology.orchestra.run.smithi028.stdout:- ens1f0 2024-04-23T18:21:05.225 INFO:teuthology.orchestra.run.smithi028.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-23T18:21:05.225 INFO:teuthology.orchestra.run.smithi028.stdout:remove their configuration from /etc/network/interfaces. 2024-04-23T18:21:05.225 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:05.232 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-client-common (238) ... 2024-04-23T18:21:05.364 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-23T18:21:05.478 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-23T18:21:05.604 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T18:21:05.722 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:21:05.780 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-23T18:21:05.857 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T18:21:05.999 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T18:21:06.159 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:21:06.207 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-23T18:21:06.646 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-23T18:21:06.913 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T18:21:06.981 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T18:21:07.365 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T18:21:07.394 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T18:21:07.394 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T18:21:07.491 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-23T18:21:07.617 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-common (238) ... 2024-04-23T18:21:08.009 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T18:21:08.135 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T18:21:08.261 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T18:21:08.412 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-23T18:21:08.538 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T18:21:08.544 INFO:teuthology.orchestra.run.smithi028.stdout:Adding user postgres to group ssl-cert 2024-04-23T18:21:08.681 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T18:21:08.799 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T18:21:08.810 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:08.810 INFO:teuthology.orchestra.run.smithi028.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-23T18:21:08.925 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T18:21:09.059 INFO:teuthology.orchestra.run.smithi028.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-23T18:21:09.059 INFO:teuthology.orchestra.run.smithi028.stdout:Removing obsolete dictionary files: 2024-04-23T18:21:09.772 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-23T18:21:09.788 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T18:21:09.906 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up dump (0.4b47-3) ... 2024-04-23T18:21:09.982 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-23T18:21:10.099 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T18:21:10.225 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T18:21:10.284 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:21:10.351 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-23T18:21:10.486 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-23T18:21:10.611 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T18:21:10.663 INFO:teuthology.orchestra.run.smithi028.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-23T18:21:10.678 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-23T18:21:10.702 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-23T18:21:10.718 INFO:teuthology.orchestra.run.smithi028.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-23T18:21:10.718 INFO:teuthology.orchestra.run.smithi028.stdout:This user must also own the server process. 2024-04-23T18:21:10.718 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:10.718 INFO:teuthology.orchestra.run.smithi028.stdout:The database cluster will be initialized with locale "en_US". 2024-04-23T18:21:10.718 INFO:teuthology.orchestra.run.smithi028.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-23T18:21:10.718 INFO:teuthology.orchestra.run.smithi028.stdout:The default text search configuration will be set to "english". 2024-04-23T18:21:10.718 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:10.718 INFO:teuthology.orchestra.run.smithi028.stdout:Data page checksums are disabled. 2024-04-23T18:21:10.719 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:10.719 INFO:teuthology.orchestra.run.smithi028.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-23T18:21:10.719 INFO:teuthology.orchestra.run.smithi028.stdout:creating subdirectories ... ok 2024-04-23T18:21:10.719 INFO:teuthology.orchestra.run.smithi028.stdout:selecting dynamic shared memory implementation ... posix 2024-04-23T18:21:10.744 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default max_connections ... 100 2024-04-23T18:21:10.778 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default shared_buffers ... 128MB 2024-04-23T18:21:10.793 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default time zone ... Etc/UTC 2024-04-23T18:21:10.794 INFO:teuthology.orchestra.run.smithi028.stdout:creating configuration files ... ok 2024-04-23T18:21:10.813 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T18:21:10.931 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T18:21:10.970 INFO:teuthology.orchestra.run.smithi028.stdout:running bootstrap script ... ok 2024-04-23T18:21:11.082 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T18:21:11.250 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T18:21:11.376 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-23T18:21:11.577 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-client (14+238) ... 2024-04-23T18:21:11.616 INFO:teuthology.orchestra.run.smithi028.stdout:performing post-bootstrap initialization ... ok 2024-04-23T18:21:11.703 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-23T18:21:12.242 INFO:teuthology.orchestra.run.smithi028.stdout:syncing data to disk ... ok 2024-04-23T18:21:12.246 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:12.246 INFO:teuthology.orchestra.run.smithi137.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-23T18:21:12.247 INFO:teuthology.orchestra.run.smithi137.stdout:which means they are currently configured by ifupdown: 2024-04-23T18:21:12.247 INFO:teuthology.orchestra.run.smithi137.stdout:- enp3s0f1 2024-04-23T18:21:12.247 INFO:teuthology.orchestra.run.smithi137.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-23T18:21:12.247 INFO:teuthology.orchestra.run.smithi137.stdout:remove their configuration from /etc/network/interfaces. 2024-04-23T18:21:12.247 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:12.374 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-23T18:21:12.721 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-23T18:21:12.789 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-23T18:21:13.084 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-23T18:21:13.655 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T18:21:13.782 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T18:21:13.975 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-23T18:21:14.101 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-common (238) ... 2024-04-23T18:21:15.048 INFO:teuthology.orchestra.run.smithi137.stdout:Adding user postgres to group ssl-cert 2024-04-23T18:21:15.238 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:15.238 INFO:teuthology.orchestra.run.smithi137.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-23T18:21:15.430 INFO:teuthology.orchestra.run.smithi137.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-23T18:21:15.431 INFO:teuthology.orchestra.run.smithi137.stdout:Removing obsolete dictionary files: 2024-04-23T18:21:15.811 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T18:21:15.970 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-23T18:21:16.040 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-23T18:21:16.096 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql (14+238) ... 2024-04-23T18:21:16.222 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T18:21:16.331 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T18:21:16.486 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T18:21:16.575 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T18:21:16.575 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T18:21:16.820 INFO:teuthology.orchestra.run.smithi137.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-23T18:21:16.837 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-23T18:21:16.879 INFO:teuthology.orchestra.run.smithi137.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-23T18:21:16.879 INFO:teuthology.orchestra.run.smithi137.stdout:This user must also own the server process. 2024-04-23T18:21:16.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:16.879 INFO:teuthology.orchestra.run.smithi137.stdout:The database cluster will be initialized with locale "en_US". 2024-04-23T18:21:16.879 INFO:teuthology.orchestra.run.smithi137.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-23T18:21:16.879 INFO:teuthology.orchestra.run.smithi137.stdout:The default text search configuration will be set to "english". 2024-04-23T18:21:16.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:16.879 INFO:teuthology.orchestra.run.smithi137.stdout:Data page checksums are disabled. 2024-04-23T18:21:16.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:16.879 INFO:teuthology.orchestra.run.smithi137.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-23T18:21:16.879 INFO:teuthology.orchestra.run.smithi137.stdout:creating subdirectories ... ok 2024-04-23T18:21:16.880 INFO:teuthology.orchestra.run.smithi137.stdout:selecting dynamic shared memory implementation ... posix 2024-04-23T18:21:16.891 INFO:teuthology.orchestra.run.smithi137.stdout:selecting default max_connections ... 100 2024-04-23T18:21:16.913 INFO:teuthology.orchestra.run.smithi137.stdout:selecting default shared_buffers ... 128MB 2024-04-23T18:21:16.922 INFO:teuthology.orchestra.run.smithi137.stdout:selecting default time zone ... Etc/UTC 2024-04-23T18:21:16.923 INFO:teuthology.orchestra.run.smithi137.stdout:creating configuration files ... ok 2024-04-23T18:21:17.034 INFO:teuthology.orchestra.run.smithi137.stdout:running bootstrap script ... ok 2024-04-23T18:21:17.325 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T18:21:17.417 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-23T18:21:17.744 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T18:21:17.764 INFO:teuthology.orchestra.run.smithi137.stdout:performing post-bootstrap initialization ... ok 2024-04-23T18:21:17.896 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T18:21:18.607 INFO:teuthology.orchestra.run.smithi137.stdout:syncing data to disk ... ok 2024-04-23T18:21:19.044 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-23T18:21:19.682 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-23T18:21:19.815 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T18:21:20.346 INFO:teuthology.orchestra.run.smithi028.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T18:21:20.353 DEBUG:teuthology.parallel:result is None 2024-04-23T18:21:22.001 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T18:21:22.152 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-23T18:21:22.278 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql (14+238) ... 2024-04-23T18:21:22.429 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T18:21:22.538 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T18:21:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T18:21:22.782 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T18:21:23.441 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T18:21:23.575 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-23T18:21:23.927 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T18:21:24.071 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T18:21:25.449 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-23T18:21:25.548 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T18:21:26.115 INFO:teuthology.orchestra.run.smithi137.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T18:21:26.120 DEBUG:teuthology.parallel:result is None 2024-04-23T18:21:26.121 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T18:21:26.341 DEBUG:teuthology.orchestra.run.smithi028:> dpkg-query -W -f '${Version}' ceph 2024-04-23T18:21:26.366 INFO:teuthology.orchestra.run.smithi028.stdout:19.0.0-3156-gd69f13d8-1jammy 2024-04-23T18:21:26.366 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T18:21:26.367 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156-gd69f13d8-1jammy is installed. 2024-04-23T18:21:26.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T18:21:26.589 DEBUG:teuthology.orchestra.run.smithi137:> dpkg-query -W -f '${Version}' ceph 2024-04-23T18:21:26.611 INFO:teuthology.orchestra.run.smithi137.stdout:19.0.0-3156-gd69f13d8-1jammy 2024-04-23T18:21:26.611 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T18:21:26.611 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156-gd69f13d8-1jammy is installed. 2024-04-23T18:21:26.613 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-23T18:21:26.613 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:26.613 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T18:21:26.635 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:21:26.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T18:21:26.667 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-23T18:21:26.667 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:26.667 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T18:21:26.698 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T18:21:26.762 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:21:26.762 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T18:21:26.776 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T18:21:26.832 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-23T18:21:26.832 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:26.832 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T18:21:26.854 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T18:21:26.922 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:21:26.922 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T18:21:26.936 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T18:21:26.991 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-23T18:21:26.991 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:26.991 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T18:21:27.012 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T18:21:27.078 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:21:27.078 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T18:21:27.091 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T18:21:27.146 INFO:teuthology.run_tasks:Running task ceph... 2024-04-23T18:21:27.226 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-23T18:21:27.226 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 777 /var/log/ceph 2024-04-23T18:21:27.229 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-04-23T18:21:27.247 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-23T18:21:27.247 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T18:21:27.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T18:21:27.314 INFO:tasks.ceph:Creating extra log directories... 2024-04-23T18:21:27.314 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T18:21:27.360 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T18:21:27.385 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-23T18:21:27.385 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-23T18:21:27.385 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-23T18:21:27.386 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:27.386 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-23T18:21:27.429 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-23T18:21:27.524 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:21:27.524 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-23T18:21:27.530 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-23T18:21:27.608 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-23T18:21:27.608 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-23T18:21:27.608 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}}', 'email': None, 'first_in_suite': False, 'job_id': '7670106', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '57e0caf76fdb7ab8b1358588f292d08519163844'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5182, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_57e0caf76fdb7ab8b1358588f292d08519163844/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph', 'suite_sha1': '57e0caf76fdb7ab8b1358588f292d08519163844', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi028.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZtr0m8d33EhsKYbt/vGaaly0Q+oAZBb5N0HYqm04HtbCag5Ao1aZSMZQaneAGQjkqYRqjuKqPdPdFVI33iaTY=', 'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOeKXnyjjUyMYlvak24BbLLLbgL9Z9qk+MC5i+7V7bETo8Oh6Y6qTrBHmbduA7HtedvKZjnB8AjcWZGUfbkrRwo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-23_17:44:29', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-23T18:21:27.609 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T18:21:27.612 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T18:21:27.652 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T18:21:27.664 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T18:21:27.707 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:27.707 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T18:21:27.734 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T18:21:27.734 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_1 2024-04-23T18:21:27.786 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T18:21:27.786 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:21:27.786 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-04-23T18:21:27.786 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:21:27.786 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-04-23 18:14:55.090418903 +0000 2024-04-23T18:21:27.786 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-04-23 18:14:54.794421544 +0000 2024-04-23T18:21:27.786 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-04-23 18:14:54.794421544 +0000 2024-04-23T18:21:27.787 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-04-23 18:14:54.794421544 +0000 2024-04-23T18:21:27.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T18:21:27.849 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-04-23T18:21:27.849 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-04-23T18:21:27.849 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000277672 s, 1.8 MB/s 2024-04-23T18:21:27.851 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T18:21:27.904 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_2 2024-04-23T18:21:27.954 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T18:21:27.954 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:21:27.954 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 6h/6d Inode: 912 Links: 1 2024-04-23T18:21:27.955 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:21:27.955 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-04-23 18:14:55.642413979 +0000 2024-04-23T18:21:27.955 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-04-23 18:14:55.378416334 +0000 2024-04-23T18:21:27.955 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-04-23 18:14:55.378416334 +0000 2024-04-23T18:21:27.955 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-04-23 18:14:55.378416334 +0000 2024-04-23T18:21:27.955 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T18:21:28.020 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-04-23T18:21:28.020 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-04-23T18:21:28.020 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000264897 s, 1.9 MB/s 2024-04-23T18:21:28.022 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T18:21:28.076 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_3 2024-04-23T18:21:28.130 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T18:21:28.130 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:21:28.130 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 6h/6d Inode: 931 Links: 1 2024-04-23T18:21:28.130 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:21:28.130 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-04-23 18:14:55.938411339 +0000 2024-04-23T18:21:28.130 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-04-23 18:14:55.934411375 +0000 2024-04-23T18:21:28.130 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-04-23 18:14:55.934411375 +0000 2024-04-23T18:21:28.130 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-04-23 18:14:55.934411375 +0000 2024-04-23T18:21:28.131 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T18:21:28.192 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-04-23T18:21:28.192 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-04-23T18:21:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000268304 s, 1.9 MB/s 2024-04-23T18:21:28.194 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T18:21:28.248 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_4 2024-04-23T18:21:28.298 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T18:21:28.299 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:21:28.299 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 6h/6d Inode: 947 Links: 1 2024-04-23T18:21:28.299 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:21:28.299 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-04-23 18:14:56.514406201 +0000 2024-04-23T18:21:28.299 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-04-23 18:14:56.510406235 +0000 2024-04-23T18:21:28.299 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-04-23 18:14:56.510406235 +0000 2024-04-23T18:21:28.299 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-04-23 18:14:56.510406235 +0000 2024-04-23T18:21:28.299 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T18:21:28.360 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-04-23T18:21:28.361 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-04-23T18:21:28.361 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000259575 s, 2.0 MB/s 2024-04-23T18:21:28.363 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T18:21:28.416 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T18:21:28.416 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:21:28.416 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T18:21:28.422 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T18:21:28.422 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-04-23T18:21:28.471 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T18:21:28.471 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:21:28.472 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-04-23T18:21:28.472 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:21:28.472 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-23 18:14:34.470000678 +0000 2024-04-23T18:21:28.472 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-23 18:14:34.198003109 +0000 2024-04-23T18:21:28.472 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-23 18:14:34.198003109 +0000 2024-04-23T18:21:28.472 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-04-23T18:21:28.472 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T18:21:28.526 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-23T18:21:28.526 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-23T18:21:28.526 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000512479 s, 999 kB/s 2024-04-23T18:21:28.527 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T18:21:28.577 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-04-23T18:21:28.623 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T18:21:28.623 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:21:28.623 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-04-23T18:21:28.623 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:21:28.623 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-23 18:14:34.957996320 +0000 2024-04-23T18:21:28.623 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-23 18:14:34.681998785 +0000 2024-04-23T18:21:28.623 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-23 18:14:34.681998785 +0000 2024-04-23T18:21:28.624 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-04-23T18:21:28.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T18:21:28.677 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-23T18:21:28.678 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-23T18:21:28.678 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000520947 s, 983 kB/s 2024-04-23T18:21:28.679 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T18:21:28.728 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-04-23T18:21:28.775 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T18:21:28.775 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:21:28.775 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-04-23T18:21:28.775 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:21:28.775 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-23 18:14:35.441991997 +0000 2024-04-23T18:21:28.775 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-23 18:14:35.201994139 +0000 2024-04-23T18:21:28.776 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-23 18:14:35.201994139 +0000 2024-04-23T18:21:28.776 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-04-23T18:21:28.776 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T18:21:28.829 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-23T18:21:28.829 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-23T18:21:28.829 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000453824 s, 1.1 MB/s 2024-04-23T18:21:28.830 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T18:21:28.880 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-04-23T18:21:28.927 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T18:21:28.927 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:21:28.927 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-04-23T18:21:28.927 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:21:28.927 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-23 18:14:35.673989925 +0000 2024-04-23T18:21:28.927 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-23 18:14:35.669989959 +0000 2024-04-23T18:21:28.928 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-23 18:14:35.669989959 +0000 2024-04-23T18:21:28.928 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-04-23T18:21:28.928 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T18:21:28.981 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-23T18:21:28.981 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-23T18:21:28.981 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000493102 s, 1.0 MB/s 2024-04-23T18:21:28.982 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T18:21:29.032 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T18:21:29.032 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-23T18:21:29.032 INFO:tasks.ceph:Generating config... 2024-04-23T18:21:29.033 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-23T18:21:29.033 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-23T18:21:29.034 INFO:tasks.ceph:[client] debug client = 20 2024-04-23T18:21:29.034 INFO:tasks.ceph:[client] debug ms = 1 2024-04-23T18:21:29.034 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-23T18:21:29.034 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-23T18:21:29.034 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-23T18:21:29.034 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-23T18:21:29.034 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-23T18:21:29.034 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-23T18:21:29.034 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-23T18:21:29.034 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-23T18:21:29.034 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-23T18:21:29.034 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-23T18:21:29.034 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-23T18:21:29.034 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-23T18:21:29.034 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-23T18:21:29.034 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-23T18:21:29.035 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-23T18:21:29.036 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-23T18:21:29.036 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-23T18:21:29.036 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-23T18:21:29.036 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-23T18:21:29.037 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-23T18:21:29.037 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-23T18:21:29.037 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-23T18:21:29.037 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-23T18:21:29.037 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-23T18:21:29.037 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-23T18:21:29.037 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-23T18:21:29.037 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-23T18:21:29.037 INFO:tasks.ceph:Setting up mon.a... 2024-04-23T18:21:29.037 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-23T18:21:29.085 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.keyring 2024-04-23T18:21:29.098 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-23T18:21:29.191 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T18:21:29.211 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.28'), ('mon.b', '172.21.15.137'), ('mon.c', '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]')] 2024-04-23T18:21:29.211 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.28,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-23T18:21:29.212 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:29.212 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T18:21:29.265 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.28 --add b 172.21.15.137 --addv c '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: generated fsid d84cc156-ceaf-4cae-a89c-ee7e55af72c5 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:setting min_mon_release = quincy 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 0 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:fsid d84cc156-ceaf-4cae-a89c-ee7e55af72c5 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:last_changed 2024-04-23T18:21:29.371102+0000 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:created 2024-04-23T18:21:29.371102+0000 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:min_mon_release 17 (quincy) 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:election_strategy: 1 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:1: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-04-23T18:21:29.360 INFO:teuthology.orchestra.run.smithi028.stdout:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-04-23T18:21:29.361 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-23T18:21:29.363 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T18:21:29.371 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d84cc156-ceaf-4cae-a89c-ee7e55af72c5... 2024-04-23T18:21:29.372 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T18:21:29.416 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T18:21:29.447 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-23T18:21:29.447 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-04-23T18:21:29.447 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T18:21:29.447 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-04-23T18:21:29.447 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.447 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.448 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.449 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.28,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on skipped message = False 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = d84cc156-ceaf-4cae-a89c-ee7e55af72c5 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-04-23T18:21:29.450 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.451 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 20 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 20 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-23T18:21:29.452 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 10 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: mon client directed command retry = 5 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject delay max = 1 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject delay probability = 0.005 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject delay type = client mds 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject socket failures = 2500 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: osd blocked scrub grace period = 3600 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: osd max markdown count = 1000 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-23T18:21:29.453 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-23T18:21:29.454 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T18:21:29.455 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: client_shutdown_timeout = 120 2024-04-23T18:21:29.456 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.e] 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.f] 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-23T18:21:29.457 INFO:teuthology.orchestra.run.smithi137.stdout: mds bal fragment size max = 10000 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: mds bal merge size = 5 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: mds bal split bits = 3 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: mds bal split size = 100 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: mds oft prefetch dirfrags = True 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: mds_dir_prefetch = True 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: mds_sleep_rank_change = 5000000.0 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: mon client directed command retry = 5 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject delay max = 1 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject delay probability = 0.005 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject delay type = client mds osd 2024-04-23T18:21:29.458 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject socket failures = 2500 2024-04-23T18:21:29.459 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-23T18:21:29.459 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-23T18:21:29.459 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-23T18:21:29.459 INFO:teuthology.orchestra.run.smithi028.stdout:[global] 2024-04-23T18:21:29.459 INFO:teuthology.orchestra.run.smithi028.stdout: chdir = "" 2024-04-23T18:21:29.459 INFO:teuthology.orchestra.run.smithi028.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T18:21:29.459 INFO:teuthology.orchestra.run.smithi028.stdout: auth supported = cephx 2024-04-23T18:21:29.459 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: filestore xattr use omap = true 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: mon clock drift allowed = 1.000 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: osd crush chooseleaf type = 0 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: auth debug = true 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on old message = true 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on bug = true 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: mon pg warn max object skew = 0 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.460 INFO:teuthology.orchestra.run.smithi028.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default size = 2 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow primary affinity = true 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow pg remap = true 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on legacy crush tunables = false 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on crush straw calc version zero = false 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on no sortbitwise = false 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on osd down out interval zero = false 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on too few osds = false 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: mon_allow_pool_size_one = true 2024-04-23T18:21:29.461 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: osd default data pool replay window = 5 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: mon allow pool delete = true 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: mon cluster log file level = debug 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: debug asserts on shutdown = true 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: mon health detail to clog = false 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: mon host = "172.21.15.28,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on skipped message = False 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: fsid = d84cc156-ceaf-4cae-a89c-ee7e55af72c5 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.462 INFO:teuthology.orchestra.run.smithi028.stdout:[osd] 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: osd journal size = 100 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub load threshold = 5.0 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub max interval = 600 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: osd mclock profile = high_recovery_ops 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: osd recover clone overlap = true 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: osd recovery max chunk = 1048576 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug shutdown = true 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug op order = true 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug verify stray on activate = true 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug trim objects = true 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: osd open classes on start = true 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug pg log writeout = true 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: osd deep scrub update digest min age = 30 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: osd map max advance = 10 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: journal zero on create = true 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: filestore ondisk finisher threads = 3 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: filestore apply finisher threads = 3 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: bdev debug aio = true 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug misdirected ops = true 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore block size = 96636764160 2024-04-23T18:21:29.464 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore fsck on mount = True 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluefs = 20 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluestore = 20 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: debug osd = 20 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: debug rocksdb = 10 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: mon client directed command retry = 5 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd full ratio = 0.9 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd nearfull ratio = 0.8 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: ms inject delay max = 1 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: ms inject delay probability = 0.005 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: ms inject delay type = client mds 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: ms inject socket failures = 2500 2024-04-23T18:21:29.465 INFO:teuthology.orchestra.run.smithi028.stdout: osd blocked scrub grace period = 3600 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: osd failsafe full ratio = 0.95 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: osd max markdown count = 1000 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: osd objectstore = bluestore 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: osd op complaint time = 180 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr] 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: debug mgr = 20 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: mgr/telemetry/nag = false 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: debug client = 20 2024-04-23T18:21:29.466 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout:[mon] 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: debug paxos = 20 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: mon data avail warn = 5 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: mon mgr mkfs grace = 240 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd reporter subtree level = osd 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd prime pg temp = true 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T18:21:29.467 INFO:teuthology.orchestra.run.smithi028.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: # 1m isn't quite enough 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: mon_down_mkfs_grace = 2m 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_filestore_osds = false 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: mon down mkfs grace = 300 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: mon op complaint time = 120 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout:[client] 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: rgw cache enabled = true 2024-04-23T18:21:29.468 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable ops log = true 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable usage log = true 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout: client mount timeout = 600 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout: client_shutdown_timeout = 120 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout: debug client = 20 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout: rados mon op timeout = 900 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout: rados osd op timeout = 900 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.a] 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.b] 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.c] 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a] 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c] 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.e] 2024-04-23T18:21:29.469 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b] 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.d] 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.f] 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout:[mds] 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout: debug mds = 20 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout: debug mds balancer = 20 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout: mds bal fragment size max = 10000 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout: mds bal merge size = 5 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout: mds bal split bits = 3 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout: mds bal split size = 100 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout: mds debug frag = True 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout: mds debug scatterstat = True 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout: mds oft prefetch dirfrags = True 2024-04-23T18:21:29.470 INFO:teuthology.orchestra.run.smithi028.stdout: mds op complaint time = 180 2024-04-23T18:21:29.471 INFO:teuthology.orchestra.run.smithi028.stdout: mds verify scatter = True 2024-04-23T18:21:29.471 INFO:teuthology.orchestra.run.smithi028.stdout: mds_dir_prefetch = True 2024-04-23T18:21:29.471 INFO:teuthology.orchestra.run.smithi028.stdout: mds_sleep_rank_change = 5000000.0 2024-04-23T18:21:29.471 INFO:teuthology.orchestra.run.smithi028.stdout: mon client directed command retry = 5 2024-04-23T18:21:29.471 INFO:teuthology.orchestra.run.smithi028.stdout: ms inject delay max = 1 2024-04-23T18:21:29.471 INFO:teuthology.orchestra.run.smithi028.stdout: ms inject delay probability = 0.005 2024-04-23T18:21:29.471 INFO:teuthology.orchestra.run.smithi028.stdout: ms inject delay type = client mds osd 2024-04-23T18:21:29.471 INFO:teuthology.orchestra.run.smithi028.stdout: ms inject socket failures = 2500 2024-04-23T18:21:29.471 INFO:teuthology.orchestra.run.smithi028.stdout: osd op complaint time = 180 2024-04-23T18:21:29.471 INFO:teuthology.orchestra.run.smithi028.stdout: rados mon op timeout = 900 2024-04-23T18:21:29.471 INFO:teuthology.orchestra.run.smithi028.stdout: rados osd op timeout = 900 2024-04-23T18:21:29.472 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-23T18:21:29.473 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-23T18:21:29.571 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-23T18:21:29.571 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:29.571 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-23T18:21:29.580 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:29.580 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-23T18:21:29.633 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:21:29.633 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:29.633 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T18:21:29.633 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T18:21:29.708 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:29.709 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:29.761 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T18:21:29.761 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:21:29.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T18:21:29.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T18:21:29.784 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:21:29.784 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:29.831 INFO:tasks.ceph:Setting up mon nodes... 2024-04-23T18:21:29.831 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-23T18:21:29.831 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-23T18:21:29.886 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-23T18:21:29.891 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T18:21:29.934 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T18:21:29.953 INFO:tasks.ceph:Setting up mds nodes... 2024-04-23T18:21:29.953 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-23T18:21:30.008 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-23T18:21:30.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-23T18:21:30.033 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-23T18:21:30.128 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-23T18:21:30.132 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-23T18:21:30.152 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-23T18:21:30.247 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-23T18:21:30.251 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-23T18:21:30.271 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-23T18:21:30.316 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-23T18:21:30.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-23T18:21:30.331 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-23T18:21:30.412 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-23T18:21:30.415 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-23T18:21:30.471 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-23T18:21:30.554 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-23T18:21:30.557 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-23T18:21:30.610 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-23T18:21:30.611 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-23T18:21:30.654 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-23T18:21:30.672 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-23T18:21:30.672 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-23T18:21:30.672 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-23T18:21:30.732 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T18:21:30.732 INFO:tasks.ceph:role: osd.0 2024-04-23T18:21:30.732 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:21:30.732 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T18:21:30.792 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:21:30.792 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:21:30.792 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:21:30.792 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:21:30.792 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:21:30.792 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:21:30.792 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:21:30.793 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:21:30.793 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:21:30.793 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:21:30.816 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-04-23T18:21:30.819 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-04-23T18:21:30.819 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-23T18:21:30.886 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-23T18:21:30.949 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:21:30.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:30.950 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-23T18:21:31.012 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T18:21:31.012 INFO:tasks.ceph:role: osd.1 2024-04-23T18:21:31.013 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:21:31.013 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T18:21:31.071 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:21:31.072 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:21:31.072 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:21:31.072 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:21:31.072 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:21:31.072 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:21:31.072 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:21:31.072 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:21:31.072 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:21:31.072 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:21:31.096 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-04-23T18:21:31.099 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-04-23T18:21:31.099 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-23T18:21:31.169 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-23T18:21:31.229 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:21:31.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:31.230 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-23T18:21:31.297 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T18:21:31.297 INFO:tasks.ceph:role: osd.2 2024-04-23T18:21:31.297 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:21:31.297 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-23T18:21:31.360 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:21:31.360 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:21:31.360 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:21:31.360 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:21:31.360 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:21:31.360 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:21:31.360 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:21:31.361 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:21:31.361 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:21:31.361 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:21:31.384 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-04-23T18:21:31.387 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-04-23T18:21:31.387 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-23T18:21:31.458 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-23T18:21:31.521 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:21:31.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:31.522 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-23T18:21:31.588 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T18:21:31.589 INFO:tasks.ceph:role: osd.3 2024-04-23T18:21:31.589 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:21:31.589 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-23T18:21:31.648 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:21:31.648 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:21:31.648 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:21:31.648 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:21:31.648 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:21:31.648 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:21:31.648 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:21:31.648 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:21:31.648 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:21:31.648 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:21:31.673 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-04-23T18:21:31.676 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-04-23T18:21:31.676 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-23T18:21:31.742 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-23T18:21:31.800 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:21:31.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:31.802 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:31.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:31.933+0000 7fe772a957c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-23T18:21:31.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:31.933+0000 7fe772a957c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-23T18:21:31.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:31.933+0000 7fe772a957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T18:21:31.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:31.933+0000 7fe772a957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T18:21:31.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:31.933+0000 7fe772a957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T18:21:31.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:31.937+0000 7fe772a957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-23T18:21:34.961 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-23T18:21:34.983 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:35.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:35.089+0000 7f158c5077c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-23T18:21:35.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:35.089+0000 7f158c5077c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-23T18:21:35.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:35.089+0000 7f158c5077c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T18:21:35.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:35.089+0000 7f158c5077c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T18:21:35.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:35.089+0000 7f158c5077c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T18:21:35.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:35.093+0000 7f158c5077c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-23T18:21:38.120 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-23T18:21:38.141 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:38.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:38.248+0000 7f434dc247c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-23T18:21:38.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:38.248+0000 7f434dc247c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-23T18:21:38.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:38.248+0000 7f434dc247c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T18:21:38.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:38.248+0000 7f434dc247c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T18:21:38.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:38.248+0000 7f434dc247c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T18:21:38.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:38.248+0000 7f434dc247c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-23T18:21:41.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-23T18:21:41.301 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:41.408+0000 7f09fbd077c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-23T18:21:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:41.408+0000 7f09fbd077c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-23T18:21:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:41.408+0000 7f09fbd077c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T18:21:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:41.408+0000 7f09fbd077c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T18:21:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:41.408+0000 7f09fbd077c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T18:21:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:21:41.408+0000 7f09fbd077c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-23T18:21:44.420 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-23T18:21:44.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-23T18:21:44.455 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T18:21:44.456 INFO:tasks.ceph:role: osd.4 2024-04-23T18:21:44.456 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T18:21:44.456 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T18:21:44.518 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:21:44.518 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:21:44.518 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:21:44.518 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:21:44.519 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:21:44.519 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:21:44.519 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:21:44.519 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:21:44.519 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:21:44.519 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:21:44.993 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-23T18:21:44.995 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-23T18:21:44.996 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-23T18:21:45.124 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-23T18:21:45.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:45.134 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:21:45.135 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-23T18:21:45.192 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T18:21:45.192 INFO:tasks.ceph:role: osd.5 2024-04-23T18:21:45.192 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T18:21:45.192 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T18:21:45.253 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:21:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:21:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:21:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:21:45.254 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:21:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:21:45.254 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:21:45.254 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:21:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:21:45.254 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:21:45.679 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-23T18:21:45.681 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-23T18:21:45.681 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-23T18:21:45.742 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-23T18:21:45.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:45.796 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:21:45.796 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-23T18:21:45.850 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T18:21:45.851 INFO:tasks.ceph:role: osd.6 2024-04-23T18:21:45.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T18:21:45.851 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-23T18:21:45.917 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:21:45.917 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:21:45.917 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:21:45.918 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:21:45.918 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:21:45.918 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:21:45.918 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:21:45.918 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:21:45.918 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:21:45.918 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:21:46.378 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-23T18:21:46.380 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-23T18:21:46.380 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-23T18:21:46.481 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-23T18:21:46.491 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:21:46.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:46.492 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-23T18:21:46.547 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T18:21:46.547 INFO:tasks.ceph:role: osd.7 2024-04-23T18:21:46.547 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T18:21:46.547 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-23T18:21:46.610 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:21:46.610 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:21:46.610 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:21:46.611 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T18:21:46.611 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:21:46.611 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:21:46.611 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:21:46.611 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T18:21:46.611 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:21:46.611 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:21:47.068 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-23T18:21:47.070 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-23T18:21:47.071 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-23T18:21:47.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-23T18:21:47.232 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T18:21:47.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:47.233 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:47.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:47.346+0000 7fce0f2f37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-23T18:21:47.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:47.350+0000 7fce0f2f37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-23T18:21:47.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:47.350+0000 7fce0f2f37c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T18:21:47.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:47.350+0000 7fce0f2f37c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T18:21:47.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:47.350+0000 7fce0f2f37c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T18:21:47.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:47.358+0000 7fce0f2f37c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-23T18:21:50.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-23T18:21:50.333 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:50.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:50.418+0000 7f9a16b507c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-23T18:21:50.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:50.422+0000 7f9a16b507c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-23T18:21:50.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:50.422+0000 7f9a16b507c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T18:21:50.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:50.422+0000 7f9a16b507c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T18:21:50.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:50.422+0000 7f9a16b507c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T18:21:50.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:50.422+0000 7f9a16b507c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-23T18:21:53.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-23T18:21:53.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:53.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:53.526+0000 7f7ec900d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-23T18:21:53.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:53.530+0000 7f7ec900d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-23T18:21:53.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:53.530+0000 7f7ec900d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T18:21:53.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:53.530+0000 7f7ec900d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T18:21:53.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:53.530+0000 7f7ec900d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T18:21:53.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:53.530+0000 7f7ec900d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-23T18:21:56.494 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-23T18:21:56.547 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:21:56.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:56.633+0000 7fbba882a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-23T18:21:56.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:56.633+0000 7fbba882a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-23T18:21:56.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:56.633+0000 7fbba882a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T18:21:56.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:56.633+0000 7fbba882a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T18:21:56.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:56.633+0000 7fbba882a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T18:21:56.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:21:56.637+0000 7fbba882a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-23T18:21:57.610 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:21:57.614 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:21:59.607 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-23T18:21:59.620 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-23T18:21:59.620 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:59.621 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-23T18:21:59.643 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:59.643 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-23T18:21:59.706 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:59.706 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-23T18:21:59.771 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:59.771 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-23T18:21:59.835 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:59.835 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-23T18:21:59.899 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:59.899 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-23T18:21:59.963 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:21:59.963 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-23T18:22:00.027 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:22:00.027 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-23T18:22:00.091 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:00.091 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-23T18:22:00.104 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:00.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-23T18:22:00.158 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:00.158 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-23T18:22:00.213 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:00.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-23T18:22:00.266 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:00.267 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-23T18:22:00.327 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:00.327 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-23T18:22:00.382 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:00.382 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-23T18:22:00.439 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:00.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-23T18:22:00.494 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:22:00.494 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-23T18:22:00.503 INFO:tasks.ceph:Adding keys to all mons... 2024-04-23T18:22:00.503 DEBUG:teuthology.orchestra.run.smithi028:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T18:22:00.548 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T18:22:00.559 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.y] 2024-04-23T18:22:00.560 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAp/Cdmi9p+NRAAf49oka+Iq49HYhA9+VA3XA== 2024-04-23T18:22:00.560 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-23T18:22:00.560 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAq/CdmdUAoARAAg5ayFRfYLPKLXYl2+B2RfQ== 2024-04-23T18:22:00.560 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-23T18:22:00.560 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAq/CdmWM1PCBAAubErsy3VWerjjn3346vBHg== 2024-04-23T18:22:00.560 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.e] 2024-04-23T18:22:00.560 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAq/CdmaUJmDxAAsjPGECu8ER7+veuMhtiKWg== 2024-04-23T18:22:00.560 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-04-23T18:22:00.560 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAr/CdmtBIIOBAAKgXUhHK28czYliu5HlARHg== 2024-04-23T18:22:00.560 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-04-23T18:22:00.560 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAv/CdmtBGpBRAAKYiAw5dMmRp+TMnL7KNR8Q== 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAy/CdmVlUeDxAAAkMevjU6kmEqbJsgCe6Nww== 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQA1/Cdmig+0GBAAQCIKW5GnI9jm9EglABf1yQ== 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAp/CdmmgBHOBAA1HIefIlEJC4bRezG6tsuvA== 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAq/CdmYTpmExAAieBivYYC+4wcxEL874y/+Q== 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAq/CdmCP8oGRAAZAwh3HCe8KXPzcsRK8Y7Qw== 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.f] 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAq/CdmQvGVIRAACmVTuAEFvcdFFzNRm5Cbgw== 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.4] 2024-04-23T18:22:00.561 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQA7/CdmTT7GFBAA6SppGy1Tj8tJFz20/lz9zQ== 2024-04-23T18:22:00.562 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.5] 2024-04-23T18:22:00.562 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQA+/Cdm5YVEGRAAUnr/Vkmhmh+DFoGsk2QfLw== 2024-04-23T18:22:00.562 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.6] 2024-04-23T18:22:00.562 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBB/CdmpAuxHxAAZAaSkZeu3gkwiHaATQrX+g== 2024-04-23T18:22:00.562 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.7] 2024-04-23T18:22:00.562 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBE/CdmXEgaJhAAkQ0w6MjInQxYHbQ2/nfBGg== 2024-04-23T18:22:00.562 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-23T18:22:00.562 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQAq/CdmVFysJxAALDIWf9Hc5eEq5lD5+hI69g== 2024-04-23T18:22:00.564 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.y] 2024-04-23T18:22:00.564 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAp/Cdmi9p+NRAAf49oka+Iq49HYhA9+VA3XA== 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a] 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAq/CdmdUAoARAAg5ayFRfYLPKLXYl2+B2RfQ== 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c] 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAq/CdmWM1PCBAAubErsy3VWerjjn3346vBHg== 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.e] 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAq/CdmaUJmDxAAsjPGECu8ER7+veuMhtiKWg== 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.0] 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAr/CdmtBIIOBAAKgXUhHK28czYliu5HlARHg== 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.1] 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAv/CdmtBGpBRAAKYiAw5dMmRp+TMnL7KNR8Q== 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.2] 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAy/CdmVlUeDxAAAkMevjU6kmEqbJsgCe6Nww== 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.3] 2024-04-23T18:22:00.565 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQA1/Cdmig+0GBAAQCIKW5GnI9jm9EglABf1yQ== 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.x] 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAp/CdmmgBHOBAA1HIefIlEJC4bRezG6tsuvA== 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b] 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAq/CdmYTpmExAAieBivYYC+4wcxEL874y/+Q== 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.d] 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAq/CdmCP8oGRAAZAwh3HCe8KXPzcsRK8Y7Qw== 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.f] 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAq/CdmQvGVIRAACmVTuAEFvcdFFzNRm5Cbgw== 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.4] 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQA7/CdmTT7GFBAA6SppGy1Tj8tJFz20/lz9zQ== 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.5] 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQA+/Cdm5YVEGRAAUnr/Vkmhmh+DFoGsk2QfLw== 2024-04-23T18:22:00.566 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.6] 2024-04-23T18:22:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBB/CdmpAuxHxAAZAaSkZeu3gkwiHaATQrX+g== 2024-04-23T18:22:00.567 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.7] 2024-04-23T18:22:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBE/CdmXEgaJhAAkQ0w6MjInQxYHbQ2/nfBGg== 2024-04-23T18:22:00.567 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-04-23T18:22:00.567 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAq/CdmVFysJxAALDIWf9Hc5eEq5lD5+hI69g== 2024-04-23T18:22:00.568 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T18:22:00.613 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T18:22:00.670 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:00.673 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:00.746 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:00.750 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:00.838 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:00.841 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:00.895 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:00.898 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:00.966 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:00.969 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.048 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.127 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.131 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.209 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T18:22:01.212 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T18:22:01.292 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:01.295 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:01.377 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:01.380 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:01.465 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:01.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T18:22:01.556 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.559 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.611 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.614 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.682 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.763 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.766 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:22:01.847 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T18:22:01.850 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T18:22:01.935 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-23T18:22:01.935 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-23T18:22:01.955 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T18:22:02.067 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-23T18:22:02.087 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-23T18:22:02.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T18:22:02.194 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-23T18:22:02.205 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-23T18:22:02.258 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T18:22:02.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-23T18:22:02.406 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:22:02.409 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:22:02.452 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-23T18:22:02.452 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-23T18:22:02.453 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-23T18:22:02.460 INFO:tasks.ceph.mon.a:Started 2024-04-23T18:22:02.460 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-23T18:22:02.460 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-23T18:22:02.500 INFO:tasks.ceph.mon.b:Started 2024-04-23T18:22:02.501 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-23T18:22:02.501 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-23T18:22:02.503 INFO:tasks.ceph.mon.c:Started 2024-04-23T18:22:02.503 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-23T18:22:02.504 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-23T18:22:02.504 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-23T18:22:02.507 INFO:tasks.ceph.mgr.y:Started 2024-04-23T18:22:02.507 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-23T18:22:02.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-23T18:22:02.509 INFO:tasks.ceph.mgr.x:Started 2024-04-23T18:22:02.509 INFO:tasks.ceph:Setting crush tunables to default 2024-04-23T18:22:02.509 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd crush tunables default 2024-04-23T18:22:02.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca2200640 1 Processor -- start 2024-04-23T18:22:02.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca2200640 1 -- start start 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca2200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca2200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca2200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac9c0cac40 con 0x7fac9c070ec0 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca2200640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fac9c15b320 con 0x7fac9c0ca290 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca2200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fac9c15b600 con 0x7fac9c154ee0 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7fac9be00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fac9c070ec0 0x7fac9c06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:46878/0 (socket says 172.21.15.28:46878) 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7fac9be00640 1 -- 172.21.15.28:0/3980423838 learned_addr learned my addr 172.21.15.28:0/3980423838 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca0e00640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 msgr2=0x7fac9c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca0e00640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 msgr2=0x7fac9c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.655+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T18:22:02.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.711+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:02.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.711+0000 7faca1800640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 msgr2=0x7fac9c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-23T18:22:02.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.711+0000 7faca1800640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 msgr2=0x7fac9c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:02.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.711+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:02.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.711+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T18:22:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.863+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.863+0000 7faca0e00640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 msgr2=0x7fac9c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T18:22:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.863+0000 7faca0e00640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 msgr2=0x7fac9c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.863+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:02.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.863+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T18:22:02.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.915+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.915+0000 7faca1800640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 msgr2=0x7fac9c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T18:22:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.915+0000 7faca1800640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 msgr2=0x7fac9c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.915+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:02.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:02.915+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T18:22:03.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:03.267+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:03.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:03.267+0000 7faca0e00640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 msgr2=0x7fac9c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T18:22:03.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:03.267+0000 7faca0e00640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 msgr2=0x7fac9c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:03.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:03.267+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:03.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:03.267+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T18:22:03.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:03.319+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:03.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:03.319+0000 7faca1800640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 msgr2=0x7fac9c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T18:22:03.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:03.319+0000 7faca1800640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 msgr2=0x7fac9c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:03.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:03.319+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:03.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:03.319+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T18:22:04.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:04.071+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:04.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:04.071+0000 7faca0e00640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 msgr2=0x7fac9c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T18:22:04.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:04.071+0000 7faca0e00640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 msgr2=0x7fac9c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:04.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:04.071+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:04.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:04.071+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-23T18:22:04.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:04.123+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:04.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:04.123+0000 7faca1800640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 msgr2=0x7fac9c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T18:22:04.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:04.123+0000 7faca1800640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 msgr2=0x7fac9c0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:04.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:04.123+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:04.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:04.123+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-23T18:22:05.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9a000640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 msgr2=0x7fac9c0713f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T18:22:05.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9a000640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac9c154ee0 0x7fac9c0713f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:05.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9a000640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 msgr2=0x7fac9c0ca700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T18:22:05.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9a000640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.28:3300/0 conn(0x7fac9c0ca290 0x7fac9c0ca700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:05.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9a000640 1 -- 172.21.15.28:0/3980423838 >> v1:172.21.15.137:6789/0 conn(0x7fac9c070ec0 legacy=0x7fac9c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:05.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9a000640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:05.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9a000640 1 -- 172.21.15.28:0/3980423838 --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac9c15b8e0 con 0x7fac7c0036f0 2024-04-23T18:22:05.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9a000640 1 -- 172.21.15.28:0/3980423838 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fac9c15b320 con 0x7fac7c007410 2024-04-23T18:22:05.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:05.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9be00640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 msgr2=0x7fac7c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-23T18:22:05.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9be00640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 msgr2=0x7fac7c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:05.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:05.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.659+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T18:22:05.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.863+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:05.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.863+0000 7fac9be00640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 msgr2=0x7fac7c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-23T18:22:05.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.863+0000 7fac9be00640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 msgr2=0x7fac7c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:05.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.863+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:05.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:05.863+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T18:22:06.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:06.267+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:06.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:06.267+0000 7fac9be00640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 msgr2=0x7fac7c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-23T18:22:06.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:06.267+0000 7fac9be00640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 msgr2=0x7fac7c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:06.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:06.267+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:06.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:06.267+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-23T18:22:07.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.071+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:07.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.071+0000 7fac9be00640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 msgr2=0x7fac7c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-23T18:22:07.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.071+0000 7fac9be00640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 msgr2=0x7fac7c0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:07.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.071+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T18:22:07.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.071+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-23T18:22:07.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136260510 0 0) 0x7fac9c15b8e0 con 0x7fac7c0036f0 2024-04-23T18:22:07.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac84003530 con 0x7fac7c0036f0 2024-04-23T18:22:07.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 197866418 0 0) 0x7fac84003530 con 0x7fac7c0036f0 2024-04-23T18:22:07.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 msgr2=0x7fac7c0098b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T18:22:07.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 --2- 172.21.15.28:0/3980423838 >> v2:172.21.15.137:3300/0 conn(0x7fac7c007410 0x7fac7c0098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:07.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c00afb0 con 0x7fac7c0036f0 2024-04-23T18:22:07.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7fac9000f040 con 0x7fac7c0036f0 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 >> v1:172.21.15.28:6789/0 conn(0x7fac7c0036f0 legacy=0x7fac7c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7faca1800640 1 -- 172.21.15.28:0/3980423838 reap_dead start 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 0x7fac84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac84004810 0x7fac84004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac840052f0 0x7fac8400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c15b320 con 0x7fac840039c0 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac8400c240 con 0x7fac84004810 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fac8400c440 con 0x7fac840052f0 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 0x7fac84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac84004810 0x7fac84004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac840052f0 0x7fac8400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:07.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7faca0e00640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac840052f0 msgr2=0x7fac8400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:07.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac840052f0 0x7fac8400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:07.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7faca0e00640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac84004810 msgr2=0x7fac84004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:07.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac84004810 0x7fac84004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:07.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7faca0e00640 1 -- 172.21.15.28:0/3980423838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac84003530 con 0x7fac840039c0 2024-04-23T18:22:07.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7faca1800640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac840052f0 0x7fac8400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:07.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.895+0000 7fac9be00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac84004810 0x7fac84004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:07.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7faca0e00640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 0x7fac84003dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fac90000ee0 tx=0x7fac9001d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1893112f5c4ea117 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:07.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac900ac070 con 0x7fac840039c0 2024-04-23T18:22:07.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac900a67c0 con 0x7fac840039c0 2024-04-23T18:22:07.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7fac9b400640 1 -- 172.21.15.28:0/3980423838 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9000ecf0 con 0x7fac840039c0 2024-04-23T18:22:07.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7faca2200640 1 -- 172.21.15.28:0/3980423838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 msgr2=0x7fac84003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:07.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7faca2200640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 0x7fac84003dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fac90000ee0 tx=0x7fac9001d910 comp rx=0 tx=0).stop 2024-04-23T18:22:07.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7faca2200640 1 -- 172.21.15.28:0/3980423838 shutdown_connections 2024-04-23T18:22:07.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7faca2200640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac840052f0 0x7fac8400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:07.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7faca2200640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac84004810 0x7fac84004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:07.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7faca2200640 1 --2- 172.21.15.28:0/3980423838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 0x7fac84003dc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:07.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7faca2200640 1 -- 172.21.15.28:0/3980423838 >> 172.21.15.28:0/3980423838 conn(0x7fac9c0ce5e0 msgr2=0x7fac9c0ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:07.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7faca2200640 1 -- 172.21.15.28:0/3980423838 shutdown_connections 2024-04-23T18:22:07.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.899+0000 7faca2200640 1 -- 172.21.15.28:0/3980423838 wait complete. 2024-04-23T18:22:07.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca2200640 1 Processor -- start 2024-04-23T18:22:07.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca2200640 1 -- start start 2024-04-23T18:22:07.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca2200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 0x7fac9c0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:07.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca2200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac84004810 0x7fac9c14afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:07.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca2200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac840052f0 0x7fac9c14b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:07.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca2200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c1552c0 con 0x7fac840039c0 2024-04-23T18:22:07.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca2200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0cf370 con 0x7fac84004810 2024-04-23T18:22:07.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca2200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fac9c155440 con 0x7fac840052f0 2024-04-23T18:22:07.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca0e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 0x7fac9c0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:07.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca0e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 0x7fac9c0c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57656/0 (socket says 172.21.15.28:57656) 2024-04-23T18:22:07.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca0e00640 1 -- 172.21.15.28:0/3306992038 learned_addr learned my addr 172.21.15.28:0/3306992038 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:07.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7fac9be00640 1 --2- 172.21.15.28:0/3306992038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac84004810 0x7fac9c14afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:07.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca1800640 1 --2- 172.21.15.28:0/3306992038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac840052f0 0x7fac9c14b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:07.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca0e00640 1 -- 172.21.15.28:0/3306992038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac840052f0 msgr2=0x7fac9c14b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:07.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca0e00640 1 --2- 172.21.15.28:0/3306992038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac840052f0 0x7fac9c14b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:07.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca0e00640 1 -- 172.21.15.28:0/3306992038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac84004810 msgr2=0x7fac9c14afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:07.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca0e00640 1 --2- 172.21.15.28:0/3306992038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac84004810 0x7fac9c14afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:07.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.903+0000 7faca0e00640 1 -- 172.21.15.28:0/3306992038 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9c0c6970 con 0x7fac840039c0 2024-04-23T18:22:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.907+0000 7faca0e00640 1 --2- 172.21.15.28:0/3306992038 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 0x7fac9c0c81b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fac9001d740 tx=0x7fac9001a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.907+0000 7fac98c00640 1 -- 172.21.15.28:0/3306992038 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac900ac040 con 0x7fac840039c0 2024-04-23T18:22:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.907+0000 7fac98c00640 1 -- 172.21.15.28:0/3306992038 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac900a6e50 con 0x7fac840039c0 2024-04-23T18:22:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.907+0000 7fac98c00640 1 -- 172.21.15.28:0/3306992038 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac900b8820 con 0x7fac840039c0 2024-04-23T18:22:07.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.907+0000 7faca2200640 1 -- 172.21.15.28:0/3306992038 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9c159b20 con 0x7fac840039c0 2024-04-23T18:22:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.907+0000 7faca2200640 1 -- 172.21.15.28:0/3306992038 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac9c15adb0 con 0x7fac840039c0 2024-04-23T18:22:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.907+0000 7fac98c00640 1 -- 172.21.15.28:0/3306992038 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fac900c2060 con 0x7fac840039c0 2024-04-23T18:22:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.907+0000 7fac98c00640 1 -- 172.21.15.28:0/3306992038 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fac900bba70 con 0x7fac840039c0 2024-04-23T18:22:07.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.907+0000 7faca2200640 1 -- 172.21.15.28:0/3306992038 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac9c068cd0 con 0x7fac840039c0 2024-04-23T18:22:07.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.911+0000 7fac98c00640 1 -- 172.21.15.28:0/3306992038 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fac90017680 con 0x7fac840039c0 2024-04-23T18:22:07.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.975+0000 7faca2200640 1 -- 172.21.15.28:0/3306992038 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fac9c0c7dd0 con 0x7fac840039c0 2024-04-23T18:22:07.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.975+0000 7fac98c00640 1 -- 172.21.15.28:0/3306992038 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fac9000e5d0 con 0x7fac840039c0 2024-04-23T18:22:07.970 INFO:teuthology.orchestra.run.smithi028.stderr:adjusted tunables profile to default 2024-04-23T18:22:07.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.979+0000 7faca2200640 1 -- 172.21.15.28:0/3306992038 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 msgr2=0x7fac9c0c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:07.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.979+0000 7faca2200640 1 --2- 172.21.15.28:0/3306992038 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 0x7fac9c0c81b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fac9001d740 tx=0x7fac9001a710 comp rx=0 tx=0).stop 2024-04-23T18:22:07.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.979+0000 7faca2200640 1 -- 172.21.15.28:0/3306992038 shutdown_connections 2024-04-23T18:22:07.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.979+0000 7faca2200640 1 --2- 172.21.15.28:0/3306992038 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac840052f0 0x7fac9c14b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:07.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.979+0000 7faca2200640 1 --2- 172.21.15.28:0/3306992038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac84004810 0x7fac9c14afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:07.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.979+0000 7faca2200640 1 --2- 172.21.15.28:0/3306992038 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac840039c0 0x7fac9c0c81b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:07.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.979+0000 7faca2200640 1 -- 172.21.15.28:0/3306992038 >> 172.21.15.28:0/3306992038 conn(0x7fac9c0ce5e0 msgr2=0x7fac9c0702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:07.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.979+0000 7faca2200640 1 -- 172.21.15.28:0/3306992038 shutdown_connections 2024-04-23T18:22:07.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:07.979+0000 7faca2200640 1 -- 172.21.15.28:0/3306992038 wait complete. 2024-04-23T18:22:07.990 INFO:tasks.ceph:check_enable_crimson: False 2024-04-23T18:22:07.990 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-23T18:22:07.991 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:22:07.991 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-23T18:22:08.011 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:22:08.011 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-23T18:22:08.074 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:22:08.074 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-23T18:22:08.141 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:22:08.141 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-23T18:22:08.201 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:08.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-23T18:22:08.215 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:08.216 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-23T18:22:08.271 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:08.271 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-23T18:22:08.326 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-23T18:22:08.327 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-23T18:22:08.383 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 5c9f5ce8-6604-4da1-9495-97f7a03ee9c6 0 2024-04-23T18:22:08.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.553+0000 7f1b3fec4640 1 Processor -- start 2024-04-23T18:22:08.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.553+0000 7f1b3fec4640 1 -- start start 2024-04-23T18:22:08.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1b38152100 0x7f1b3815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:08.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1b380c9e50 0x7f1b3806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:08.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b380c8d50 0x7f1b38072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:08.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f1b38072840 con 0x7f1b38152100 2024-04-23T18:22:08.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1b3815b520 con 0x7f1b380c9e50 2024-04-23T18:22:08.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1b38071d40 con 0x7f1b380c8d50 2024-04-23T18:22:08.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3d45f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1b380c9e50 0x7f1b3806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:08.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3e461640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b380c8d50 0x7f1b38072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:08.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3d45f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1b380c9e50 0x7f1b3806ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34760/0 (socket says 172.21.15.137:34760) 2024-04-23T18:22:08.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3d45f640 1 -- 172.21.15.137:0/2118412922 learned_addr learned my addr 172.21.15.137:0/2118412922 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:08.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3dc60640 1 --2- 172.21.15.137:0/2118412922 >> v2:172.21.15.28:3300/0 conn(0x7f1b38152100 0x7f1b3815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:08.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3e461640 1 -- 172.21.15.137:0/2118412922 >> v2:172.21.15.137:3300/0 conn(0x7f1b380c9e50 msgr2=0x7f1b3806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:08.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3e461640 1 --2- 172.21.15.137:0/2118412922 >> v2:172.21.15.137:3300/0 conn(0x7f1b380c9e50 0x7f1b3806ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3e461640 1 -- 172.21.15.137:0/2118412922 >> v2:172.21.15.28:3300/0 conn(0x7f1b38152100 msgr2=0x7f1b3815bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:08.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3e461640 1 --2- 172.21.15.137:0/2118412922 >> v2:172.21.15.28:3300/0 conn(0x7f1b38152100 0x7f1b3815bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3e461640 1 -- 172.21.15.137:0/2118412922 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b38072020 con 0x7f1b380c8d50 2024-04-23T18:22:08.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3d45f640 1 --2- 172.21.15.137:0/2118412922 >> v2:172.21.15.137:3300/0 conn(0x7f1b380c9e50 0x7f1b3806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:08.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3e461640 1 --2- 172.21.15.137:0/2118412922 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b380c8d50 0x7f1b38072300 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1b380c3de0 tx=0x7f1b3001f110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba8b592cbaec9a8c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:08.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3cc5e640 1 -- 172.21.15.137:0/2118412922 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b300b5070 con 0x7f1b380c8d50 2024-04-23T18:22:08.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3cc5e640 1 -- 172.21.15.137:0/2118412922 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b300b0440 con 0x7f1b380c8d50 2024-04-23T18:22:08.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3cc5e640 1 -- 172.21.15.137:0/2118412922 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b300b0810 con 0x7f1b380c8d50 2024-04-23T18:22:08.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2118412922 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b380c8d50 msgr2=0x7f1b38072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:08.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 --2- 172.21.15.137:0/2118412922 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b380c8d50 0x7f1b38072300 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1b380c3de0 tx=0x7f1b3001f110 comp rx=0 tx=0).stop 2024-04-23T18:22:08.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2118412922 shutdown_connections 2024-04-23T18:22:08.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 --2- 172.21.15.137:0/2118412922 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b380c8d50 0x7f1b38072300 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 --2- 172.21.15.137:0/2118412922 >> v2:172.21.15.137:3300/0 conn(0x7f1b380c9e50 0x7f1b3806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 --2- 172.21.15.137:0/2118412922 >> v2:172.21.15.28:3300/0 conn(0x7f1b38152100 0x7f1b3815bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2118412922 >> 172.21.15.137:0/2118412922 conn(0x7f1b380c9330 msgr2=0x7f1b380c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2118412922 shutdown_connections 2024-04-23T18:22:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.557+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2118412922 wait complete. 2024-04-23T18:22:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3fec4640 1 Processor -- start 2024-04-23T18:22:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3fec4640 1 -- start start 2024-04-23T18:22:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3fec4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b380c8d50 0x7f1b38156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3fec4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b380c9e50 0x7f1b38152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3fec4640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b38152100 0x7f1b38155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3fec4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38152660 con 0x7f1b380c8d50 2024-04-23T18:22:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3fec4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b381524e0 con 0x7f1b380c9e50 2024-04-23T18:22:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3fec4640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1b38070e40 con 0x7f1b38152100 2024-04-23T18:22:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3d45f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b380c9e50 0x7f1b38152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3e461640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b38152100 0x7f1b38155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3d45f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b380c9e50 0x7f1b38152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34764/0 (socket says 172.21.15.137:34764) 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3d45f640 1 -- 172.21.15.137:0/2487372862 learned_addr learned my addr 172.21.15.137:0/2487372862 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3dc60640 1 --2- 172.21.15.137:0/2487372862 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b380c8d50 0x7f1b38156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3d45f640 1 -- 172.21.15.137:0/2487372862 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b38152100 msgr2=0x7f1b38155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3d45f640 1 --2- 172.21.15.137:0/2487372862 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b38152100 0x7f1b38155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3d45f640 1 -- 172.21.15.137:0/2487372862 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b380c8d50 msgr2=0x7f1b38156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3d45f640 1 --2- 172.21.15.137:0/2487372862 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b380c8d50 0x7f1b38156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3d45f640 1 -- 172.21.15.137:0/2487372862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b381540b0 con 0x7f1b380c9e50 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3e461640 1 --2- 172.21.15.137:0/2487372862 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b38152100 0x7f1b38155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3dc60640 1 --2- 172.21.15.137:0/2487372862 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b380c8d50 0x7f1b38156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3d45f640 1 --2- 172.21.15.137:0/2487372862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b380c9e50 0x7f1b38152cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009fd0 tx=0x7f1b3400ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b2e7fc640 1 -- 172.21.15.137:0/2487372862 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400ca00 con 0x7f1b380c9e50 2024-04-23T18:22:08.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b2e7fc640 1 -- 172.21.15.137:0/2487372862 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3400cba0 con 0x7f1b380c9e50 2024-04-23T18:22:08.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2487372862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b38155e30 con 0x7f1b380c9e50 2024-04-23T18:22:08.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b2e7fc640 1 -- 172.21.15.137:0/2487372862 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34004030 con 0x7f1b380c9e50 2024-04-23T18:22:08.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2487372862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b38154350 con 0x7f1b380c9e50 2024-04-23T18:22:08.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b2e7fc640 1 -- 172.21.15.137:0/2487372862 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b34003620 con 0x7f1b380c9e50 2024-04-23T18:22:08.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b2e7fc640 1 -- 172.21.15.137:0/2487372862 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1b34013bb0 con 0x7f1b380c9e50 2024-04-23T18:22:08.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.561+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2487372862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b38068db0 con 0x7f1b380c9e50 2024-04-23T18:22:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.581+0000 7f1b2e7fc640 1 -- 172.21.15.137:0/2487372862 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1b34017020 con 0x7f1b380c9e50 2024-04-23T18:22:08.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.653+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2487372862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5c9f5ce8-6604-4da1-9495-97f7a03ee9c6", "id": 0} v 0) -- 0x7f1b380c7030 con 0x7f1b380c9e50 2024-04-23T18:22:08.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.657+0000 7f1b2e7fc640 1 -- 172.21.15.137:0/2487372862 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5c9f5ce8-6604-4da1-9495-97f7a03ee9c6", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1b34013db0 con 0x7f1b380c9e50 2024-04-23T18:22:08.651 INFO:teuthology.orchestra.run.smithi137.stdout:0 2024-04-23T18:22:08.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.657+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2487372862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b380c9e50 msgr2=0x7f1b38152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:08.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.657+0000 7f1b3fec4640 1 --2- 172.21.15.137:0/2487372862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b380c9e50 0x7f1b38152cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009fd0 tx=0x7f1b3400ee10 comp rx=0 tx=0).stop 2024-04-23T18:22:08.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.657+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2487372862 shutdown_connections 2024-04-23T18:22:08.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.657+0000 7f1b3fec4640 1 --2- 172.21.15.137:0/2487372862 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1b38152100 0x7f1b38155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.657+0000 7f1b3fec4640 1 --2- 172.21.15.137:0/2487372862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b380c9e50 0x7f1b38152cf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.657+0000 7f1b3fec4640 1 --2- 172.21.15.137:0/2487372862 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b380c8d50 0x7f1b38156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.657+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2487372862 >> 172.21.15.137:0/2487372862 conn(0x7f1b380c9330 msgr2=0x7f1b380c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:08.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.657+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2487372862 shutdown_connections 2024-04-23T18:22:08.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.657+0000 7f1b3fec4640 1 -- 172.21.15.137:0/2487372862 wait complete. 2024-04-23T18:22:08.669 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 9d312ff9-1642-4ef5-b6d7-84253976620b 1 2024-04-23T18:22:08.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.789+0000 7f8c58861640 1 Processor -- start 2024-04-23T18:22:08.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.789+0000 7f8c58861640 1 -- start start 2024-04-23T18:22:08.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.789+0000 7f8c58861640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54152f40 0x7f8c540c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:08.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.789+0000 7f8c58861640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8c54153320 0x7f8c54073a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:08.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.789+0000 7f8c58861640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c540c8dc0 con 0x7f8c5415c440 2024-04-23T18:22:08.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.789+0000 7f8c58861640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8c540c80b0 con 0x7f8c54153320 2024-04-23T18:22:08.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.789+0000 7f8c58861640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8c540c6680 con 0x7f8c54152f40 2024-04-23T18:22:08.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.789+0000 7f8c5259c640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54152f40 0x7f8c540c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:08.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.789+0000 7f8c4bfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8c54153320 0x7f8c54073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:08.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.789+0000 7f8c5259c640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54152f40 0x7f8c540c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:43360/0 (socket says 172.21.15.137:43360) 2024-04-23T18:22:08.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.789+0000 7f8c5259c640 1 -- 172.21.15.137:0/2431677598 learned_addr learned my addr 172.21.15.137:0/2431677598 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:08.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c5259c640 1 -- 172.21.15.137:0/2431677598 >> v2:172.21.15.137:3300/0 conn(0x7f8c54153320 msgr2=0x7f8c54073a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:08.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c5259c640 1 --2- 172.21.15.137:0/2431677598 >> v2:172.21.15.137:3300/0 conn(0x7f8c54153320 0x7f8c54073a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c5259c640 1 -- 172.21.15.137:0/2431677598 >> v1:172.21.15.28:6789/0 conn(0x7f8c5415c440 legacy=0x7f8c540c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:08.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c5259c640 1 -- 172.21.15.137:0/2431677598 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c540c6960 con 0x7f8c54152f40 2024-04-23T18:22:08.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c5259c640 1 --2- 172.21.15.137:0/2431677598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54152f40 0x7f8c540c5df0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009870 tx=0x7f8c4401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=649c0f5470f65b5f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:08.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c51d9b640 1 -- 172.21.15.137:0/2431677598 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c440b2070 con 0x7f8c54152f40 2024-04-23T18:22:08.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c51d9b640 1 -- 172.21.15.137:0/2431677598 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c440a9070 con 0x7f8c54152f40 2024-04-23T18:22:08.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c51d9b640 1 -- 172.21.15.137:0/2431677598 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c440ad880 con 0x7f8c54152f40 2024-04-23T18:22:08.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c58861640 1 -- 172.21.15.137:0/2431677598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54152f40 msgr2=0x7f8c540c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:08.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c58861640 1 --2- 172.21.15.137:0/2431677598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54152f40 0x7f8c540c5df0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009870 tx=0x7f8c4401c560 comp rx=0 tx=0).stop 2024-04-23T18:22:08.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c58861640 1 -- 172.21.15.137:0/2431677598 shutdown_connections 2024-04-23T18:22:08.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c58861640 1 --2- 172.21.15.137:0/2431677598 >> v2:172.21.15.137:3300/0 conn(0x7f8c54153320 0x7f8c54073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c58861640 1 --2- 172.21.15.137:0/2431677598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54152f40 0x7f8c540c5df0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c58861640 1 -- 172.21.15.137:0/2431677598 >> 172.21.15.137:0/2431677598 conn(0x7f8c540ce8f0 msgr2=0x7f8c540ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:08.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c58861640 1 -- 172.21.15.137:0/2431677598 shutdown_connections 2024-04-23T18:22:08.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.793+0000 7f8c58861640 1 -- 172.21.15.137:0/2431677598 wait complete. 2024-04-23T18:22:08.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c58861640 1 Processor -- start 2024-04-23T18:22:08.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c58861640 1 -- start start 2024-04-23T18:22:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c58861640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c54152f40 0x7f8c54146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c58861640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54153320 0x7f8c540c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c58861640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c5415c440 0x7f8c541f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c58861640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c54073f50 con 0x7f8c54152f40 2024-04-23T18:22:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c58861640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c540c6330 con 0x7f8c5415c440 2024-04-23T18:22:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c58861640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8c540c9a00 con 0x7f8c54153320 2024-04-23T18:22:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c4bfff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54153320 0x7f8c540c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c4bfff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54153320 0x7f8c540c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:43370/0 (socket says 172.21.15.137:43370) 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c4bfff640 1 -- 172.21.15.137:0/859044672 learned_addr learned my addr 172.21.15.137:0/859044672 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c52d9d640 1 --2- 172.21.15.137:0/859044672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c5415c440 0x7f8c541f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c5259c640 1 --2- 172.21.15.137:0/859044672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c54152f40 0x7f8c54146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c52d9d640 1 -- 172.21.15.137:0/859044672 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54153320 msgr2=0x7f8c540c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c52d9d640 1 --2- 172.21.15.137:0/859044672 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54153320 0x7f8c540c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c52d9d640 1 -- 172.21.15.137:0/859044672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c54152f40 msgr2=0x7f8c54146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c52d9d640 1 --2- 172.21.15.137:0/859044672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c54152f40 0x7f8c54146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c52d9d640 1 -- 172.21.15.137:0/859044672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c541f5e80 con 0x7f8c5415c440 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c4bfff640 1 --2- 172.21.15.137:0/859044672 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54153320 0x7f8c540c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c5259c640 1 --2- 172.21.15.137:0/859044672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c54152f40 0x7f8c54146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c52d9d640 1 --2- 172.21.15.137:0/859044672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c5415c440 0x7f8c541f55b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00c760 tx=0x7f8c4c00cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c4affd640 1 -- 172.21.15.137:0/859044672 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c003b80 con 0x7f8c5415c440 2024-04-23T18:22:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c4affd640 1 -- 172.21.15.137:0/859044672 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4c003d20 con 0x7f8c5415c440 2024-04-23T18:22:08.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c58861640 1 -- 172.21.15.137:0/859044672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c541f6160 con 0x7f8c5415c440 2024-04-23T18:22:08.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c4affd640 1 -- 172.21.15.137:0/859044672 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c00aa30 con 0x7f8c5415c440 2024-04-23T18:22:08.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.797+0000 7f8c58861640 1 -- 172.21.15.137:0/859044672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c54146500 con 0x7f8c5415c440 2024-04-23T18:22:08.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.801+0000 7f8c4affd640 1 -- 172.21.15.137:0/859044672 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8c4c00abd0 con 0x7f8c5415c440 2024-04-23T18:22:08.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.801+0000 7f8c58861640 1 -- 172.21.15.137:0/859044672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c54074290 con 0x7f8c5415c440 2024-04-23T18:22:08.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.801+0000 7f8c4affd640 1 -- 172.21.15.137:0/859044672 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8c4c0050d0 con 0x7f8c5415c440 2024-04-23T18:22:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.801+0000 7f8c4affd640 1 -- 172.21.15.137:0/859044672 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8c4c020020 con 0x7f8c5415c440 2024-04-23T18:22:08.814 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:08.817+0000 7f13f19d1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T18:22:08.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.881+0000 7f8c58861640 1 -- 172.21.15.137:0/859044672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d312ff9-1642-4ef5-b6d7-84253976620b", "id": 1} v 0) -- 0x7f8c54156870 con 0x7f8c5415c440 2024-04-23T18:22:08.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.885+0000 7f8c4affd640 1 -- 172.21.15.137:0/859044672 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d312ff9-1642-4ef5-b6d7-84253976620b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8c4c0052d0 con 0x7f8c5415c440 2024-04-23T18:22:08.881 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-23T18:22:08.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.885+0000 7f8c58861640 1 -- 172.21.15.137:0/859044672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c5415c440 msgr2=0x7f8c541f55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:08.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.885+0000 7f8c58861640 1 --2- 172.21.15.137:0/859044672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c5415c440 0x7f8c541f55b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00c760 tx=0x7f8c4c00cc20 comp rx=0 tx=0).stop 2024-04-23T18:22:08.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.885+0000 7f8c58861640 1 -- 172.21.15.137:0/859044672 shutdown_connections 2024-04-23T18:22:08.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.885+0000 7f8c58861640 1 --2- 172.21.15.137:0/859044672 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8c54153320 0x7f8c540c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.885+0000 7f8c58861640 1 --2- 172.21.15.137:0/859044672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c5415c440 0x7f8c541f55b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.885+0000 7f8c58861640 1 --2- 172.21.15.137:0/859044672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c54152f40 0x7f8c54146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:08.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.885+0000 7f8c58861640 1 -- 172.21.15.137:0/859044672 >> 172.21.15.137:0/859044672 conn(0x7f8c540ce8f0 msgr2=0x7f8c5406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:08.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.885+0000 7f8c58861640 1 -- 172.21.15.137:0/859044672 shutdown_connections 2024-04-23T18:22:08.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:08.885+0000 7f8c58861640 1 -- 172.21.15.137:0/859044672 wait complete. 2024-04-23T18:22:08.901 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246 2 2024-04-23T18:22:08.980 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:08.987+0000 7fe366708180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T18:22:09.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da3aec640 1 Processor -- start 2024-04-23T18:22:09.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da3aec640 1 -- start start 2024-04-23T18:22:09.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da3aec640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d9c153170 0x7f6d9c15a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da3aec640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c0b2da0 0x7f6d9c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da3aec640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d9c0c7bf0 con 0x7f6d9c153550 2024-04-23T18:22:09.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da3aec640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6d9c0c2280 con 0x7f6d9c153170 2024-04-23T18:22:09.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da3aec640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6d9c0c2560 con 0x7f6d9c0b2da0 2024-04-23T18:22:09.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da1087640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c0b2da0 0x7f6d9c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da1888640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d9c153170 0x7f6d9c15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da1087640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c0b2da0 0x7f6d9c159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:43384/0 (socket says 172.21.15.137:43384) 2024-04-23T18:22:09.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da1888640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d9c153170 0x7f6d9c15a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34808/0 (socket says 172.21.15.137:34808) 2024-04-23T18:22:09.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.021+0000 7f6da1087640 1 -- 172.21.15.137:0/623328011 learned_addr learned my addr 172.21.15.137:0/623328011 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:09.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da1087640 1 -- 172.21.15.137:0/623328011 >> v2:172.21.15.137:3300/0 conn(0x7f6d9c153170 msgr2=0x7f6d9c15a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:09.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da1087640 1 --2- 172.21.15.137:0/623328011 >> v2:172.21.15.137:3300/0 conn(0x7f6d9c153170 0x7f6d9c15a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da1087640 1 -- 172.21.15.137:0/623328011 >> v1:172.21.15.28:6789/0 conn(0x7f6d9c153550 legacy=0x7f6d9c0c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da1087640 1 -- 172.21.15.137:0/623328011 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9c0c2840 con 0x7f6d9c0b2da0 2024-04-23T18:22:09.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da1888640 1 --2- 172.21.15.137:0/623328011 >> v2:172.21.15.137:3300/0 conn(0x7f6d9c153170 0x7f6d9c15a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:09.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da1087640 1 --2- 172.21.15.137:0/623328011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c0b2da0 0x7f6d9c159b10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009870 tx=0x7f6d8c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4a0986c446e0946 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:09.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da0886640 1 -- 172.21.15.137:0/623328011 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0b5070 con 0x7f6d9c0b2da0 2024-04-23T18:22:09.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da0886640 1 -- 172.21.15.137:0/623328011 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d8c0a8a50 con 0x7f6d9c0b2da0 2024-04-23T18:22:09.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da0886640 1 -- 172.21.15.137:0/623328011 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0a8e20 con 0x7f6d9c0b2da0 2024-04-23T18:22:09.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da3aec640 1 -- 172.21.15.137:0/623328011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c0b2da0 msgr2=0x7f6d9c159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da3aec640 1 --2- 172.21.15.137:0/623328011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c0b2da0 0x7f6d9c159b10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009870 tx=0x7f6d8c01ed50 comp rx=0 tx=0).stop 2024-04-23T18:22:09.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da3aec640 1 -- 172.21.15.137:0/623328011 shutdown_connections 2024-04-23T18:22:09.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da3aec640 1 --2- 172.21.15.137:0/623328011 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c0b2da0 0x7f6d9c159b10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da3aec640 1 --2- 172.21.15.137:0/623328011 >> v2:172.21.15.137:3300/0 conn(0x7f6d9c153170 0x7f6d9c15a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da3aec640 1 -- 172.21.15.137:0/623328011 >> 172.21.15.137:0/623328011 conn(0x7f6d9c075eb0 msgr2=0x7f6d9c0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:09.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da3aec640 1 -- 172.21.15.137:0/623328011 shutdown_connections 2024-04-23T18:22:09.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.025+0000 7f6da3aec640 1 -- 172.21.15.137:0/623328011 wait complete. 2024-04-23T18:22:09.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da3aec640 1 Processor -- start 2024-04-23T18:22:09.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da3aec640 1 -- start start 2024-04-23T18:22:09.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da3aec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d9c0b2da0 0x7f6d9c154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da3aec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d9c153170 0x7f6d9c1467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da3aec640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c153550 0x7f6d9c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da3aec640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c159000 con 0x7f6d9c0b2da0 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da3aec640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c1595f0 con 0x7f6d9c153170 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da3aec640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6d9c0c1e40 con 0x7f6d9c153550 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da1087640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d9c153170 0x7f6d9c1467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da1087640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d9c153170 0x7f6d9c1467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34822/0 (socket says 172.21.15.137:34822) 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da1087640 1 -- 172.21.15.137:0/2830444127 learned_addr learned my addr 172.21.15.137:0/2830444127 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da2089640 1 --2- 172.21.15.137:0/2830444127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c153550 0x7f6d9c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da1888640 1 --2- 172.21.15.137:0/2830444127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d9c0b2da0 0x7f6d9c154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da1087640 1 -- 172.21.15.137:0/2830444127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c153550 msgr2=0x7f6d9c150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da1087640 1 --2- 172.21.15.137:0/2830444127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c153550 0x7f6d9c150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da1087640 1 -- 172.21.15.137:0/2830444127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d9c0b2da0 msgr2=0x7f6d9c154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da1087640 1 --2- 172.21.15.137:0/2830444127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d9c0b2da0 0x7f6d9c154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da1087640 1 -- 172.21.15.137:0/2830444127 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9c150770 con 0x7f6d9c153170 2024-04-23T18:22:09.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da1087640 1 --2- 172.21.15.137:0/2830444127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d9c153170 0x7f6d9c1467b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0b3040 tx=0x7f6d8c01baf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:09.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6d927fc640 1 -- 172.21.15.137:0/2830444127 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0b5070 con 0x7f6d9c153170 2024-04-23T18:22:09.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6d927fc640 1 -- 172.21.15.137:0/2830444127 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d8c0b0de0 con 0x7f6d9c153170 2024-04-23T18:22:09.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6d927fc640 1 -- 172.21.15.137:0/2830444127 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0bb670 con 0x7f6d9c153170 2024-04-23T18:22:09.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da3aec640 1 -- 172.21.15.137:0/2830444127 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9c146cf0 con 0x7f6d9c153170 2024-04-23T18:22:09.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da3aec640 1 -- 172.21.15.137:0/2830444127 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d9c1eec80 con 0x7f6d9c153170 2024-04-23T18:22:09.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6d927fc640 1 -- 172.21.15.137:0/2830444127 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6d8c0c2060 con 0x7f6d9c153170 2024-04-23T18:22:09.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6d927fc640 1 -- 172.21.15.137:0/2830444127 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f6d8c0ba7e0 con 0x7f6d9c153170 2024-04-23T18:22:09.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.029+0000 7f6da3aec640 1 -- 172.21.15.137:0/2830444127 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d9c150940 con 0x7f6d9c153170 2024-04-23T18:22:09.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.033+0000 7f6d927fc640 1 -- 172.21.15.137:0/2830444127 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6d8c0188b0 con 0x7f6d9c153170 2024-04-23T18:22:09.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.097+0000 7f6da3aec640 1 -- 172.21.15.137:0/2830444127 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246", "id": 2} v 0) -- 0x7f6d9c074290 con 0x7f6d9c153170 2024-04-23T18:22:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.101+0000 7f6d927fc640 1 -- 172.21.15.137:0/2830444127 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f6d8c0c4400 con 0x7f6d9c153170 2024-04-23T18:22:09.098 INFO:teuthology.orchestra.run.smithi137.stdout:2 2024-04-23T18:22:09.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.105+0000 7f6da3aec640 1 -- 172.21.15.137:0/2830444127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d9c153170 msgr2=0x7f6d9c1467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.105+0000 7f6da3aec640 1 --2- 172.21.15.137:0/2830444127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d9c153170 0x7f6d9c1467b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0b3040 tx=0x7f6d8c01baf0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.105+0000 7f6da3aec640 1 -- 172.21.15.137:0/2830444127 shutdown_connections 2024-04-23T18:22:09.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.105+0000 7f6da3aec640 1 --2- 172.21.15.137:0/2830444127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6d9c153550 0x7f6d9c150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.105+0000 7f6da3aec640 1 --2- 172.21.15.137:0/2830444127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d9c153170 0x7f6d9c1467b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.105+0000 7f6da3aec640 1 --2- 172.21.15.137:0/2830444127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6d9c0b2da0 0x7f6d9c154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.105+0000 7f6da3aec640 1 -- 172.21.15.137:0/2830444127 >> 172.21.15.137:0/2830444127 conn(0x7f6d9c075eb0 msgr2=0x7f6d9c0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:09.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.105+0000 7f6da3aec640 1 -- 172.21.15.137:0/2830444127 shutdown_connections 2024-04-23T18:22:09.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.105+0000 7f6da3aec640 1 -- 172.21.15.137:0/2830444127 wait complete. 2024-04-23T18:22:09.114 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 3ee92e5b-66ce-4e58-b4a6-110de2f8bbda 3 2024-04-23T18:22:09.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.225+0000 7f0b6d818640 1 Processor -- start 2024-04-23T18:22:09.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.225+0000 7f0b6d818640 1 -- start start 2024-04-23T18:22:09.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b6d818640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0b680c7780 0x7f0b6815bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b6d818640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0b68143b20 0x7f0b68143f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b6d818640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b68072000 con 0x7f0b680c9450 2024-04-23T18:22:09.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b6d818640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f0b6815c250 con 0x7f0b680c7780 2024-04-23T18:22:09.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b6d818640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0b680722a0 con 0x7f0b68143b20 2024-04-23T18:22:09.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b677fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0b68143b20 0x7f0b68143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b677fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0b68143b20 0x7f0b68143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34836/0 (socket says 172.21.15.137:34836) 2024-04-23T18:22:09.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b677fe640 1 -- 172.21.15.137:0/1188236349 learned_addr learned my addr 172.21.15.137:0/1188236349 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:09.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b677fe640 1 -- 172.21.15.137:0/1188236349 >> v2:172.21.15.28:3300/0 conn(0x7f0b680c7780 msgr2=0x7f0b6815bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:09.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b677fe640 1 --2- 172.21.15.137:0/1188236349 >> v2:172.21.15.28:3300/0 conn(0x7f0b680c7780 0x7f0b6815bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b677fe640 1 -- 172.21.15.137:0/1188236349 >> v1:172.21.15.28:6789/0 conn(0x7f0b680c9450 legacy=0x7f0b680c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:09.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b677fe640 1 -- 172.21.15.137:0/1188236349 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b68072580 con 0x7f0b68143b20 2024-04-23T18:22:09.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b677fe640 1 --2- 172.21.15.137:0/1188236349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b68143b20 0x7f0b68143f00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b68071b20 tx=0x7f0b6001c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f92b4e472f9fc0f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:09.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b65ffb640 1 -- 172.21.15.137:0/1188236349 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b600a57d0 con 0x7f0b68143b20 2024-04-23T18:22:09.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b65ffb640 1 -- 172.21.15.137:0/1188236349 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b600a5970 con 0x7f0b68143b20 2024-04-23T18:22:09.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.229+0000 7f0b65ffb640 1 -- 172.21.15.137:0/1188236349 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b600a5d40 con 0x7f0b68143b20 2024-04-23T18:22:09.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- 172.21.15.137:0/1188236349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b68143b20 msgr2=0x7f0b68143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 --2- 172.21.15.137:0/1188236349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b68143b20 0x7f0b68143f00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b68071b20 tx=0x7f0b6001c8f0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- 172.21.15.137:0/1188236349 shutdown_connections 2024-04-23T18:22:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 --2- 172.21.15.137:0/1188236349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b68143b20 0x7f0b68143f00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 --2- 172.21.15.137:0/1188236349 >> v2:172.21.15.28:3300/0 conn(0x7f0b680c7780 0x7f0b6815bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- 172.21.15.137:0/1188236349 >> 172.21.15.137:0/1188236349 conn(0x7f0b680ca2d0 msgr2=0x7f0b680ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- 172.21.15.137:0/1188236349 shutdown_connections 2024-04-23T18:22:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- 172.21.15.137:0/1188236349 wait complete. 2024-04-23T18:22:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 Processor -- start 2024-04-23T18:22:09.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- start start 2024-04-23T18:22:09.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b680c7780 0x7f0b6813f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b680c9450 0x7f0b68138e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b68143b20 0x7f0b681393b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6806ea80 con 0x7f0b680c9450 2024-04-23T18:22:09.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b68072e20 con 0x7f0b68143b20 2024-04-23T18:22:09.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0b680c7b60 con 0x7f0b680c7780 2024-04-23T18:22:09.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b66ffd640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b680c7780 0x7f0b6813f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b68143b20 0x7f0b681393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b68143b20 0x7f0b681393b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34842/0 (socket says 172.21.15.137:34842) 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b677fe640 1 -- 172.21.15.137:0/87526487 learned_addr learned my addr 172.21.15.137:0/87526487 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b66ffd640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b680c7780 0x7f0b6813f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:43404/0 (socket says 172.21.15.137:43404) 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b667fc640 1 --2- 172.21.15.137:0/87526487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b680c9450 0x7f0b68138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b66ffd640 1 -- 172.21.15.137:0/87526487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b68143b20 msgr2=0x7f0b681393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b66ffd640 1 --2- 172.21.15.137:0/87526487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b68143b20 0x7f0b681393b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b66ffd640 1 -- 172.21.15.137:0/87526487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b680c9450 msgr2=0x7f0b68138e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b66ffd640 1 --2- 172.21.15.137:0/87526487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b680c9450 0x7f0b68138e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b66ffd640 1 -- 172.21.15.137:0/87526487 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b680cd560 con 0x7f0b680c7780 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b677fe640 1 --2- 172.21.15.137:0/87526487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b68143b20 0x7f0b681393b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b667fc640 1 --2- 172.21.15.137:0/87526487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b680c9450 0x7f0b68138e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b66ffd640 1 --2- 172.21.15.137:0/87526487 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b680c7780 0x7f0b6813f770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00b410 tx=0x7f0b5c00b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b4ffff640 1 -- 172.21.15.137:0/87526487 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c015020 con 0x7f0b680c7780 2024-04-23T18:22:09.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b4ffff640 1 -- 172.21.15.137:0/87526487 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5c011830 con 0x7f0b680c7780 2024-04-23T18:22:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- 172.21.15.137:0/87526487 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b681f4ed0 con 0x7f0b680c7780 2024-04-23T18:22:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b4ffff640 1 -- 172.21.15.137:0/87526487 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c011c20 con 0x7f0b680c7780 2024-04-23T18:22:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- 172.21.15.137:0/87526487 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b680c5440 con 0x7f0b680c7780 2024-04-23T18:22:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b4ffff640 1 -- 172.21.15.137:0/87526487 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0b5c018020 con 0x7f0b680c7780 2024-04-23T18:22:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b4ffff640 1 -- 172.21.15.137:0/87526487 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0b5c019b60 con 0x7f0b680c7780 2024-04-23T18:22:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.233+0000 7f0b6d818640 1 -- 172.21.15.137:0/87526487 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b680c4ef0 con 0x7f0b680c7780 2024-04-23T18:22:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.237+0000 7f0b4ffff640 1 -- 172.21.15.137:0/87526487 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0b5c01f020 con 0x7f0b680c7780 2024-04-23T18:22:09.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.301+0000 7f0b6d818640 1 -- 172.21.15.137:0/87526487 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3ee92e5b-66ce-4e58-b4a6-110de2f8bbda", "id": 3} v 0) -- 0x7f0b68074290 con 0x7f0b680c7780 2024-04-23T18:22:09.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.305+0000 7f0b4ffff640 1 -- 172.21.15.137:0/87526487 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ee92e5b-66ce-4e58-b4a6-110de2f8bbda", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0b5c019db0 con 0x7f0b680c7780 2024-04-23T18:22:09.301 INFO:teuthology.orchestra.run.smithi137.stdout:3 2024-04-23T18:22:09.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.305+0000 7f0b6d818640 1 -- 172.21.15.137:0/87526487 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b680c7780 msgr2=0x7f0b6813f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.305+0000 7f0b6d818640 1 --2- 172.21.15.137:0/87526487 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b680c7780 0x7f0b6813f770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00b410 tx=0x7f0b5c00b810 comp rx=0 tx=0).stop 2024-04-23T18:22:09.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.305+0000 7f0b6d818640 1 -- 172.21.15.137:0/87526487 shutdown_connections 2024-04-23T18:22:09.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.305+0000 7f0b6d818640 1 --2- 172.21.15.137:0/87526487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b68143b20 0x7f0b681393b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.305+0000 7f0b6d818640 1 --2- 172.21.15.137:0/87526487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b680c9450 0x7f0b68138e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.305+0000 7f0b6d818640 1 --2- 172.21.15.137:0/87526487 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b680c7780 0x7f0b6813f770 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.305+0000 7f0b6d818640 1 -- 172.21.15.137:0/87526487 >> 172.21.15.137:0/87526487 conn(0x7f0b680ca2d0 msgr2=0x7f0b68159c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:09.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.305+0000 7f0b6d818640 1 -- 172.21.15.137:0/87526487 shutdown_connections 2024-04-23T18:22:09.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.305+0000 7f0b6d818640 1 -- 172.21.15.137:0/87526487 wait complete. 2024-04-23T18:22:09.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new f495a288-0985-466d-8737-f306ddfe04b1 4 2024-04-23T18:22:09.322 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:09.325+0000 7f13f19d1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T18:22:09.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f40633cd640 1 Processor -- start 2024-04-23T18:22:09.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f40633cd640 1 -- start start 2024-04-23T18:22:09.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f40633cd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f405c153320 0x7f405c073a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f40633cd640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c15c440 0x7f405c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f40633cd640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405c0c8dc0 con 0x7f405c152f40 2024-04-23T18:22:09.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f40633cd640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f405c0c80b0 con 0x7f405c153320 2024-04-23T18:22:09.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f40633cd640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f405c0c6680 con 0x7f405c15c440 2024-04-23T18:22:09.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f4061169640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f405c152f40 0x7f405c0c5df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42470/0 (socket says 172.21.15.137:42470) 2024-04-23T18:22:09.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f4061169640 1 -- 172.21.15.137:0/4067884955 learned_addr learned my addr 172.21.15.137:0/4067884955 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-23T18:22:09.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f406196a640 1 --2- 172.21.15.137:0/4067884955 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c15c440 0x7f405c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f4060968640 1 --2- 172.21.15.137:0/4067884955 >> v2:172.21.15.28:3300/0 conn(0x7f405c153320 0x7f405c073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f4053fff640 1 -- 172.21.15.137:0/4067884955 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741918585 0 0) 0x7f405c0c8dc0 con 0x7f405c152f40 2024-04-23T18:22:09.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f406196a640 1 -- 172.21.15.137:0/4067884955 >> v2:172.21.15.28:3300/0 conn(0x7f405c153320 msgr2=0x7f405c073a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:09.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f406196a640 1 --2- 172.21.15.137:0/4067884955 >> v2:172.21.15.28:3300/0 conn(0x7f405c153320 0x7f405c073a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f406196a640 1 -- 172.21.15.137:0/4067884955 >> v1:172.21.15.137:6789/0 conn(0x7f405c152f40 legacy=0x7f405c0c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.425+0000 7f406196a640 1 -- 172.21.15.137:0/4067884955 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c0c6960 con 0x7f405c15c440 2024-04-23T18:22:09.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f406196a640 1 --2- 172.21.15.137:0/4067884955 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c15c440 0x7f405c15c850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4054009d90 tx=0x7f405401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d5a11a3531085fe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:09.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f4053fff640 1 -- 172.21.15.137:0/4067884955 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40540b2070 con 0x7f405c15c440 2024-04-23T18:22:09.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f4053fff640 1 -- 172.21.15.137:0/4067884955 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40540a5920 con 0x7f405c15c440 2024-04-23T18:22:09.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f4053fff640 1 -- 172.21.15.137:0/4067884955 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40540a5cf0 con 0x7f405c15c440 2024-04-23T18:22:09.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 -- 172.21.15.137:0/4067884955 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c15c440 msgr2=0x7f405c15c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 --2- 172.21.15.137:0/4067884955 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c15c440 0x7f405c15c850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4054009d90 tx=0x7f405401c970 comp rx=0 tx=0).stop 2024-04-23T18:22:09.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 -- 172.21.15.137:0/4067884955 shutdown_connections 2024-04-23T18:22:09.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 --2- 172.21.15.137:0/4067884955 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c15c440 0x7f405c15c850 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 --2- 172.21.15.137:0/4067884955 >> v2:172.21.15.28:3300/0 conn(0x7f405c153320 0x7f405c073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 -- 172.21.15.137:0/4067884955 >> 172.21.15.137:0/4067884955 conn(0x7f405c0ce8f0 msgr2=0x7f405c0ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:09.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 -- 172.21.15.137:0/4067884955 shutdown_connections 2024-04-23T18:22:09.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 -- 172.21.15.137:0/4067884955 wait complete. 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 Processor -- start 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 -- start start 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f405c152f40 0x7f405c0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c153320 0x7f405c1f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f405c15c440 0x7f405c1f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f405c1657e0 con 0x7f405c152f40 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f405c073f50 con 0x7f405c15c440 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.429+0000 7f40633cd640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f405c165960 con 0x7f405c153320 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f406196a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f405c15c440 0x7f405c1f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f4060968640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c153320 0x7f405c1f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f4060968640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c153320 0x7f405c1f44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:43420/0 (socket says 172.21.15.137:43420) 2024-04-23T18:22:09.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f4060968640 1 -- 172.21.15.137:0/2842706585 learned_addr learned my addr 172.21.15.137:0/2842706585 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:09.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f4061169640 1 --2- 172.21.15.137:0/2842706585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f405c152f40 0x7f405c0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f406196a640 1 -- 172.21.15.137:0/2842706585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c153320 msgr2=0x7f405c1f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f406196a640 1 --2- 172.21.15.137:0/2842706585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c153320 0x7f405c1f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f406196a640 1 -- 172.21.15.137:0/2842706585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f405c152f40 msgr2=0x7f405c0cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f406196a640 1 --2- 172.21.15.137:0/2842706585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f405c152f40 0x7f405c0cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f406196a640 1 -- 172.21.15.137:0/2842706585 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c06be20 con 0x7f405c15c440 2024-04-23T18:22:09.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f4060968640 1 --2- 172.21.15.137:0/2842706585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c153320 0x7f405c1f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:09.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f406196a640 1 --2- 172.21.15.137:0/2842706585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f405c15c440 0x7f405c1f4a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f40540ac000 tx=0x7f4054019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:09.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f4051ffb640 1 -- 172.21.15.137:0/2842706585 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40540b2050 con 0x7f405c15c440 2024-04-23T18:22:09.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f4051ffb640 1 -- 172.21.15.137:0/2842706585 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40540be070 con 0x7f405c15c440 2024-04-23T18:22:09.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f40633cd640 1 -- 172.21.15.137:0/2842706585 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405c143820 con 0x7f405c15c440 2024-04-23T18:22:09.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f4051ffb640 1 -- 172.21.15.137:0/2842706585 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40540ada50 con 0x7f405c15c440 2024-04-23T18:22:09.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f40633cd640 1 -- 172.21.15.137:0/2842706585 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405c143de0 con 0x7f405c15c440 2024-04-23T18:22:09.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f4051ffb640 1 -- 172.21.15.137:0/2842706585 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f40540adbf0 con 0x7f405c15c440 2024-04-23T18:22:09.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f4051ffb640 1 -- 172.21.15.137:0/2842706585 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f40540c3c80 con 0x7f405c15c440 2024-04-23T18:22:09.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f40633cd640 1 -- 172.21.15.137:0/2842706585 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f405c074290 con 0x7f405c15c440 2024-04-23T18:22:09.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.433+0000 7f4051ffb640 1 -- 172.21.15.137:0/2842706585 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4054016560 con 0x7f405c15c440 2024-04-23T18:22:09.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.501+0000 7f40633cd640 1 -- 172.21.15.137:0/2842706585 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f495a288-0985-466d-8737-f306ddfe04b1", "id": 4} v 0) -- 0x7f405c071720 con 0x7f405c15c440 2024-04-23T18:22:09.498 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:09.503+0000 7fe366708180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T18:22:09.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.509+0000 7f4051ffb640 1 -- 172.21.15.137:0/2842706585 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f495a288-0985-466d-8737-f306ddfe04b1", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f40540a58a0 con 0x7f405c15c440 2024-04-23T18:22:09.503 INFO:teuthology.orchestra.run.smithi137.stdout:4 2024-04-23T18:22:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.509+0000 7f40633cd640 1 -- 172.21.15.137:0/2842706585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f405c15c440 msgr2=0x7f405c1f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.509+0000 7f40633cd640 1 --2- 172.21.15.137:0/2842706585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f405c15c440 0x7f405c1f4a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f40540ac000 tx=0x7f4054019710 comp rx=0 tx=0).stop 2024-04-23T18:22:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.509+0000 7f40633cd640 1 -- 172.21.15.137:0/2842706585 shutdown_connections 2024-04-23T18:22:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.509+0000 7f40633cd640 1 --2- 172.21.15.137:0/2842706585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f405c153320 0x7f405c1f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.509+0000 7f40633cd640 1 --2- 172.21.15.137:0/2842706585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f405c15c440 0x7f405c1f4a30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.509+0000 7f40633cd640 1 --2- 172.21.15.137:0/2842706585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f405c152f40 0x7f405c0cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.509+0000 7f40633cd640 1 -- 172.21.15.137:0/2842706585 >> 172.21.15.137:0/2842706585 conn(0x7f405c0ce8f0 msgr2=0x7f405c0cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.509+0000 7f40633cd640 1 -- 172.21.15.137:0/2842706585 shutdown_connections 2024-04-23T18:22:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.509+0000 7f40633cd640 1 -- 172.21.15.137:0/2842706585 wait complete. 2024-04-23T18:22:09.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 8012096c-b6d4-4a49-b43e-e879e2829526 5 2024-04-23T18:22:09.522 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:09.525+0000 7f13f19d1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T18:22:09.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.637+0000 7fd375b71640 1 Processor -- start 2024-04-23T18:22:09.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.637+0000 7fd375b71640 1 -- start start 2024-04-23T18:22:09.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd375b71640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd3700c5de0 0x7fd3700cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd375b71640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd37015eea0 con 0x7fd37015e7f0 2024-04-23T18:22:09.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd375b71640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd37015f180 con 0x7fd370155710 2024-04-23T18:22:09.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd375b71640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd37015ec80 con 0x7fd3700c5de0 2024-04-23T18:22:09.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd36effd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd3700c5de0 0x7fd3700cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd36f7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd370155710 0x7fd37015bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42482/0 (socket says 172.21.15.137:42482) 2024-04-23T18:22:09.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd36f7fe640 1 -- 172.21.15.137:0/244447813 learned_addr learned my addr 172.21.15.137:0/244447813 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-23T18:22:09.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd36effd640 1 -- 172.21.15.137:0/244447813 >> v1:172.21.15.137:6789/0 conn(0x7fd370155710 legacy=0x7fd37015bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd36effd640 1 -- 172.21.15.137:0/244447813 >> v1:172.21.15.28:6789/0 conn(0x7fd37015e7f0 legacy=0x7fd3700cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:09.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd36effd640 1 -- 172.21.15.137:0/244447813 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37015f460 con 0x7fd3700c5de0 2024-04-23T18:22:09.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd36effd640 1 --2- 172.21.15.137:0/244447813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3700c5de0 0x7fd3700cce60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd358009d90 tx=0x7fd35801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d70eaad6abb5090 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:09.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd36e7fc640 1 -- 172.21.15.137:0/244447813 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3580b2070 con 0x7fd3700c5de0 2024-04-23T18:22:09.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd36e7fc640 1 -- 172.21.15.137:0/244447813 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3580a5920 con 0x7fd3700c5de0 2024-04-23T18:22:09.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.641+0000 7fd36e7fc640 1 -- 172.21.15.137:0/244447813 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3580a5cf0 con 0x7fd3700c5de0 2024-04-23T18:22:09.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- 172.21.15.137:0/244447813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3700c5de0 msgr2=0x7fd3700cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 --2- 172.21.15.137:0/244447813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3700c5de0 0x7fd3700cce60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd358009d90 tx=0x7fd35801c970 comp rx=0 tx=0).stop 2024-04-23T18:22:09.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- 172.21.15.137:0/244447813 shutdown_connections 2024-04-23T18:22:09.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 --2- 172.21.15.137:0/244447813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3700c5de0 0x7fd3700cce60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- 172.21.15.137:0/244447813 >> 172.21.15.137:0/244447813 conn(0x7fd37006cd90 msgr2=0x7fd37006d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:09.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- 172.21.15.137:0/244447813 shutdown_connections 2024-04-23T18:22:09.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- 172.21.15.137:0/244447813 wait complete. 2024-04-23T18:22:09.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 Processor -- start 2024-04-23T18:22:09.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- start start 2024-04-23T18:22:09.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3700c5de0 0x7fd370148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd370155710 0x7fd3700b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd37015e7f0 0x7fd3700b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd3700c6400 con 0x7fd3700c5de0 2024-04-23T18:22:09.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3700c6280 con 0x7fd370155710 2024-04-23T18:22:09.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd3701697c0 con 0x7fd37015e7f0 2024-04-23T18:22:09.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd370155710 0x7fd3700b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd370155710 0x7fd3700b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34874/0 (socket says 172.21.15.137:34874) 2024-04-23T18:22:09.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36effd640 1 -- 172.21.15.137:0/2356825640 learned_addr learned my addr 172.21.15.137:0/2356825640 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:09.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36ffff640 1 --2- 172.21.15.137:0/2356825640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd37015e7f0 0x7fd3700b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36f7fe640 1 --2- 172.21.15.137:0/2356825640 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3700c5de0 0x7fd370148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36effd640 1 -- 172.21.15.137:0/2356825640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd37015e7f0 msgr2=0x7fd3700b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36effd640 1 --2- 172.21.15.137:0/2356825640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd37015e7f0 0x7fd3700b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36effd640 1 -- 172.21.15.137:0/2356825640 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3700c5de0 msgr2=0x7fd370148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36effd640 1 --2- 172.21.15.137:0/2356825640 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3700c5de0 0x7fd370148980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36effd640 1 -- 172.21.15.137:0/2356825640 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37014adc0 con 0x7fd370155710 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36ffff640 1 --2- 172.21.15.137:0/2356825640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd37015e7f0 0x7fd3700b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd36effd640 1 --2- 172.21.15.137:0/2356825640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd370155710 0x7fd3700b5210 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd3580b0040 tx=0x7fd358019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd367fff640 1 -- 172.21.15.137:0/2356825640 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3580b2040 con 0x7fd370155710 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd367fff640 1 -- 172.21.15.137:0/2356825640 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3580bf070 con 0x7fd370155710 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- 172.21.15.137:0/2356825640 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3700b4d10 con 0x7fd370155710 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd367fff640 1 -- 172.21.15.137:0/2356825640 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3580ad8c0 con 0x7fd370155710 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- 172.21.15.137:0/2356825640 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37015a690 con 0x7fd370155710 2024-04-23T18:22:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd367fff640 1 -- 172.21.15.137:0/2356825640 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd3580ada60 con 0x7fd370155710 2024-04-23T18:22:09.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd367fff640 1 -- 172.21.15.137:0/2356825640 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fd3580b8bf0 con 0x7fd370155710 2024-04-23T18:22:09.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.645+0000 7fd375b71640 1 -- 172.21.15.137:0/2356825640 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd370146f70 con 0x7fd370155710 2024-04-23T18:22:09.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.649+0000 7fd367fff640 1 -- 172.21.15.137:0/2356825640 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd370146f70 con 0x7fd370155710 2024-04-23T18:22:09.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.717+0000 7fd375b71640 1 -- 172.21.15.137:0/2356825640 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8012096c-b6d4-4a49-b43e-e879e2829526", "id": 5} v 0) -- 0x7fd3700b4ee0 con 0x7fd370155710 2024-04-23T18:22:09.716 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:09.722+0000 7fe366708180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T18:22:09.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.721+0000 7fd367fff640 1 -- 172.21.15.137:0/2356825640 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8012096c-b6d4-4a49-b43e-e879e2829526", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fd358016560 con 0x7fd370155710 2024-04-23T18:22:09.717 INFO:teuthology.orchestra.run.smithi137.stdout:5 2024-04-23T18:22:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.721+0000 7fd375b71640 1 -- 172.21.15.137:0/2356825640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd370155710 msgr2=0x7fd3700b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.721+0000 7fd375b71640 1 --2- 172.21.15.137:0/2356825640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd370155710 0x7fd3700b5210 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd3580b0040 tx=0x7fd358019710 comp rx=0 tx=0).stop 2024-04-23T18:22:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.721+0000 7fd375b71640 1 -- 172.21.15.137:0/2356825640 shutdown_connections 2024-04-23T18:22:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.721+0000 7fd375b71640 1 --2- 172.21.15.137:0/2356825640 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd37015e7f0 0x7fd3700b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.721+0000 7fd375b71640 1 --2- 172.21.15.137:0/2356825640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd370155710 0x7fd3700b5210 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.721+0000 7fd375b71640 1 --2- 172.21.15.137:0/2356825640 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3700c5de0 0x7fd370148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.721+0000 7fd375b71640 1 -- 172.21.15.137:0/2356825640 >> 172.21.15.137:0/2356825640 conn(0x7fd37006cd90 msgr2=0x7fd37014b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.721+0000 7fd375b71640 1 -- 172.21.15.137:0/2356825640 shutdown_connections 2024-04-23T18:22:09.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.721+0000 7fd375b71640 1 -- 172.21.15.137:0/2356825640 wait complete. 2024-04-23T18:22:09.733 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 72a499db-d416-419a-a102-58eaf66bd7f7 6 2024-04-23T18:22:09.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2dfa8f640 1 Processor -- start 2024-04-23T18:22:09.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2dfa8f640 1 -- start start 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2dfa8f640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2d815b120 0x7fa2d815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2dfa8f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa2d806c5a0 0x7fa2d815f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2dfa8f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2d8073d70 con 0x7fa2d81556b0 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2dfa8f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa2d815e940 con 0x7fa2d806c5a0 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2dfa8f640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d815b5d0 con 0x7fa2d815b120 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2dd82b640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa2d81556b0 0x7fa2d8073660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42498/0 (socket says 172.21.15.137:42498) 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2dd82b640 1 -- 172.21.15.137:0/2008014020 learned_addr learned my addr 172.21.15.137:0/2008014020 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2de02c640 1 --2- 172.21.15.137:0/2008014020 >> v2:172.21.15.137:3300/0 conn(0x7fa2d806c5a0 0x7fa2d815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2dd02a640 1 --2- 172.21.15.137:0/2008014020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2d815b120 0x7fa2d815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2de02c640 1 -- 172.21.15.137:0/2008014020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2d815b120 msgr2=0x7fa2d815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2de02c640 1 --2- 172.21.15.137:0/2008014020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2d815b120 0x7fa2d815edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2de02c640 1 -- 172.21.15.137:0/2008014020 >> v1:172.21.15.137:6789/0 conn(0x7fa2d81556b0 legacy=0x7fa2d8073660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.849+0000 7fa2de02c640 1 -- 172.21.15.137:0/2008014020 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d815b8b0 con 0x7fa2d806c5a0 2024-04-23T18:22:09.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2de02c640 1 --2- 172.21.15.137:0/2008014020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2d806c5a0 0x7fa2d815f310 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009d90 tx=0x7fa2d001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a76d5b875b7542f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:09.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dc829640 1 -- 172.21.15.137:0/2008014020 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00b2070 con 0x7fa2d806c5a0 2024-04-23T18:22:09.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dc829640 1 -- 172.21.15.137:0/2008014020 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d00a57a0 con 0x7fa2d806c5a0 2024-04-23T18:22:09.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dc829640 1 -- 172.21.15.137:0/2008014020 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00a5b70 con 0x7fa2d806c5a0 2024-04-23T18:22:09.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/2008014020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2d806c5a0 msgr2=0x7fa2d815f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 --2- 172.21.15.137:0/2008014020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2d806c5a0 0x7fa2d815f310 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009d90 tx=0x7fa2d001c8e0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/2008014020 shutdown_connections 2024-04-23T18:22:09.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 --2- 172.21.15.137:0/2008014020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2d806c5a0 0x7fa2d815f310 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 --2- 172.21.15.137:0/2008014020 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2d815b120 0x7fa2d815edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/2008014020 >> 172.21.15.137:0/2008014020 conn(0x7fa2d80ce8f0 msgr2=0x7fa2d80ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:09.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/2008014020 shutdown_connections 2024-04-23T18:22:09.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/2008014020 wait complete. 2024-04-23T18:22:09.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 Processor -- start 2024-04-23T18:22:09.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 -- start start 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2d806c5a0 0x7fa2d814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2d81556b0 0x7fa2d814b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2d815b120 0x7fa2d815c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8167e40 con 0x7fa2d815b120 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8167cc0 con 0x7fa2d806c5a0 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dfa8f640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d8167fc0 con 0x7fa2d81556b0 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dd82b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2d806c5a0 0x7fa2d814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dd02a640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2d81556b0 0x7fa2d814b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dd82b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2d806c5a0 0x7fa2d814c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34894/0 (socket says 172.21.15.137:34894) 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.853+0000 7fa2dd82b640 1 -- 172.21.15.137:0/4242932449 learned_addr learned my addr 172.21.15.137:0/4242932449 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2de02c640 1 --2- 172.21.15.137:0/4242932449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2d815b120 0x7fa2d815c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:09.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2dd82b640 1 -- 172.21.15.137:0/4242932449 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2d81556b0 msgr2=0x7fa2d814b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2dd82b640 1 --2- 172.21.15.137:0/4242932449 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2d81556b0 0x7fa2d814b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2dd82b640 1 -- 172.21.15.137:0/4242932449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2d815b120 msgr2=0x7fa2d815c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2dd82b640 1 --2- 172.21.15.137:0/4242932449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2d815b120 0x7fa2d815c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2dd82b640 1 -- 172.21.15.137:0/4242932449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d81f3fc0 con 0x7fa2d806c5a0 2024-04-23T18:22:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2dd02a640 1 --2- 172.21.15.137:0/4242932449 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2d81556b0 0x7fa2d814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2dd82b640 1 --2- 172.21.15.137:0/4242932449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2d806c5a0 0x7fa2d814c850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c480 tx=0x7fa2d400c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2ce7fc640 1 -- 172.21.15.137:0/4242932449 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4017070 con 0x7fa2d806c5a0 2024-04-23T18:22:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2ce7fc640 1 -- 172.21.15.137:0/4242932449 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d4005cf0 con 0x7fa2d806c5a0 2024-04-23T18:22:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/4242932449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d814d090 con 0x7fa2d806c5a0 2024-04-23T18:22:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2ce7fc640 1 -- 172.21.15.137:0/4242932449 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4007290 con 0x7fa2d806c5a0 2024-04-23T18:22:09.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/4242932449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d81f4280 con 0x7fa2d806c5a0 2024-04-23T18:22:09.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2ce7fc640 1 -- 172.21.15.137:0/4242932449 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa2d401a070 con 0x7fa2d806c5a0 2024-04-23T18:22:09.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/4242932449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d8074290 con 0x7fa2d806c5a0 2024-04-23T18:22:09.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2ce7fc640 1 -- 172.21.15.137:0/4242932449 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fa2d40129f0 con 0x7fa2d806c5a0 2024-04-23T18:22:09.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.857+0000 7fa2ce7fc640 1 -- 172.21.15.137:0/4242932449 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa2d4021070 con 0x7fa2d806c5a0 2024-04-23T18:22:09.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.921+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/4242932449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "72a499db-d416-419a-a102-58eaf66bd7f7", "id": 6} v 0) -- 0x7fa2d81652d0 con 0x7fa2d806c5a0 2024-04-23T18:22:09.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.929+0000 7fa2ce7fc640 1 -- 172.21.15.137:0/4242932449 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72a499db-d416-419a-a102-58eaf66bd7f7", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fa2d4007610 con 0x7fa2d806c5a0 2024-04-23T18:22:09.926 INFO:teuthology.orchestra.run.smithi137.stdout:6 2024-04-23T18:22:09.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.929+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/4242932449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2d806c5a0 msgr2=0x7fa2d814c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:09.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.929+0000 7fa2dfa8f640 1 --2- 172.21.15.137:0/4242932449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2d806c5a0 0x7fa2d814c850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c480 tx=0x7fa2d400c940 comp rx=0 tx=0).stop 2024-04-23T18:22:09.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.929+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/4242932449 shutdown_connections 2024-04-23T18:22:09.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.929+0000 7fa2dfa8f640 1 --2- 172.21.15.137:0/4242932449 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2d81556b0 0x7fa2d814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.929+0000 7fa2dfa8f640 1 --2- 172.21.15.137:0/4242932449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2d815b120 0x7fa2d815c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.929+0000 7fa2dfa8f640 1 --2- 172.21.15.137:0/4242932449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2d806c5a0 0x7fa2d814c850 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:09.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.929+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/4242932449 >> 172.21.15.137:0/4242932449 conn(0x7fa2d80ce8f0 msgr2=0x7fa2d80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:09.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.929+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/4242932449 shutdown_connections 2024-04-23T18:22:09.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:09.929+0000 7fa2dfa8f640 1 -- 172.21.15.137:0/4242932449 wait complete. 2024-04-23T18:22:09.942 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 22b5f227-7ed6-46ad-adfa-39c1a5ffb777 7 2024-04-23T18:22:10.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d27dd8640 1 Processor -- start 2024-04-23T18:22:10.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d27dd8640 1 -- start start 2024-04-23T18:22:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d27dd8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3d200c2100 0x7f3d2006d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d27dd8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3d2015b470 0x7f3d2006d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d27dd8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d200ca5b0 con 0x7f3d201519a0 2024-04-23T18:22:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d27dd8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f3d200c92d0 con 0x7f3d2015b470 2024-04-23T18:22:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d27dd8640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3d200c2ba0 con 0x7f3d200c2100 2024-04-23T18:22:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d25373640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3d200c2100 0x7f3d2006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d25373640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3d200c2100 0x7f3d2006d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34904/0 (socket says 172.21.15.137:34904) 2024-04-23T18:22:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d25373640 1 -- 172.21.15.137:0/349230012 learned_addr learned my addr 172.21.15.137:0/349230012 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d26375640 1 --2- 172.21.15.137:0/349230012 >> v2:172.21.15.28:3300/0 conn(0x7f3d2015b470 0x7f3d2006d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d25373640 1 -- 172.21.15.137:0/349230012 >> v2:172.21.15.28:3300/0 conn(0x7f3d2015b470 msgr2=0x7f3d2006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:10.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d25373640 1 --2- 172.21.15.137:0/349230012 >> v2:172.21.15.28:3300/0 conn(0x7f3d2015b470 0x7f3d2006d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d25373640 1 -- 172.21.15.137:0/349230012 >> v1:172.21.15.28:6789/0 conn(0x7f3d201519a0 legacy=0x7f3d200c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:10.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.053+0000 7f3d25373640 1 -- 172.21.15.137:0/349230012 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d200c7f30 con 0x7f3d200c2100 2024-04-23T18:22:10.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d25373640 1 --2- 172.21.15.137:0/349230012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d200c2100 0x7f3d2006d260 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3d2006ee90 tx=0x7f3d1001c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd425b4929e8d5aa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:10.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d24b72640 1 -- 172.21.15.137:0/349230012 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d100a9400 con 0x7f3d200c2100 2024-04-23T18:22:10.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d24b72640 1 -- 172.21.15.137:0/349230012 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d100a95a0 con 0x7f3d200c2100 2024-04-23T18:22:10.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d24b72640 1 -- 172.21.15.137:0/349230012 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d100a9970 con 0x7f3d200c2100 2024-04-23T18:22:10.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d27dd8640 1 -- 172.21.15.137:0/349230012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d200c2100 msgr2=0x7f3d2006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:10.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d27dd8640 1 --2- 172.21.15.137:0/349230012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d200c2100 0x7f3d2006d260 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3d2006ee90 tx=0x7f3d1001c520 comp rx=0 tx=0).stop 2024-04-23T18:22:10.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d27dd8640 1 -- 172.21.15.137:0/349230012 shutdown_connections 2024-04-23T18:22:10.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d27dd8640 1 --2- 172.21.15.137:0/349230012 >> v2:172.21.15.28:3300/0 conn(0x7f3d2015b470 0x7f3d2006d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d27dd8640 1 --2- 172.21.15.137:0/349230012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d200c2100 0x7f3d2006d260 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d27dd8640 1 -- 172.21.15.137:0/349230012 >> 172.21.15.137:0/349230012 conn(0x7f3d2006f210 msgr2=0x7f3d2006f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:10.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d27dd8640 1 -- 172.21.15.137:0/349230012 shutdown_connections 2024-04-23T18:22:10.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d27dd8640 1 -- 172.21.15.137:0/349230012 wait complete. 2024-04-23T18:22:10.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d27dd8640 1 Processor -- start 2024-04-23T18:22:10.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.057+0000 7f3d27dd8640 1 -- start start 2024-04-23T18:22:10.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d27dd8640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d200c2100 0x7f3d2015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:10.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d27dd8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d201519a0 0x7f3d20154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:10.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d27dd8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d2015b470 0x7f3d201f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:10.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d27dd8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201647c0 con 0x7f3d2015b470 2024-04-23T18:22:10.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d27dd8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20164640 con 0x7f3d201519a0 2024-04-23T18:22:10.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d27dd8640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3d20164940 con 0x7f3d200c2100 2024-04-23T18:22:10.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25b74640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d200c2100 0x7f3d2015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:10.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25373640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d201519a0 0x7f3d20154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25b74640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d200c2100 0x7f3d2015aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:43456/0 (socket says 172.21.15.137:43456) 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25b74640 1 -- 172.21.15.137:0/389515096 learned_addr learned my addr 172.21.15.137:0/389515096 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25373640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d201519a0 0x7f3d20154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34908/0 (socket says 172.21.15.137:34908) 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d26375640 1 --2- 172.21.15.137:0/389515096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d2015b470 0x7f3d201f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25373640 1 -- 172.21.15.137:0/389515096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d200c2100 msgr2=0x7f3d2015aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25373640 1 --2- 172.21.15.137:0/389515096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d200c2100 0x7f3d2015aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25373640 1 -- 172.21.15.137:0/389515096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d2015b470 msgr2=0x7f3d201f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25373640 1 --2- 172.21.15.137:0/389515096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d2015b470 0x7f3d201f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25373640 1 -- 172.21.15.137:0/389515096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d20147220 con 0x7f3d201519a0 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d26375640 1 --2- 172.21.15.137:0/389515096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d2015b470 0x7f3d201f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25b74640 1 --2- 172.21.15.137:0/389515096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d200c2100 0x7f3d2015aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d25373640 1 --2- 172.21.15.137:0/389515096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d201519a0 0x7f3d20154520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3d20070220 tx=0x7f3d1001ad60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d167fc640 1 -- 172.21.15.137:0/389515096 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d100b1800 con 0x7f3d201519a0 2024-04-23T18:22:10.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d167fc640 1 -- 172.21.15.137:0/389515096 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d100b19c0 con 0x7f3d201519a0 2024-04-23T18:22:10.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d27dd8640 1 -- 172.21.15.137:0/389515096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d20150840 con 0x7f3d201519a0 2024-04-23T18:22:10.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d167fc640 1 -- 172.21.15.137:0/389515096 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d100b1db0 con 0x7f3d201519a0 2024-04-23T18:22:10.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d27dd8640 1 -- 172.21.15.137:0/389515096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d20150e00 con 0x7f3d201519a0 2024-04-23T18:22:10.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d167fc640 1 -- 172.21.15.137:0/389515096 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3d100bc450 con 0x7f3d201519a0 2024-04-23T18:22:10.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d167fc640 1 -- 172.21.15.137:0/389515096 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f3d100a89c0 con 0x7f3d201519a0 2024-04-23T18:22:10.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.061+0000 7f3d27dd8640 1 -- 172.21.15.137:0/389515096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d20074290 con 0x7f3d201519a0 2024-04-23T18:22:10.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.065+0000 7f3d167fc640 1 -- 172.21.15.137:0/389515096 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3d100ad020 con 0x7f3d201519a0 2024-04-23T18:22:10.107 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:10.113+0000 7f13f19d1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T18:22:10.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.129+0000 7f3d27dd8640 1 -- 172.21.15.137:0/389515096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd new", "uuid": "22b5f227-7ed6-46ad-adfa-39c1a5ffb777", "id": 7} v 0) -- 0x7f3d200c89b0 con 0x7f3d201519a0 2024-04-23T18:22:10.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.137+0000 7f3d167fc640 1 -- 172.21.15.137:0/389515096 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22b5f227-7ed6-46ad-adfa-39c1a5ffb777", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f3d10016110 con 0x7f3d201519a0 2024-04-23T18:22:10.133 INFO:teuthology.orchestra.run.smithi137.stdout:7 2024-04-23T18:22:10.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.137+0000 7f3d27dd8640 1 -- 172.21.15.137:0/389515096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d201519a0 msgr2=0x7f3d20154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:10.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.137+0000 7f3d27dd8640 1 --2- 172.21.15.137:0/389515096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d201519a0 0x7f3d20154520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3d20070220 tx=0x7f3d1001ad60 comp rx=0 tx=0).stop 2024-04-23T18:22:10.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.137+0000 7f3d27dd8640 1 -- 172.21.15.137:0/389515096 shutdown_connections 2024-04-23T18:22:10.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.137+0000 7f3d27dd8640 1 --2- 172.21.15.137:0/389515096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d2015b470 0x7f3d201f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.137+0000 7f3d27dd8640 1 --2- 172.21.15.137:0/389515096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d201519a0 0x7f3d20154520 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.137+0000 7f3d27dd8640 1 --2- 172.21.15.137:0/389515096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3d200c2100 0x7f3d2015aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.137+0000 7f3d27dd8640 1 -- 172.21.15.137:0/389515096 >> 172.21.15.137:0/389515096 conn(0x7f3d2006f210 msgr2=0x7f3d200c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:10.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.137+0000 7f3d27dd8640 1 -- 172.21.15.137:0/389515096 shutdown_connections 2024-04-23T18:22:10.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-23T18:22:10.137+0000 7f3d27dd8640 1 -- 172.21.15.137:0/389515096 wait complete. 2024-04-23T18:22:10.149 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-23T18:22:10.150 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-23T18:22:10.153 INFO:tasks.ceph.osd.0:Started 2024-04-23T18:22:10.153 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-23T18:22:10.153 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-23T18:22:10.156 INFO:tasks.ceph.osd.1:Started 2024-04-23T18:22:10.156 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-23T18:22:10.156 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-23T18:22:10.159 INFO:tasks.ceph.osd.2:Started 2024-04-23T18:22:10.159 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-23T18:22:10.159 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-23T18:22:10.163 INFO:tasks.ceph.osd.3:Started 2024-04-23T18:22:10.164 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-23T18:22:10.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-23T18:22:10.164 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:10.169+0000 7f13f19d1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T18:22:10.165 INFO:tasks.ceph.osd.4:Started 2024-04-23T18:22:10.166 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-23T18:22:10.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-23T18:22:10.168 INFO:tasks.ceph.osd.5:Started 2024-04-23T18:22:10.168 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-23T18:22:10.168 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-23T18:22:10.170 INFO:tasks.ceph.osd.6:Started 2024-04-23T18:22:10.170 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-23T18:22:10.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-23T18:22:10.172 INFO:tasks.ceph.osd.7:Started 2024-04-23T18:22:10.173 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:10.244 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:10.249+0000 7f13f19d1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T18:22:10.324 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:10.329+0000 7f13f19d1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T18:22:10.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.350+0000 7fcd20a00640 1 Processor -- start 2024-04-23T18:22:10.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.350+0000 7fcd20a00640 1 -- start start 2024-04-23T18:22:10.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd20a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c15d160 0x7fcd1c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:10.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd20a00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd1c15b650 con 0x7fcd1c0c91e0 2024-04-23T18:22:10.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd20a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd1c15b930 con 0x7fcd1c1444e0 2024-04-23T18:22:10.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd20a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1c15bc10 con 0x7fcd1c15d160 2024-04-23T18:22:10.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd13e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcd1c0c91e0 0x7fcd1c15ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:51272/0 (socket says 172.21.15.28:51272) 2024-04-23T18:22:10.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd13e00640 1 -- 172.21.15.28:0/2932189519 learned_addr learned my addr 172.21.15.28:0/2932189519 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:10.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd1a800640 1 --2- 172.21.15.28:0/2932189519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c15d160 0x7fcd1c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:10.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd19400640 1 -- 172.21.15.28:0/2932189519 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 826634650 0 0) 0x7fcd1c15b650 con 0x7fcd1c0c91e0 2024-04-23T18:22:10.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd19400640 1 -- 172.21.15.28:0/2932189519 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd00003530 con 0x7fcd1c0c91e0 2024-04-23T18:22:10.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd19400640 1 -- 172.21.15.28:0/2932189519 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198406654 0 0) 0x7fcd1c15b930 con 0x7fcd1c1444e0 2024-04-23T18:22:10.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd19400640 1 -- 172.21.15.28:0/2932189519 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd1c15b650 con 0x7fcd1c1444e0 2024-04-23T18:22:10.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd1a800640 1 -- 172.21.15.28:0/2932189519 >> v1:172.21.15.137:6789/0 conn(0x7fcd1c1444e0 legacy=0x7fcd1c072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:10.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd19400640 1 -- 172.21.15.28:0/2932189519 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3757717455 0 0) 0x7fcd00003530 con 0x7fcd1c0c91e0 2024-04-23T18:22:10.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd1a800640 1 -- 172.21.15.28:0/2932189519 >> v1:172.21.15.28:6789/0 conn(0x7fcd1c0c91e0 legacy=0x7fcd1c15ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:10.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.354+0000 7fcd1a800640 1 -- 172.21.15.28:0/2932189519 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c15bef0 con 0x7fcd1c15d160 2024-04-23T18:22:10.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.358+0000 7fcd1a800640 1 --2- 172.21.15.28:0/2932189519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c15d160 0x7fcd1c0710e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009dc0 tx=0x7fcd1401f0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b24b07416e696182 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:10.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.358+0000 7fcd19400640 1 -- 172.21.15.28:0/2932189519 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd140b5070 con 0x7fcd1c15d160 2024-04-23T18:22:10.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.358+0000 7fcd19400640 1 -- 172.21.15.28:0/2932189519 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd140a8c30 con 0x7fcd1c15d160 2024-04-23T18:22:10.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.358+0000 7fcd19400640 1 -- 172.21.15.28:0/2932189519 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04001680 con 0x7fcd1c15d160 2024-04-23T18:22:10.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 -- 172.21.15.28:0/2932189519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c15d160 msgr2=0x7fcd1c0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:10.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 --2- 172.21.15.28:0/2932189519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c15d160 0x7fcd1c0710e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009dc0 tx=0x7fcd1401f0a0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 -- 172.21.15.28:0/2932189519 shutdown_connections 2024-04-23T18:22:10.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 --2- 172.21.15.28:0/2932189519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c15d160 0x7fcd1c0710e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 -- 172.21.15.28:0/2932189519 >> 172.21.15.28:0/2932189519 conn(0x7fcd1c0676e0 msgr2=0x7fcd1c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:10.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 -- 172.21.15.28:0/2932189519 shutdown_connections 2024-04-23T18:22:10.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 -- 172.21.15.28:0/2932189519 wait complete. 2024-04-23T18:22:10.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 Processor -- start 2024-04-23T18:22:10.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 -- start start 2024-04-23T18:22:10.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd1c0c91e0 0x7fcd1c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:10.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c1444e0 0x7fcd1c1f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:10.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd1c15d160 0x7fcd1c1580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:10.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c1448c0 con 0x7fcd1c15d160 2024-04-23T18:22:10.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c15b300 con 0x7fcd1c0c91e0 2024-04-23T18:22:10.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd20a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1c144a40 con 0x7fcd1c1444e0 2024-04-23T18:22:10.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd1a800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd1c15d160 0x7fcd1c1580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:10.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd1a800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd1c15d160 0x7fcd1c1580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:32890/0 (socket says 172.21.15.28:32890) 2024-04-23T18:22:10.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd1a800640 1 -- 172.21.15.28:0/2472203263 learned_addr learned my addr 172.21.15.28:0/2472203263 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:10.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd19e00640 1 --2- 172.21.15.28:0/2472203263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd1c0c91e0 0x7fcd1c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:10.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd13e00640 1 --2- 172.21.15.28:0/2472203263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c1444e0 0x7fcd1c1f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:10.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd1a800640 1 -- 172.21.15.28:0/2472203263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c1444e0 msgr2=0x7fcd1c1f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:10.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd1a800640 1 --2- 172.21.15.28:0/2472203263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c1444e0 0x7fcd1c1f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd1a800640 1 -- 172.21.15.28:0/2472203263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd1c0c91e0 msgr2=0x7fcd1c0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:10.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd1a800640 1 --2- 172.21.15.28:0/2472203263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd1c0c91e0 0x7fcd1c0caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd1a800640 1 -- 172.21.15.28:0/2472203263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c06fea0 con 0x7fcd1c15d160 2024-04-23T18:22:10.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.362+0000 7fcd13e00640 1 --2- 172.21.15.28:0/2472203263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c1444e0 0x7fcd1c1f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:10.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.366+0000 7fcd1a800640 1 --2- 172.21.15.28:0/2472203263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd1c15d160 0x7fcd1c1580e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd1401d750 tx=0x7fcd1401be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:10.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.366+0000 7fcd12000640 1 -- 172.21.15.28:0/2472203263 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd140b5050 con 0x7fcd1c15d160 2024-04-23T18:22:10.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.366+0000 7fcd12000640 1 -- 172.21.15.28:0/2472203263 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd140c1070 con 0x7fcd1c15d160 2024-04-23T18:22:10.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.366+0000 7fcd12000640 1 -- 172.21.15.28:0/2472203263 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14009450 con 0x7fcd1c15d160 2024-04-23T18:22:10.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.366+0000 7fcd20a00640 1 -- 172.21.15.28:0/2472203263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1c0cf6b0 con 0x7fcd1c15d160 2024-04-23T18:22:10.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.366+0000 7fcd20a00640 1 -- 172.21.15.28:0/2472203263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1c0cca80 con 0x7fcd1c15d160 2024-04-23T18:22:10.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.366+0000 7fcd12000640 1 -- 172.21.15.28:0/2472203263 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd140bc670 con 0x7fcd1c15d160 2024-04-23T18:22:10.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.366+0000 7fcd12000640 1 -- 172.21.15.28:0/2472203263 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fcd140baad0 con 0x7fcd1c15d160 2024-04-23T18:22:10.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.366+0000 7fcd20a00640 1 -- 172.21.15.28:0/2472203263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1c068cd0 con 0x7fcd1c15d160 2024-04-23T18:22:10.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.370+0000 7fcd12000640 1 -- 172.21.15.28:0/2472203263 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fcd14018c00 con 0x7fcd1c15d160 2024-04-23T18:22:10.377 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:10.381+0000 7f13f19d1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T18:22:10.415 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:10.422+0000 7fe366708180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T18:22:10.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.426+0000 7fcd20a00640 1 -- 172.21.15.28:0/2472203263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd1c0cc040 con 0x7fcd1c15d160 2024-04-23T18:22:10.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.426+0000 7fcd12000640 1 -- 172.21.15.28:0/2472203263 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fcd140bacd0 con 0x7fcd1c15d160 2024-04-23T18:22:10.422 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:10.422 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":10,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:10.134910+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:10.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.430+0000 7fcd20a00640 1 -- 172.21.15.28:0/2472203263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd1c15d160 msgr2=0x7fcd1c1580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:10.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.430+0000 7fcd20a00640 1 --2- 172.21.15.28:0/2472203263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd1c15d160 0x7fcd1c1580e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd1401d750 tx=0x7fcd1401be40 comp rx=0 tx=0).stop 2024-04-23T18:22:10.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.430+0000 7fcd20a00640 1 -- 172.21.15.28:0/2472203263 shutdown_connections 2024-04-23T18:22:10.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.430+0000 7fcd20a00640 1 --2- 172.21.15.28:0/2472203263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd1c1444e0 0x7fcd1c1f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.430+0000 7fcd20a00640 1 --2- 172.21.15.28:0/2472203263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd1c15d160 0x7fcd1c1580e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.430+0000 7fcd20a00640 1 --2- 172.21.15.28:0/2472203263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd1c0c91e0 0x7fcd1c0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:10.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.430+0000 7fcd20a00640 1 -- 172.21.15.28:0/2472203263 >> 172.21.15.28:0/2472203263 conn(0x7fcd1c0676e0 msgr2=0x7fcd1c1e4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:10.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.430+0000 7fcd20a00640 1 -- 172.21.15.28:0/2472203263 shutdown_connections 2024-04-23T18:22:10.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:10.430+0000 7fcd20a00640 1 -- 172.21.15.28:0/2472203263 wait complete. 2024-04-23T18:22:10.443 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-23T18:22:10.443 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-23T18:22:10.453 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:10.457+0000 7f13f19d1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T18:22:10.482 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:10.486+0000 7fe366708180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T18:22:10.507 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:10.509+0000 7f13f19d1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T18:22:10.546 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:10.554+0000 7fe366708180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T18:22:10.640 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:10.646+0000 7fe366708180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T18:22:10.656 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:10.661+0000 7f13f19d1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T18:22:10.703 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:10.710+0000 7fe366708180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T18:22:10.717 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:10.721+0000 7f13f19d1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T18:22:10.791 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-04-23T18:22:10.798+0000 7f25d70677c0 -1 Falling back to public interface 2024-04-23T18:22:10.792 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-23T18:22:10.797+0000 7f0d8afd37c0 -1 Falling back to public interface 2024-04-23T18:22:10.793 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-23T18:22:10.797+0000 7f7a894497c0 -1 Falling back to public interface 2024-04-23T18:22:10.793 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-23T18:22:10.797+0000 7f7a88409640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6805/0: (98) Address already in use 2024-04-23T18:22:10.797 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:10.802+0000 7fe366708180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T18:22:10.800 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-23T18:22:10.805+0000 7f103fa547c0 -1 Falling back to public interface 2024-04-23T18:22:10.807 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-23T18:22:10.813+0000 7f559b82f7c0 -1 Falling back to public interface 2024-04-23T18:22:10.856 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-04-23T18:22:10.862+0000 7f7271d2d7c0 -1 Falling back to public interface 2024-04-23T18:22:10.859 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-04-23T18:22:10.866+0000 7fccd2c8e7c0 -1 Falling back to public interface 2024-04-23T18:22:10.865 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:10.870+0000 7fe366708180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T18:22:10.871 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-04-23T18:22:10.878+0000 7f89b839b7c0 -1 Falling back to public interface 2024-04-23T18:22:11.041 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:11.046+0000 7fe366708180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T18:22:11.116 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:11.122+0000 7fe366708180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T18:22:11.249 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:11.373 INFO:tasks.ceph.mgr.x.smithi137.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-23T18:22:11.373 INFO:tasks.ceph.mgr.x.smithi137.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-23T18:22:11.373 INFO:tasks.ceph.mgr.x.smithi137.stderr: from numpy import show_config as show_numpy_config 2024-04-23T18:22:11.380 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f920e000640 1 Processor -- start 2024-04-23T18:22:11.380 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f920e000640 1 -- start start 2024-04-23T18:22:11.381 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f920e000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f92080caf10 0x7f92080c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:11.381 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f920e000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f920815c6f0 0x7f9208070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:11.381 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f920e000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920815bd20 con 0x7f9208154fe0 2024-04-23T18:22:11.382 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f920e000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f920806c1a0 con 0x7f920815c6f0 2024-04-23T18:22:11.382 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f920e000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f92080c9cc0 con 0x7f92080caf10 2024-04-23T18:22:11.382 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f9207e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f920815c6f0 0x7f9208070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:11.382 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f9207e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f920815c6f0 0x7f9208070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:32900/0 (socket says 172.21.15.28:32900) 2024-04-23T18:22:11.382 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f9207e00640 1 -- 172.21.15.28:0/1252871235 learned_addr learned my addr 172.21.15.28:0/1252871235 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:11.382 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f91ffe00640 1 --2- 172.21.15.28:0/1252871235 >> v2:172.21.15.137:3300/0 conn(0x7f92080caf10 0x7f92080c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:11.382 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f9207e00640 1 -- 172.21.15.28:0/1252871235 >> v2:172.21.15.137:3300/0 conn(0x7f92080caf10 msgr2=0x7f92080c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:11.383 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f9207e00640 1 --2- 172.21.15.28:0/1252871235 >> v2:172.21.15.137:3300/0 conn(0x7f92080caf10 0x7f92080c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:11.383 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f9207e00640 1 -- 172.21.15.28:0/1252871235 >> v1:172.21.15.137:6789/0 conn(0x7f9208154fe0 legacy=0x7f92080ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:11.383 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.386+0000 7f9207e00640 1 -- 172.21.15.28:0/1252871235 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920815bfc0 con 0x7f920815c6f0 2024-04-23T18:22:11.384 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f9207e00640 1 --2- 172.21.15.28:0/1252871235 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f920815c6f0 0x7f9208070890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9200009e50 tx=0x7f920001f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99aa6f60a2453e35 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:11.385 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f9206a00640 1 -- 172.21.15.28:0/1252871235 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92000b4070 con 0x7f920815c6f0 2024-04-23T18:22:11.385 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f9206a00640 1 -- 172.21.15.28:0/1252871235 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92000af400 con 0x7f920815c6f0 2024-04-23T18:22:11.385 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f9206a00640 1 -- 172.21.15.28:0/1252871235 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92000af7d0 con 0x7f920815c6f0 2024-04-23T18:22:11.386 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f920e000640 1 -- 172.21.15.28:0/1252871235 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f920815c6f0 msgr2=0x7f9208070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:11.386 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f920e000640 1 --2- 172.21.15.28:0/1252871235 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f920815c6f0 0x7f9208070890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9200009e50 tx=0x7f920001f1a0 comp rx=0 tx=0).stop 2024-04-23T18:22:11.386 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f920e000640 1 -- 172.21.15.28:0/1252871235 shutdown_connections 2024-04-23T18:22:11.386 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f920e000640 1 --2- 172.21.15.28:0/1252871235 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f920815c6f0 0x7f9208070890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:11.386 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f920e000640 1 --2- 172.21.15.28:0/1252871235 >> v2:172.21.15.137:3300/0 conn(0x7f92080caf10 0x7f92080c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:11.386 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f920e000640 1 -- 172.21.15.28:0/1252871235 >> 172.21.15.28:0/1252871235 conn(0x7f9208073060 msgr2=0x7f92080ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:11.386 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f920e000640 1 -- 172.21.15.28:0/1252871235 shutdown_connections 2024-04-23T18:22:11.386 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.390+0000 7f920e000640 1 -- 172.21.15.28:0/1252871235 wait complete. 2024-04-23T18:22:11.387 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f920e000640 1 Processor -- start 2024-04-23T18:22:11.387 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f920e000640 1 -- start start 2024-04-23T18:22:11.389 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f920e000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92080caf10 0x7f920806ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:11.389 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f920e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9208154fe0 0x7f920814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:11.389 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f920e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f920815c6f0 0x7f92080cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:11.389 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f920e000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92080c9950 con 0x7f92080caf10 2024-04-23T18:22:11.389 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f920e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f92080c9670 con 0x7f920815c6f0 2024-04-23T18:22:11.389 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f920e000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f92080ca970 con 0x7f9208154fe0 2024-04-23T18:22:11.390 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f9207400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92080caf10 0x7f920806ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:11.390 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f9207400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92080caf10 0x7f920806ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:32902/0 (socket says 172.21.15.28:32902) 2024-04-23T18:22:11.390 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f9207400640 1 -- 172.21.15.28:0/886991452 learned_addr learned my addr 172.21.15.28:0/886991452 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:11.390 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f91ffe00640 1 --2- 172.21.15.28:0/886991452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9208154fe0 0x7f920814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:11.390 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f9207e00640 1 --2- 172.21.15.28:0/886991452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f920815c6f0 0x7f92080cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:11.390 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f9207400640 1 -- 172.21.15.28:0/886991452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9208154fe0 msgr2=0x7f920814dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:11.390 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f9207400640 1 --2- 172.21.15.28:0/886991452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9208154fe0 0x7f920814dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:11.390 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f9207400640 1 -- 172.21.15.28:0/886991452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f920815c6f0 msgr2=0x7f92080cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:11.390 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f9207400640 1 --2- 172.21.15.28:0/886991452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f920815c6f0 0x7f92080cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:11.390 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f9207400640 1 -- 172.21.15.28:0/886991452 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9208152a80 con 0x7f92080caf10 2024-04-23T18:22:11.390 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f9207400640 1 --2- 172.21.15.28:0/886991452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92080caf10 0x7f920806ca90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c480 tx=0x7f91f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:11.391 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f91ff400640 1 -- 172.21.15.28:0/886991452 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f8012830 con 0x7f92080caf10 2024-04-23T18:22:11.391 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f91ff400640 1 -- 172.21.15.28:0/886991452 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f8017070 con 0x7f92080caf10 2024-04-23T18:22:11.392 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f91ff400640 1 -- 172.21.15.28:0/886991452 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f8012c30 con 0x7f92080caf10 2024-04-23T18:22:11.392 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f920e000640 1 -- 172.21.15.28:0/886991452 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920815dac0 con 0x7f92080caf10 2024-04-23T18:22:11.392 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f920e000640 1 -- 172.21.15.28:0/886991452 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9208152cf0 con 0x7f92080caf10 2024-04-23T18:22:11.392 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f91ff400640 1 -- 172.21.15.28:0/886991452 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f91f801c460 con 0x7f92080caf10 2024-04-23T18:22:11.392 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.394+0000 7f91ff400640 1 -- 172.21.15.28:0/886991452 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f91f801be00 con 0x7f92080caf10 2024-04-23T18:22:11.392 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.398+0000 7f920e000640 1 -- 172.21.15.28:0/886991452 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f920804fcf0 con 0x7f92080caf10 2024-04-23T18:22:11.393 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.398+0000 7f91ff400640 1 -- 172.21.15.28:0/886991452 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f920815dac0 con 0x7f92080caf10 2024-04-23T18:22:11.438 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:11.441+0000 7f13f19d1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T18:22:11.494 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.498+0000 7f920e000640 1 -- 172.21.15.28:0/886991452 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92080cacf0 con 0x7f92080caf10 2024-04-23T18:22:11.494 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.498+0000 7f91ff400640 1 -- 172.21.15.28:0/886991452 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f91f8012dd0 con 0x7f92080caf10 2024-04-23T18:22:11.494 INFO:teuthology.misc.health.smithi028.stdout: 2024-04-23T18:22:11.495 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":10,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:10.134910+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:11.495 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.502+0000 7f920e000640 1 -- 172.21.15.28:0/886991452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92080caf10 msgr2=0x7f920806ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:11.496 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.502+0000 7f920e000640 1 --2- 172.21.15.28:0/886991452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92080caf10 0x7f920806ca90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c480 tx=0x7f91f800c940 comp rx=0 tx=0).stop 2024-04-23T18:22:11.496 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.502+0000 7f920e000640 1 -- 172.21.15.28:0/886991452 shutdown_connections 2024-04-23T18:22:11.496 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.502+0000 7f920e000640 1 --2- 172.21.15.28:0/886991452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9208154fe0 0x7f920814dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:11.496 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.502+0000 7f920e000640 1 --2- 172.21.15.28:0/886991452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f920815c6f0 0x7f92080cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:11.496 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.502+0000 7f920e000640 1 --2- 172.21.15.28:0/886991452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92080caf10 0x7f920806ca90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:11.496 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.502+0000 7f920e000640 1 -- 172.21.15.28:0/886991452 >> 172.21.15.28:0/886991452 conn(0x7f9208073060 msgr2=0x7f920806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:11.496 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.502+0000 7f920e000640 1 -- 172.21.15.28:0/886991452 shutdown_connections 2024-04-23T18:22:11.496 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:11.502+0000 7f920e000640 1 -- 172.21.15.28:0/886991452 wait complete. 2024-04-23T18:22:11.512 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-23T18:22:11.614 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:11.617+0000 7f13f19d1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T18:22:11.786 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:11.789+0000 7f13f19d1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T18:22:11.803 INFO:tasks.ceph.mgr.y.smithi028.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-23T18:22:11.804 INFO:tasks.ceph.mgr.y.smithi028.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-23T18:22:11.804 INFO:tasks.ceph.mgr.y.smithi028.stderr: from numpy import show_config as show_numpy_config 2024-04-23T18:22:11.850 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:11.853+0000 7f13f19d1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T18:22:11.850 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:11.854+0000 7fe366708180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T18:22:11.984 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:11.989+0000 7f13f19d1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T18:22:12.007 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:12.014+0000 7fe366708180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T18:22:12.192 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:12.198+0000 7fe366708180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T18:22:12.270 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:12.274+0000 7fe366708180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T18:22:12.428 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:12.434+0000 7fe366708180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T18:22:12.597 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:12.601+0000 7f13f19d1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T18:22:12.672 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:12.677+0000 7f13f19d1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T18:22:12.854 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:12.857+0000 7f13f19d1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T18:22:12.927 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:12.929+0000 7f13f19d1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T18:22:13.145 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:13.150+0000 7fe366708180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T18:22:13.216 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:13.221+0000 7f13f19d1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T18:22:13.238 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:13.242+0000 7fe366708180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T18:22:13.278 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:13.281+0000 7f13f19d1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T18:22:13.459 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:13.466+0000 7fe366708180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T18:22:13.549 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:13.554+0000 7fe366708180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T18:22:13.925 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:13.930+0000 7fe366708180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T18:22:14.001 INFO:tasks.ceph.mgr.y.smithi028.stderr:2024-04-23T18:22:14.006+0000 7fe366708180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T18:22:14.315 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:14.317+0000 7f1398e19640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-23T18:22:14.322 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-04-23T18:22:14.325+0000 7f1398e19640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-23T18:22:14.701 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-23T18:22:14.705+0000 7f559b82f7c0 -1 osd.5 0 log_to_monitors true 2024-04-23T18:22:14.707 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-04-23T18:22:14.714+0000 7f25d70677c0 -1 osd.0 0 log_to_monitors true 2024-04-23T18:22:14.759 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-23T18:22:14.761+0000 7f7a894497c0 -1 osd.4 0 log_to_monitors true 2024-04-23T18:22:14.786 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-23T18:22:14.789+0000 7f0d8afd37c0 -1 osd.7 0 log_to_monitors true 2024-04-23T18:22:14.803 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-23T18:22:14.809+0000 7f103fa547c0 -1 osd.6 0 log_to_monitors true 2024-04-23T18:22:14.948 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-04-23T18:22:14.954+0000 7f7271d2d7c0 -1 osd.1 0 log_to_monitors true 2024-04-23T18:22:14.960 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-04-23T18:22:14.966+0000 7fccd2c8e7c0 -1 osd.3 0 log_to_monitors true 2024-04-23T18:22:14.981 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-04-23T18:22:14.986+0000 7f89b839b7c0 -1 osd.2 0 log_to_monitors true 2024-04-23T18:22:17.957 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-04-23T18:22:17.962+0000 7f726cc00640 -1 osd.1 0 waiting for initial osdmap 2024-04-23T18:22:18.005 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-04-23T18:22:18.010+0000 7f7262c00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:22:18.069 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-04-23T18:22:18.074+0000 7fccce600640 -1 osd.3 0 waiting for initial osdmap 2024-04-23T18:22:18.092 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-04-23T18:22:18.098+0000 7fccc3c00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:22:18.107 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-04-23T18:22:18.114+0000 7f25d2000640 -1 osd.0 0 waiting for initial osdmap 2024-04-23T18:22:18.128 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-04-23T18:22:18.134+0000 7f25c8000640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:22:18.133 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-04-23T18:22:18.138+0000 7f89b3200640 -1 osd.2 0 waiting for initial osdmap 2024-04-23T18:22:18.176 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-04-23T18:22:18.182+0000 7f89a9200640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:22:18.318 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:18.449 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.454+0000 7fdd03000640 1 Processor -- start 2024-04-23T18:22:18.449 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.454+0000 7fdd03000640 1 -- start start 2024-04-23T18:22:18.451 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.454+0000 7fdd03000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 0x7fdcfc141f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:18.451 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.454+0000 7fdd03000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc0c6bc0 con 0x7fdcfc0c7640 2024-04-23T18:22:18.451 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.454+0000 7fdd03000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc0c3f30 con 0x7fdcfc1424a0 2024-04-23T18:22:18.451 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.454+0000 7fdd03000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdcfc0c4210 con 0x7fdcfc0c7a20 2024-04-23T18:22:18.451 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.458+0000 7fdcfbe00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdcfc0c7640 0x7fdcfc1597b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:51282/0 (socket says 172.21.15.28:51282) 2024-04-23T18:22:18.451 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.458+0000 7fdcfbe00640 1 -- 172.21.15.28:0/4212264310 learned_addr learned my addr 172.21.15.28:0/4212264310 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:18.451 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.458+0000 7fdcf3e00640 1 --2- 172.21.15.28:0/4212264310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 0x7fdcfc141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:18.452 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.458+0000 7fdcfb400640 1 -- 172.21.15.28:0/4212264310 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058374076 0 0) 0x7fdcfc0c6bc0 con 0x7fdcfc0c7640 2024-04-23T18:22:18.452 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.458+0000 7fdcfb400640 1 -- 172.21.15.28:0/4212264310 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce0003530 con 0x7fdcfc0c7640 2024-04-23T18:22:18.452 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.458+0000 7fdcf3e00640 1 -- 172.21.15.28:0/4212264310 >> v1:172.21.15.137:6789/0 conn(0x7fdcfc1424a0 legacy=0x7fdcfc073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:18.452 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.458+0000 7fdcf3e00640 1 -- 172.21.15.28:0/4212264310 >> v1:172.21.15.28:6789/0 conn(0x7fdcfc0c7640 legacy=0x7fdcfc1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:18.452 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.458+0000 7fdcf3e00640 1 -- 172.21.15.28:0/4212264310 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc0c44f0 con 0x7fdcfc0c7a20 2024-04-23T18:22:18.454 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.458+0000 7fdcf3e00640 1 --2- 172.21.15.28:0/4212264310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 0x7fdcfc141f60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdce40097f0 tx=0x7fdce401ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91506b08280668e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:18.455 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdcfb400640 1 -- 172.21.15.28:0/4212264310 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce40b5070 con 0x7fdcfc0c7a20 2024-04-23T18:22:18.455 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdcfb400640 1 -- 172.21.15.28:0/4212264310 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce40a89d0 con 0x7fdcfc0c7a20 2024-04-23T18:22:18.455 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdcfb400640 1 -- 172.21.15.28:0/4212264310 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce40a8d80 con 0x7fdcfc0c7a20 2024-04-23T18:22:18.456 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 -- 172.21.15.28:0/4212264310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 msgr2=0x7fdcfc141f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:18.456 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 --2- 172.21.15.28:0/4212264310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 0x7fdcfc141f60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdce40097f0 tx=0x7fdce401ecd0 comp rx=0 tx=0).stop 2024-04-23T18:22:18.456 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 -- 172.21.15.28:0/4212264310 shutdown_connections 2024-04-23T18:22:18.456 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 --2- 172.21.15.28:0/4212264310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 0x7fdcfc141f60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:18.456 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 -- 172.21.15.28:0/4212264310 >> 172.21.15.28:0/4212264310 conn(0x7fdcfc0c91f0 msgr2=0x7fdcfc0c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:18.456 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 -- 172.21.15.28:0/4212264310 shutdown_connections 2024-04-23T18:22:18.456 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 -- 172.21.15.28:0/4212264310 wait complete. 2024-04-23T18:22:18.457 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 Processor -- start 2024-04-23T18:22:18.457 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 -- start start 2024-04-23T18:22:18.459 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcfc0c7640 0x7fdcfc0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:18.459 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 0x7fdcfc152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:18.459 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcfc1424a0 0x7fdcfc152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:18.459 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc0c3bf0 con 0x7fdcfc1424a0 2024-04-23T18:22:18.459 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc159290 con 0x7fdcfc0c7640 2024-04-23T18:22:18.459 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd03000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fdcfc159ec0 con 0x7fdcfc0c7a20 2024-04-23T18:22:18.459 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdcfbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcfc0c7640 0x7fdcfc0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:18.459 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdcf3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 0x7fdcfc152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:18.460 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdd01000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcfc1424a0 0x7fdcfc152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:18.460 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdcf3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 0x7fdcfc152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:52856/0 (socket says 172.21.15.28:52856) 2024-04-23T18:22:18.460 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdcfbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcfc0c7640 0x7fdcfc0cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:48084/0 (socket says 172.21.15.28:48084) 2024-04-23T18:22:18.460 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.462+0000 7fdcf3e00640 1 -- 172.21.15.28:0/130836425 learned_addr learned my addr 172.21.15.28:0/130836425 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:18.460 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdd01000640 1 -- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 msgr2=0x7fdcfc152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:18.460 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdd01000640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 0x7fdcfc152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:18.460 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdd01000640 1 -- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcfc0c7640 msgr2=0x7fdcfc0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:18.460 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdd01000640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcfc0c7640 0x7fdcfc0cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:18.460 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdd01000640 1 -- 172.21.15.28:0/130836425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc1f1c70 con 0x7fdcfc1424a0 2024-04-23T18:22:18.460 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdd01000640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcfc1424a0 0x7fdcfc152550 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c730 tx=0x7fdcf400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:18.461 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdcf8c00640 1 -- 172.21.15.28:0/130836425 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4003b80 con 0x7fdcfc1424a0 2024-04-23T18:22:18.461 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdcf8c00640 1 -- 172.21.15.28:0/130836425 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf4003d20 con 0x7fdcfc1424a0 2024-04-23T18:22:18.461 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdd03000640 1 -- 172.21.15.28:0/130836425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcfc1f1060 con 0x7fdcfc1424a0 2024-04-23T18:22:18.461 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdcf8c00640 1 -- 172.21.15.28:0/130836425 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf400aa30 con 0x7fdcfc1424a0 2024-04-23T18:22:18.461 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdd03000640 1 -- 172.21.15.28:0/130836425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcfc1f1620 con 0x7fdcfc1424a0 2024-04-23T18:22:18.461 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdd03000640 1 -- 172.21.15.28:0/130836425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcfc04fcf0 con 0x7fdcfc1424a0 2024-04-23T18:22:18.462 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdcf8c00640 1 -- 172.21.15.28:0/130836425 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fdcf400abd0 con 0x7fdcfc1424a0 2024-04-23T18:22:18.463 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.466+0000 7fdcf8c00640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fdcd80682f0 0x7fdcd806a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:18.463 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.470+0000 7fdcf8c00640 1 -- 172.21.15.28:0/130836425 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fdcf4085950 con 0x7fdcfc1424a0 2024-04-23T18:22:18.463 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.470+0000 7fdcfbe00640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fdcd80682f0 0x7fdcd806a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:18.464 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.470+0000 7fdcfbe00640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fdcd80682f0 0x7fdcd806a7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0011f0 tx=0x7fdcec007d40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:18.467 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.474+0000 7fdcf8c00640 1 -- 172.21.15.28:0/130836425 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdcf4056600 con 0x7fdcfc1424a0 2024-04-23T18:22:18.620 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-23T18:22:18.624+0000 7f7a853f2640 -1 osd.4 0 waiting for initial osdmap 2024-04-23T18:22:18.631 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-23T18:22:18.636+0000 7f55977d8640 -1 osd.5 0 waiting for initial osdmap 2024-04-23T18:22:18.633 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.638+0000 7fdd03000640 1 -- 172.21.15.28:0/130836425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdcfc0c71c0 con 0x7fdcfc1424a0 2024-04-23T18:22:18.635 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdcf8c00640 1 -- 172.21.15.28:0/130836425 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fdcf405a900 con 0x7fdcfc1424a0 2024-04-23T18:22:18.635 INFO:teuthology.misc.health.smithi028.stdout: 2024-04-23T18:22:18.635 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":12,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:16.374652+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:18.637 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 -- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fdcd80682f0 msgr2=0x7fdcd806a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:18.637 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fdcd80682f0 0x7fdcd806a7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0011f0 tx=0x7fdcec007d40 comp rx=0 tx=0).stop 2024-04-23T18:22:18.637 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 -- 172.21.15.28:0/130836425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcfc1424a0 msgr2=0x7fdcfc152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:18.638 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcfc1424a0 0x7fdcfc152550 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c730 tx=0x7fdcf400cbf0 comp rx=0 tx=0).stop 2024-04-23T18:22:18.638 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 -- 172.21.15.28:0/130836425 shutdown_connections 2024-04-23T18:22:18.638 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fdcd80682f0 0x7fdcd806a7b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:18.638 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdcfc0c7a20 0x7fdcfc152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:18.638 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcfc1424a0 0x7fdcfc152550 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:18.638 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 --2- 172.21.15.28:0/130836425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcfc0c7640 0x7fdcfc0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:18.638 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 -- 172.21.15.28:0/130836425 >> 172.21.15.28:0/130836425 conn(0x7fdcfc0c91f0 msgr2=0x7fdcfc0c5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:18.638 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 -- 172.21.15.28:0/130836425 shutdown_connections 2024-04-23T18:22:18.638 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:18.642+0000 7fdd03000640 1 -- 172.21.15.28:0/130836425 wait complete. 2024-04-23T18:22:18.638 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-23T18:22:18.640+0000 7f0d86f7c640 -1 osd.7 0 waiting for initial osdmap 2024-04-23T18:22:18.652 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-04-23T18:22:18.656+0000 7f7a7d226640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:22:18.654 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-23T18:22:18.660 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-04-23T18:22:18.664+0000 7f0d7edb0640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:22:18.660 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-04-23T18:22:18.664+0000 7f558f60c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:22:18.666 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-23T18:22:18.668+0000 7f103b9fd640 -1 osd.6 0 waiting for initial osdmap 2024-04-23T18:22:18.713 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-04-23T18:22:18.716+0000 7f1033831640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:22:25.461 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:25.604 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbf1800640 1 Processor -- start 2024-04-23T18:22:25.604 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbf1800640 1 -- start start 2024-04-23T18:22:25.605 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbf1800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbbec155200 0x7fbbec0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:25.605 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbf1800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbbec0c6080 0x7fbbec15b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:25.606 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbf1800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbec0cb430 con 0x7fbbec0cccf0 2024-04-23T18:22:25.606 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbf1800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fbbec0cb6f0 con 0x7fbbec155200 2024-04-23T18:22:25.606 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbf1800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbbec0cb9d0 con 0x7fbbec0c6080 2024-04-23T18:22:25.606 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbebe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbbec155200 0x7fbbec0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:25.606 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbeb400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbbec0cccf0 0x7fbbec072010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37918/0 (socket says 172.21.15.28:37918) 2024-04-23T18:22:25.606 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbeb400640 1 -- 172.21.15.28:0/3181266262 learned_addr learned my addr 172.21.15.28:0/3181266262 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:25.606 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbf0e00640 1 --2- 172.21.15.28:0/3181266262 >> v2:172.21.15.137:3300/0 conn(0x7fbbec0c6080 0x7fbbec15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:25.607 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbebe00640 1 -- 172.21.15.28:0/3181266262 >> v2:172.21.15.137:3300/0 conn(0x7fbbec0c6080 msgr2=0x7fbbec15b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:25.607 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbebe00640 1 --2- 172.21.15.28:0/3181266262 >> v2:172.21.15.137:3300/0 conn(0x7fbbec0c6080 0x7fbbec15b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:25.607 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbebe00640 1 -- 172.21.15.28:0/3181266262 >> v1:172.21.15.28:6789/0 conn(0x7fbbec0cccf0 legacy=0x7fbbec072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:25.607 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbebe00640 1 -- 172.21.15.28:0/3181266262 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbec0cbcb0 con 0x7fbbec155200 2024-04-23T18:22:25.607 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.610+0000 7fbbeaa00640 1 -- 172.21.15.28:0/3181266262 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377657879 0 0) 0x7fbbec0cb430 con 0x7fbbec0cccf0 2024-04-23T18:22:25.609 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbebe00640 1 --2- 172.21.15.28:0/3181266262 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbec155200 0x7fbbec0c5b40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0739f0 tx=0x7fbbdc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf67fa56c965c91 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:25.609 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbeaa00640 1 -- 172.21.15.28:0/3181266262 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0b5070 con 0x7fbbec155200 2024-04-23T18:22:25.609 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbeaa00640 1 -- 172.21.15.28:0/3181266262 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbdc0a8970 con 0x7fbbec155200 2024-04-23T18:22:25.609 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbeaa00640 1 -- 172.21.15.28:0/3181266262 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0a8d40 con 0x7fbbec155200 2024-04-23T18:22:25.610 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbf1800640 1 -- 172.21.15.28:0/3181266262 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbec155200 msgr2=0x7fbbec0c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:25.610 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbf1800640 1 --2- 172.21.15.28:0/3181266262 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbec155200 0x7fbbec0c5b40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0739f0 tx=0x7fbbdc01ec70 comp rx=0 tx=0).stop 2024-04-23T18:22:25.610 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbf1800640 1 -- 172.21.15.28:0/3181266262 shutdown_connections 2024-04-23T18:22:25.610 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbf1800640 1 --2- 172.21.15.28:0/3181266262 >> v2:172.21.15.137:3300/0 conn(0x7fbbec0c6080 0x7fbbec15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:25.610 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbf1800640 1 --2- 172.21.15.28:0/3181266262 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbec155200 0x7fbbec0c5b40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:25.610 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbf1800640 1 -- 172.21.15.28:0/3181266262 >> 172.21.15.28:0/3181266262 conn(0x7fbbec0cd490 msgr2=0x7fbbec0cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:25.610 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbf1800640 1 -- 172.21.15.28:0/3181266262 shutdown_connections 2024-04-23T18:22:25.610 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.614+0000 7fbbf1800640 1 -- 172.21.15.28:0/3181266262 wait complete. 2024-04-23T18:22:25.611 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf1800640 1 Processor -- start 2024-04-23T18:22:25.611 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf1800640 1 -- start start 2024-04-23T18:22:25.613 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf1800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbec0c6080 0x7fbbec0cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:25.613 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbec0cccf0 0x7fbbec1f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:25.613 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf1800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbec155200 0x7fbbec0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:25.613 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf1800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec1555e0 con 0x7fbbec155200 2024-04-23T18:22:25.613 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf1800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec0cc270 con 0x7fbbec0cccf0 2024-04-23T18:22:25.613 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf1800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbbec1f0cd0 con 0x7fbbec0c6080 2024-04-23T18:22:25.614 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf0e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbec155200 0x7fbbec0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:25.614 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf0e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbec155200 0x7fbbec0b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35890/0 (socket says 172.21.15.28:35890) 2024-04-23T18:22:25.614 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf0e00640 1 -- 172.21.15.28:0/2905689391 learned_addr learned my addr 172.21.15.28:0/2905689391 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:25.614 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbeb400640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbec0cccf0 0x7fbbec1f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:25.614 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbebe00640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbec0c6080 0x7fbbec0cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:25.614 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf0e00640 1 -- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbec0c6080 msgr2=0x7fbbec0cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:25.614 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf0e00640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbec0c6080 0x7fbbec0cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:25.614 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf0e00640 1 -- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbec0cccf0 msgr2=0x7fbbec1f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:25.614 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf0e00640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbec0cccf0 0x7fbbec1f1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:25.614 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf0e00640 1 -- 172.21.15.28:0/2905689391 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbec1f43a0 con 0x7fbbec155200 2024-04-23T18:22:25.614 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbebe00640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbec0c6080 0x7fbbec0cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:25.615 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf0e00640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbec155200 0x7fbbec0b4b50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009dd0 tx=0x7fbbe400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:25.615 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbe3e00640 1 -- 172.21.15.28:0/2905689391 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4018020 con 0x7fbbec155200 2024-04-23T18:22:25.615 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbe3e00640 1 -- 172.21.15.28:0/2905689391 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe4014480 con 0x7fbbec155200 2024-04-23T18:22:25.615 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbe3e00640 1 -- 172.21.15.28:0/2905689391 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4014870 con 0x7fbbec155200 2024-04-23T18:22:25.616 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf1800640 1 -- 172.21.15.28:0/2905689391 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbec1f4680 con 0x7fbbec155200 2024-04-23T18:22:25.616 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.618+0000 7fbbf1800640 1 -- 172.21.15.28:0/2905689391 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbec1f4c40 con 0x7fbbec155200 2024-04-23T18:22:25.616 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.622+0000 7fbbf1800640 1 -- 172.21.15.28:0/2905689391 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbec04fcf0 con 0x7fbbec155200 2024-04-23T18:22:25.616 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.622+0000 7fbbe3e00640 1 -- 172.21.15.28:0/2905689391 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbbe401b020 con 0x7fbbec155200 2024-04-23T18:22:25.617 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.622+0000 7fbbe3e00640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 0x7fbbcc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:25.617 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.622+0000 7fbbe3e00640 1 -- 172.21.15.28:0/2905689391 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fbbe4087210 con 0x7fbbec155200 2024-04-23T18:22:25.617 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.622+0000 7fbbebe00640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 0x7fbbcc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:25.618 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.622+0000 7fbbebe00640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 0x7fbbcc06a840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0b2000 tx=0x7fbbdc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:25.622 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.626+0000 7fbbe3e00640 1 -- 172.21.15.28:0/2905689391 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbbe4022030 con 0x7fbbec155200 2024-04-23T18:22:25.800 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.806+0000 7fbbf1800640 1 -- 172.21.15.28:0/2905689391 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbec1f4e40 con 0x7fbbec155200 2024-04-23T18:22:25.802 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.806+0000 7fbbe3e00640 1 -- 172.21.15.28:0/2905689391 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7fbbe4010040 con 0x7fbbec155200 2024-04-23T18:22:25.802 INFO:teuthology.misc.health.smithi028.stdout: 2024-04-23T18:22:25.802 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":16,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:21.992360+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:25.804 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 -- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 msgr2=0x7fbbcc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:25.804 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 0x7fbbcc06a840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0b2000 tx=0x7fbbdc008040 comp rx=0 tx=0).stop 2024-04-23T18:22:25.804 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 -- 172.21.15.28:0/2905689391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbec155200 msgr2=0x7fbbec0b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:25.804 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbec155200 0x7fbbec0b4b50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009dd0 tx=0x7fbbe400c490 comp rx=0 tx=0).stop 2024-04-23T18:22:25.805 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 -- 172.21.15.28:0/2905689391 shutdown_connections 2024-04-23T18:22:25.805 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 0x7fbbcc06a840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:25.805 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbec155200 0x7fbbec0b4b50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:25.805 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbec0cccf0 0x7fbbec1f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:25.805 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 --2- 172.21.15.28:0/2905689391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbec0c6080 0x7fbbec0cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:25.805 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 -- 172.21.15.28:0/2905689391 >> 172.21.15.28:0/2905689391 conn(0x7fbbec0cd490 msgr2=0x7fbbec153580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:25.805 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 -- 172.21.15.28:0/2905689391 shutdown_connections 2024-04-23T18:22:25.805 INFO:teuthology.misc.health.smithi028.stderr:2024-04-23T18:22:25.810+0000 7fbbf1800640 1 -- 172.21.15.28:0/2905689391 wait complete. 2024-04-23T18:22:25.821 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-23T18:22:25.822 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-23T18:22:25.822 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-23T18:22:25.822 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-23T18:22:25.825 INFO:tasks.ceph.mds.a:Started 2024-04-23T18:22:25.825 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-23T18:22:25.825 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-23T18:22:25.829 INFO:tasks.ceph.mds.c:Started 2024-04-23T18:22:25.829 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-23T18:22:25.829 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-23T18:22:25.833 INFO:tasks.ceph.mds.e:Started 2024-04-23T18:22:25.833 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-23T18:22:25.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-23T18:22:25.836 INFO:tasks.ceph.mds.b:Started 2024-04-23T18:22:25.836 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-23T18:22:25.837 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-23T18:22:25.839 INFO:tasks.ceph.mds.d:Started 2024-04-23T18:22:25.839 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-23T18:22:25.840 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-23T18:22:25.842 INFO:tasks.ceph.mds.f:Started 2024-04-23T18:22:25.843 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-23T18:22:25.843 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:25.919 INFO:tasks.ceph.mds.f.smithi137.stdout:starting mds.f at 2024-04-23T18:22:25.927 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-04-23T18:22:25.927 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-04-23T18:22:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc33e00640 1 Processor -- start 2024-04-23T18:22:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc33e00640 1 -- start start 2024-04-23T18:22:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc33e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efc2c0c5750 0x7efc2c070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc33e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2c0c8980 0x7efc2c159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc33e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc2c0714f0 con 0x7efc2c073020 2024-04-23T18:22:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc33e00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7efc2c0c5c50 con 0x7efc2c0c5750 2024-04-23T18:22:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc33e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efc2c0c5f30 con 0x7efc2c0c8980 2024-04-23T18:22:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc30a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efc2c0c5750 0x7efc2c070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc30a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efc2c0c5750 0x7efc2c070e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35898/0 (socket says 172.21.15.28:35898) 2024-04-23T18:22:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc30a00640 1 -- 172.21.15.28:0/167258580 learned_addr learned my addr 172.21.15.28:0/167258580 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc31e00640 1 --2- 172.21.15.28:0/167258580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2c0c8980 0x7efc2c159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc30a00640 1 -- 172.21.15.28:0/167258580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2c0c8980 msgr2=0x7efc2c159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc30a00640 1 --2- 172.21.15.28:0/167258580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2c0c8980 0x7efc2c159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc30a00640 1 -- 172.21.15.28:0/167258580 >> v1:172.21.15.137:6789/0 conn(0x7efc2c073020 legacy=0x7efc2c142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.994+0000 7efc30a00640 1 -- 172.21.15.28:0/167258580 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c0c6210 con 0x7efc2c0c5750 2024-04-23T18:22:25.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:25.998+0000 7efc30a00640 1 --2- 172.21.15.28:0/167258580 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c5750 0x7efc2c070e90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efc18009870 tx=0x7efc1801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3fd2f8f36a1e42 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:26.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.301+0000 7efc2be00640 1 -- 172.21.15.28:0/167258580 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc180b5070 con 0x7efc2c0c5750 2024-04-23T18:22:26.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.301+0000 7efc2be00640 1 -- 172.21.15.28:0/167258580 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc180a8a50 con 0x7efc2c0c5750 2024-04-23T18:22:26.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.301+0000 7efc2be00640 1 -- 172.21.15.28:0/167258580 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc180a8e20 con 0x7efc2c0c5750 2024-04-23T18:22:26.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.301+0000 7efc33e00640 1 -- 172.21.15.28:0/167258580 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c5750 msgr2=0x7efc2c070e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:26.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.301+0000 7efc33e00640 1 --2- 172.21.15.28:0/167258580 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c5750 0x7efc2c070e90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efc18009870 tx=0x7efc1801ed50 comp rx=0 tx=0).stop 2024-04-23T18:22:26.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.301+0000 7efc33e00640 1 -- 172.21.15.28:0/167258580 shutdown_connections 2024-04-23T18:22:26.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.301+0000 7efc33e00640 1 --2- 172.21.15.28:0/167258580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2c0c8980 0x7efc2c159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.301+0000 7efc33e00640 1 --2- 172.21.15.28:0/167258580 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c0c5750 0x7efc2c070e90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.301+0000 7efc33e00640 1 -- 172.21.15.28:0/167258580 >> 172.21.15.28:0/167258580 conn(0x7efc2c0676e0 msgr2=0x7efc2c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:26.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.301+0000 7efc33e00640 1 -- 172.21.15.28:0/167258580 shutdown_connections 2024-04-23T18:22:26.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.301+0000 7efc33e00640 1 -- 172.21.15.28:0/167258580 wait complete. 2024-04-23T18:22:26.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc33e00640 1 Processor -- start 2024-04-23T18:22:26.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc33e00640 1 -- start start 2024-04-23T18:22:26.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc33e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c073020 0x7efc2c156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:26.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc33e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc2c0c5750 0x7efc2c15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:26.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc33e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2c0c8980 0x7efc2c13ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:26.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc33e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c073400 con 0x7efc2c073020 2024-04-23T18:22:26.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc33e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c0c67d0 con 0x7efc2c0c5750 2024-04-23T18:22:26.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc33e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efc2c073580 con 0x7efc2c0c8980 2024-04-23T18:22:26.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc31400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c073020 0x7efc2c156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:26.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc31e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2c0c8980 0x7efc2c13ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:26.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc31400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c073020 0x7efc2c156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35906/0 (socket says 172.21.15.28:35906) 2024-04-23T18:22:26.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc31400640 1 -- 172.21.15.28:0/3167921541 learned_addr learned my addr 172.21.15.28:0/3167921541 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:26.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc30a00640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc2c0c5750 0x7efc2c15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:26.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc31400640 1 -- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2c0c8980 msgr2=0x7efc2c13ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:26.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc31400640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2c0c8980 0x7efc2c13ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc31400640 1 -- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc2c0c5750 msgr2=0x7efc2c15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:26.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc31400640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc2c0c5750 0x7efc2c15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc31400640 1 -- 172.21.15.28:0/3167921541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c13e410 con 0x7efc2c073020 2024-04-23T18:22:26.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc31400640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c073020 0x7efc2c156e00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc2000c400 tx=0x7efc2000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:26.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.305+0000 7efc29600640 1 -- 172.21.15.28:0/3167921541 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20017070 con 0x7efc2c073020 2024-04-23T18:22:26.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.309+0000 7efc29600640 1 -- 172.21.15.28:0/3167921541 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc20005310 con 0x7efc2c073020 2024-04-23T18:22:26.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.309+0000 7efc29600640 1 -- 172.21.15.28:0/3167921541 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc200054c0 con 0x7efc2c073020 2024-04-23T18:22:26.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.309+0000 7efc33e00640 1 -- 172.21.15.28:0/3167921541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2c13cfc0 con 0x7efc2c073020 2024-04-23T18:22:26.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.309+0000 7efc33e00640 1 -- 172.21.15.28:0/3167921541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc2c1f1880 con 0x7efc2c073020 2024-04-23T18:22:26.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.309+0000 7efc33e00640 1 -- 172.21.15.28:0/3167921541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc2c068cd0 con 0x7efc2c073020 2024-04-23T18:22:26.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.309+0000 7efc29600640 1 -- 172.21.15.28:0/3167921541 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc2001a070 con 0x7efc2c073020 2024-04-23T18:22:26.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.313+0000 7efc29600640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc0c0683b0 0x7efc0c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:26.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.313+0000 7efc29600640 1 -- 172.21.15.28:0/3167921541 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7efc20085970 con 0x7efc2c073020 2024-04-23T18:22:26.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.313+0000 7efc30a00640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc0c0683b0 0x7efc0c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:26.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.313+0000 7efc30a00640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc0c0683b0 0x7efc0c06a870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc180b2000 tx=0x7efc18009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:26.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.321+0000 7efc29600640 1 -- 172.21.15.28:0/3167921541 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efc2c13e410 con 0x7efc2c073020 2024-04-23T18:22:26.343 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2024-04-23T18:22:26.343 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2024-04-23T18:22:26.357 INFO:tasks.ceph.mds.e.smithi028.stdout:starting mds.e at 2024-04-23T18:22:26.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.509+0000 7efc33e00640 1 -- 172.21.15.28:0/3167921541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc2c0c4e30 con 0x7efc2c073020 2024-04-23T18:22:26.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc29600640 1 -- 172.21.15.28:0/3167921541 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7efc20055b90 con 0x7efc2c073020 2024-04-23T18:22:26.508 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:26.508 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":16,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:21.992360+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:26.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 -- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc0c0683b0 msgr2=0x7efc0c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:26.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc0c0683b0 0x7efc0c06a870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc180b2000 tx=0x7efc18009040 comp rx=0 tx=0).stop 2024-04-23T18:22:26.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 -- 172.21.15.28:0/3167921541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c073020 msgr2=0x7efc2c156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:26.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c073020 0x7efc2c156e00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc2000c400 tx=0x7efc2000c8c0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 -- 172.21.15.28:0/3167921541 shutdown_connections 2024-04-23T18:22:26.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc0c0683b0 0x7efc0c06a870 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc2c0c8980 0x7efc2c13ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc2c0c5750 0x7efc2c15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 --2- 172.21.15.28:0/3167921541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc2c073020 0x7efc2c156e00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 -- 172.21.15.28:0/3167921541 >> 172.21.15.28:0/3167921541 conn(0x7efc2c0676e0 msgr2=0x7efc2c06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:26.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 -- 172.21.15.28:0/3167921541 shutdown_connections 2024-04-23T18:22:26.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.513+0000 7efc33e00640 1 -- 172.21.15.28:0/3167921541 wait complete. 2024-04-23T18:22:26.529 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T18:22:19.363864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T18:22:26.529 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T18:22:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.677+0000 7fad91c00640 1 Processor -- start 2024-04-23T18:22:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.677+0000 7fad91c00640 1 -- start start 2024-04-23T18:22:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.677+0000 7fad91c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fad8c1551b0 0x7fad8c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.677+0000 7fad91c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad8c0ca3e0 0x7fad8c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.677+0000 7fad91c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad8c0ca870 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.677+0000 7fad91c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fad8c15bbe0 con 0x7fad8c1551b0 2024-04-23T18:22:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.677+0000 7fad91c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c15aff0 con 0x7fad8c0ca3e0 2024-04-23T18:22:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.677+0000 7fad8aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fad8c1551b0 0x7fad8c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.677+0000 7fad8b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad8c0ca3e0 0x7fad8c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.677+0000 7fad82000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fad8c0c9fc0 0x7fad8c073710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:35378/0 (socket says 172.21.15.28:35378) 2024-04-23T18:22:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.677+0000 7fad82000640 1 -- 172.21.15.28:0/1977277996 learned_addr learned my addr 172.21.15.28:0/1977277996 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad8aa00640 1 -- 172.21.15.28:0/1977277996 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad8c0ca3e0 msgr2=0x7fad8c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad8aa00640 1 --2- 172.21.15.28:0/1977277996 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad8c0ca3e0 0x7fad8c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad8aa00640 1 -- 172.21.15.28:0/1977277996 >> v1:172.21.15.137:6789/0 conn(0x7fad8c0c9fc0 legacy=0x7fad8c073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad8aa00640 1 -- 172.21.15.28:0/1977277996 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c06c530 con 0x7fad8c1551b0 2024-04-23T18:22:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad8aa00640 1 --2- 172.21.15.28:0/1977277996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c1551b0 0x7fad8c15f1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0097c0 tx=0x7fad7c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82377f330a242edb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad8a000640 1 -- 172.21.15.28:0/1977277996 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0b0070 con 0x7fad8c1551b0 2024-04-23T18:22:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad8a000640 1 -- 172.21.15.28:0/1977277996 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7c0ab600 con 0x7fad8c1551b0 2024-04-23T18:22:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad8a000640 1 -- 172.21.15.28:0/1977277996 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0ab9d0 con 0x7fad8c1551b0 2024-04-23T18:22:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad91c00640 1 -- 172.21.15.28:0/1977277996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c1551b0 msgr2=0x7fad8c15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad91c00640 1 --2- 172.21.15.28:0/1977277996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c1551b0 0x7fad8c15f1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0097c0 tx=0x7fad7c01c4a0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad91c00640 1 -- 172.21.15.28:0/1977277996 shutdown_connections 2024-04-23T18:22:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad91c00640 1 --2- 172.21.15.28:0/1977277996 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad8c0ca3e0 0x7fad8c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad91c00640 1 --2- 172.21.15.28:0/1977277996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c1551b0 0x7fad8c15f1a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.681+0000 7fad91c00640 1 -- 172.21.15.28:0/1977277996 >> 172.21.15.28:0/1977277996 conn(0x7fad8c0676e0 msgr2=0x7fad8c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 -- 172.21.15.28:0/1977277996 shutdown_connections 2024-04-23T18:22:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 -- 172.21.15.28:0/1977277996 wait complete. 2024-04-23T18:22:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 Processor -- start 2024-04-23T18:22:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 -- start start 2024-04-23T18:22:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad8c0c9fc0 0x7fad8c14faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c0ca3e0 0x7fad8c0c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad8c1551b0 0x7fad8c1f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c155710 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c155590 con 0x7fad8c0ca3e0 2024-04-23T18:22:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c073e20 con 0x7fad8c1551b0 2024-04-23T18:22:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad8aa00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad8c0c9fc0 0x7fad8c14faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad8aa00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad8c0c9fc0 0x7fad8c14faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35966/0 (socket says 172.21.15.28:35966) 2024-04-23T18:22:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad8aa00640 1 -- 172.21.15.28:0/2082873722 learned_addr learned my addr 172.21.15.28:0/2082873722 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad8b400640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad8c1551b0 0x7fad8c1f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad82000640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c0ca3e0 0x7fad8c0c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad8aa00640 1 -- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad8c1551b0 msgr2=0x7fad8c1f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad8aa00640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad8c1551b0 0x7fad8c1f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad8aa00640 1 -- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c0ca3e0 msgr2=0x7fad8c0c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad8aa00640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c0ca3e0 0x7fad8c0c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad8aa00640 1 -- 172.21.15.28:0/2082873722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c14f2c0 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad8aa00640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad8c0c9fc0 0x7fad8c14faf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad7c01a0d0 tx=0x7fad7c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad83400640 1 -- 172.21.15.28:0/2082873722 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0ba070 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad83400640 1 -- 172.21.15.28:0/2082873722 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7c0b43f0 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad83400640 1 -- 172.21.15.28:0/2082873722 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0b0040 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 -- 172.21.15.28:0/2082873722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8c14f5a0 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.685+0000 7fad91c00640 1 -- 172.21.15.28:0/2082873722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad8c150840 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.689+0000 7fad91c00640 1 -- 172.21.15.28:0/2082873722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad8c150b70 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.689+0000 7fad83400640 1 -- 172.21.15.28:0/2082873722 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fad7c0bd070 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.689+0000 7fad83400640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fad68068380 0x7fad6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.689+0000 7fad83400640 1 -- 172.21.15.28:0/2082873722 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fad7c11f5c0 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.689+0000 7fad82000640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fad68068380 0x7fad6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:26.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.689+0000 7fad82000640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fad68068380 0x7fad6806a840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad8c165940 tx=0x7fad74009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:26.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.693+0000 7fad83400640 1 -- 172.21.15.28:0/2082873722 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad7c016090 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.857+0000 7fad91c00640 1 -- 172.21.15.28:0/2082873722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fad8c068db0 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.857+0000 7fad83400640 1 -- 172.21.15.28:0/2082873722 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fad7c0efe30 con 0x7fad8c0c9fc0 2024-04-23T18:22:26.854 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 -- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fad68068380 msgr2=0x7fad6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fad68068380 0x7fad6806a840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad8c165940 tx=0x7fad74009040 comp rx=0 tx=0).stop 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 -- 172.21.15.28:0/2082873722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad8c0c9fc0 msgr2=0x7fad8c14faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad8c0c9fc0 0x7fad8c14faf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad7c01a0d0 tx=0x7fad7c019240 comp rx=0 tx=0).stop 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 -- 172.21.15.28:0/2082873722 shutdown_connections 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fad68068380 0x7fad6806a840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad8c1551b0 0x7fad8c1f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad8c0ca3e0 0x7fad8c0c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 --2- 172.21.15.28:0/2082873722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad8c0c9fc0 0x7fad8c14faf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 -- 172.21.15.28:0/2082873722 >> 172.21.15.28:0/2082873722 conn(0x7fad8c0676e0 msgr2=0x7fad8c153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 -- 172.21.15.28:0/2082873722 shutdown_connections 2024-04-23T18:22:26.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:26.861+0000 7fad91c00640 1 -- 172.21.15.28:0/2082873722 wait complete. 2024-04-23T18:22:26.875 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:22:27.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb851600640 1 Processor -- start 2024-04-23T18:22:27.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb851600640 1 -- start start 2024-04-23T18:22:27.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb851600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb84c0c91e0 0x7fb84c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:27.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb851600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb84c06c3f0 0x7fb84c15ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:27.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb851600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb84c15b650 con 0x7fb84c1444e0 2024-04-23T18:22:27.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb851600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fb84c06c860 con 0x7fb84c0c91e0 2024-04-23T18:22:27.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb851600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb84c15b930 con 0x7fb84c06c3f0 2024-04-23T18:22:27.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb84a000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb84c0c91e0 0x7fb84c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:27.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb84a000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb84c0c91e0 0x7fb84c0710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35982/0 (socket says 172.21.15.28:35982) 2024-04-23T18:22:27.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb84a000640 1 -- 172.21.15.28:0/185479846 learned_addr learned my addr 172.21.15.28:0/185479846 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:27.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb84b400640 1 --2- 172.21.15.28:0/185479846 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb84c06c3f0 0x7fb84c15ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:27.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb84a000640 1 -- 172.21.15.28:0/185479846 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb84c06c3f0 msgr2=0x7fb84c15ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:27.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb84a000640 1 --2- 172.21.15.28:0/185479846 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb84c06c3f0 0x7fb84c15ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:27.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb84a000640 1 -- 172.21.15.28:0/185479846 >> v1:172.21.15.137:6789/0 conn(0x7fb84c1444e0 legacy=0x7fb84c072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:27.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.021+0000 7fb84a000640 1 -- 172.21.15.28:0/185479846 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84c15bc10 con 0x7fb84c0c91e0 2024-04-23T18:22:27.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb84a000640 1 --2- 172.21.15.28:0/185479846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb84c0c91e0 0x7fb84c0710e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb838009870 tx=0x7fb83801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c1753df6eb012c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:27.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb849600640 1 -- 172.21.15.28:0/185479846 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b5070 con 0x7fb84c0c91e0 2024-04-23T18:22:27.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb849600640 1 -- 172.21.15.28:0/185479846 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8380a8a50 con 0x7fb84c0c91e0 2024-04-23T18:22:27.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb849600640 1 -- 172.21.15.28:0/185479846 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8380a8e20 con 0x7fb84c0c91e0 2024-04-23T18:22:27.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb851600640 1 -- 172.21.15.28:0/185479846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb84c0c91e0 msgr2=0x7fb84c0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:27.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb851600640 1 --2- 172.21.15.28:0/185479846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb84c0c91e0 0x7fb84c0710e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb838009870 tx=0x7fb83801ed50 comp rx=0 tx=0).stop 2024-04-23T18:22:27.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb851600640 1 -- 172.21.15.28:0/185479846 shutdown_connections 2024-04-23T18:22:27.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb851600640 1 --2- 172.21.15.28:0/185479846 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb84c06c3f0 0x7fb84c15ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:27.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb851600640 1 --2- 172.21.15.28:0/185479846 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb84c0c91e0 0x7fb84c0710e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:27.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb851600640 1 -- 172.21.15.28:0/185479846 >> 172.21.15.28:0/185479846 conn(0x7fb84c0676e0 msgr2=0x7fb84c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:27.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb851600640 1 -- 172.21.15.28:0/185479846 shutdown_connections 2024-04-23T18:22:27.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb851600640 1 -- 172.21.15.28:0/185479846 wait complete. 2024-04-23T18:22:27.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.025+0000 7fb851600640 1 Processor -- start 2024-04-23T18:22:27.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb851600640 1 -- start start 2024-04-23T18:22:27.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb851600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb84c06c3f0 0x7fb84c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:27.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb851600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb84c0c91e0 0x7fb84c1e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:27.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb851600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb84c1444e0 0x7fb84c1e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:27.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb851600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c15b300 con 0x7fb84c0c91e0 2024-04-23T18:22:27.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb851600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c15c1d0 con 0x7fb84c06c3f0 2024-04-23T18:22:27.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb851600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb84c1448c0 con 0x7fb84c1444e0 2024-04-23T18:22:27.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb84a000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb84c0c91e0 0x7fb84c1e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:27.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb84a000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb84c0c91e0 0x7fb84c1e6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35986/0 (socket says 172.21.15.28:35986) 2024-04-23T18:22:27.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb84a000640 1 -- 172.21.15.28:0/4288669255 learned_addr learned my addr 172.21.15.28:0/4288669255 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:27.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb84aa00640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb84c06c3f0 0x7fb84c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:27.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb84b400640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb84c1444e0 0x7fb84c1e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:27.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb84a000640 1 -- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb84c1444e0 msgr2=0x7fb84c1e70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:27.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb84a000640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb84c1444e0 0x7fb84c1e70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:27.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb84a000640 1 -- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb84c06c3f0 msgr2=0x7fb84c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:27.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb84a000640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb84c06c3f0 0x7fb84c0c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:27.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb84a000640 1 -- 172.21.15.28:0/4288669255 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84c0c7790 con 0x7fb84c0c91e0 2024-04-23T18:22:27.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb84a000640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb84c0c91e0 0x7fb84c1e6bb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8380b3040 tx=0x7fb83801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:27.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb842a00640 1 -- 172.21.15.28:0/4288669255 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8380c0070 con 0x7fb84c0c91e0 2024-04-23T18:22:27.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb842a00640 1 -- 172.21.15.28:0/4288669255 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8380ae550 con 0x7fb84c0c91e0 2024-04-23T18:22:27.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb842a00640 1 -- 172.21.15.28:0/4288669255 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b5070 con 0x7fb84c0c91e0 2024-04-23T18:22:27.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb851600640 1 -- 172.21.15.28:0/4288669255 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84c0c5e00 con 0x7fb84c0c91e0 2024-04-23T18:22:27.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb851600640 1 -- 172.21.15.28:0/4288669255 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb84c0c6080 con 0x7fb84c0c91e0 2024-04-23T18:22:27.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.029+0000 7fb851600640 1 -- 172.21.15.28:0/4288669255 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb84c068cd0 con 0x7fb84c0c91e0 2024-04-23T18:22:27.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.033+0000 7fb842a00640 1 -- 172.21.15.28:0/4288669255 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8380c3070 con 0x7fb84c0c91e0 2024-04-23T18:22:27.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.033+0000 7fb842a00640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb82c068380 0x7fb82c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:27.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.033+0000 7fb842a00640 1 -- 172.21.15.28:0/4288669255 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb838124000 con 0x7fb84c0c91e0 2024-04-23T18:22:27.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.033+0000 7fb84aa00640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb82c068380 0x7fb82c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:27.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.033+0000 7fb84aa00640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb82c068380 0x7fb82c06a840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0015b0 tx=0x7fb83c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:27.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.037+0000 7fb842a00640 1 -- 172.21.15.28:0/4288669255 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb84c0c5e00 con 0x7fb84c0c91e0 2024-04-23T18:22:27.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.233+0000 7fb851600640 1 -- 172.21.15.28:0/4288669255 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb84c070720 con 0x7fb84c0c91e0 2024-04-23T18:22:27.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb842a00640 1 -- 172.21.15.28:0/4288669255 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7fb8380188b0 con 0x7fb84c0c91e0 2024-04-23T18:22:27.231 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:27.232 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-23T18:22:27.232 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 2 2024-04-23T18:22:27.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 -- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb82c068380 msgr2=0x7fb82c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:27.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb82c068380 0x7fb82c06a840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0015b0 tx=0x7fb83c009040 comp rx=0 tx=0).stop 2024-04-23T18:22:27.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 -- 172.21.15.28:0/4288669255 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb84c0c91e0 msgr2=0x7fb84c1e6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:27.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb84c0c91e0 0x7fb84c1e6bb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8380b3040 tx=0x7fb83801baf0 comp rx=0 tx=0).stop 2024-04-23T18:22:27.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 -- 172.21.15.28:0/4288669255 shutdown_connections 2024-04-23T18:22:27.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb82c068380 0x7fb82c06a840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:27.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb84c1444e0 0x7fb84c1e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:27.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb84c0c91e0 0x7fb84c1e6bb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:27.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 --2- 172.21.15.28:0/4288669255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb84c06c3f0 0x7fb84c0c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:27.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 -- 172.21.15.28:0/4288669255 >> 172.21.15.28:0/4288669255 conn(0x7fb84c0676e0 msgr2=0x7fb84c1412a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:27.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 -- 172.21.15.28:0/4288669255 shutdown_connections 2024-04-23T18:22:27.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:27.237+0000 7fb851600640 1 -- 172.21.15.28:0/4288669255 wait complete. 2024-04-23T18:22:27.686 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:22:27.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:22:29.253 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:22:29.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.409+0000 7ff21fe00640 1 Processor -- start 2024-04-23T18:22:29.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.409+0000 7ff21fe00640 1 -- start start 2024-04-23T18:22:29.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21fe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2200c8080 0x7ff22015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21fe00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2200682c0 con 0x7ff220072180 2024-04-23T18:22:29.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22015e820 con 0x7ff220144430 2024-04-23T18:22:29.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21fe00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff22015bf60 con 0x7ff2200c8080 2024-04-23T18:22:29.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21f400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff220072180 0x7ff2200725f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60344/0 (socket says 172.21.15.28:60344) 2024-04-23T18:22:29.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21f400640 1 -- 172.21.15.28:0/2579061738 learned_addr learned my addr 172.21.15.28:0/2579061738 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:29.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21e000640 1 --2- 172.21.15.28:0/2579061738 >> v2:172.21.15.137:3300/0 conn(0x7ff2200c8080 0x7ff22015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221910649 0 0) 0x7ff2200682c0 con 0x7ff220072180 2024-04-23T18:22:29.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff204003530 con 0x7ff220072180 2024-04-23T18:22:29.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2981509501 0 0) 0x7ff204003530 con 0x7ff220072180 2024-04-23T18:22:29.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 >> v2:172.21.15.137:3300/0 conn(0x7ff2200c8080 msgr2=0x7ff22015ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:29.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 --2- 172.21.15.28:0/2579061738 >> v2:172.21.15.137:3300/0 conn(0x7ff2200c8080 0x7ff22015ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 >> v1:172.21.15.137:6789/0 conn(0x7ff220144430 legacy=0x7ff2200676e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22015eb00 con 0x7ff220072180 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7ff218001a00 con 0x7ff220072180 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 >> v1:172.21.15.28:6789/0 conn(0x7ff220072180 legacy=0x7ff2200725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 --2- 172.21.15.28:0/2579061738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2040039c0 0x7ff204003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 --2- 172.21.15.28:0/2579061738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2040043c0 0x7ff204004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 --2- 172.21.15.28:0/2579061738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff204005090 0x7ff20400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff22015bf60 con 0x7ff204005090 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff20400bf40 con 0x7ff2040043c0 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff20400c140 con 0x7ff2040039c0 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21f400640 1 --2- 172.21.15.28:0/2579061738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff204005090 0x7ff20400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21e000640 1 --2- 172.21.15.28:0/2579061738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2040043c0 0x7ff204004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21ea00640 1 --2- 172.21.15.28:0/2579061738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2040039c0 0x7ff204003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21f400640 1 -- 172.21.15.28:0/2579061738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2040039c0 msgr2=0x7ff204003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21f400640 1 --2- 172.21.15.28:0/2579061738 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2040039c0 0x7ff204003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21f400640 1 -- 172.21.15.28:0/2579061738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2040043c0 msgr2=0x7ff204004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:29.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21f400640 1 --2- 172.21.15.28:0/2579061738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2040043c0 0x7ff204004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.413+0000 7ff21f400640 1 -- 172.21.15.28:0/2579061738 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff204003530 con 0x7ff204005090 2024-04-23T18:22:29.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21f400640 1 -- 172.21.15.28:0/2579061738 reap_dead start 2024-04-23T18:22:29.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21f400640 1 --2- 172.21.15.28:0/2579061738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff204005090 0x7ff20400b9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff21800a800 tx=0x7ff21801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c65ce500e0b54b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:29.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21800a450 con 0x7ff204005090 2024-04-23T18:22:29.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2180ad650 con 0x7ff204005090 2024-04-23T18:22:29.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21d600640 1 -- 172.21.15.28:0/2579061738 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2180ada40 con 0x7ff204005090 2024-04-23T18:22:29.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21fe00640 1 -- 172.21.15.28:0/2579061738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff204005090 msgr2=0x7ff20400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21fe00640 1 --2- 172.21.15.28:0/2579061738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff204005090 0x7ff20400b9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff21800a800 tx=0x7ff21801d300 comp rx=0 tx=0).stop 2024-04-23T18:22:29.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21fe00640 1 -- 172.21.15.28:0/2579061738 shutdown_connections 2024-04-23T18:22:29.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21fe00640 1 --2- 172.21.15.28:0/2579061738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff204005090 0x7ff20400b9d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21fe00640 1 -- 172.21.15.28:0/2579061738 >> 172.21.15.28:0/2579061738 conn(0x7ff2200c9ff0 msgr2=0x7ff2200ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:29.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21fe00640 1 -- 172.21.15.28:0/2579061738 shutdown_connections 2024-04-23T18:22:29.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.417+0000 7ff21fe00640 1 -- 172.21.15.28:0/2579061738 wait complete. 2024-04-23T18:22:29.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21fe00640 1 Processor -- start 2024-04-23T18:22:29.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21fe00640 1 -- start start 2024-04-23T18:22:29.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff204005090 0x7ff22013b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2200cb3d0 0x7ff220137210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21fe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff220137750 0x7ff2201f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21fe00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff22015f0c0 con 0x7ff220137750 2024-04-23T18:22:29.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff220071cf0 con 0x7ff204005090 2024-04-23T18:22:29.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff22015f3a0 con 0x7ff2200cb3d0 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff220137750 0x7ff2201f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff220137750 0x7ff2201f0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38454/0 (socket says 172.21.15.28:38454) 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21f400640 1 -- 172.21.15.28:0/409554828 learned_addr learned my addr 172.21.15.28:0/409554828 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21ea00640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff204005090 0x7ff22013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21e000640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2200cb3d0 0x7ff220137210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21f400640 1 -- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2200cb3d0 msgr2=0x7ff220137210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21f400640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2200cb3d0 0x7ff220137210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21f400640 1 -- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff204005090 msgr2=0x7ff22013b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21f400640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff204005090 0x7ff22013b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21f400640 1 -- 172.21.15.28:0/409554828 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2200cbb90 con 0x7ff220137750 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21e000640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2200cb3d0 0x7ff220137210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21ea00640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff204005090 0x7ff22013b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:29.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21f400640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff220137750 0x7ff2201f0970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff21801dba0 tx=0x7ff204005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:29.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff216a00640 1 -- 172.21.15.28:0/409554828 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2180019c0 con 0x7ff220137750 2024-04-23T18:22:29.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff216a00640 1 -- 172.21.15.28:0/409554828 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2180b4070 con 0x7ff220137750 2024-04-23T18:22:29.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff216a00640 1 -- 172.21.15.28:0/409554828 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2180ad800 con 0x7ff220137750 2024-04-23T18:22:29.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21fe00640 1 -- 172.21.15.28:0/409554828 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2201f4ca0 con 0x7ff220137750 2024-04-23T18:22:29.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21fe00640 1 -- 172.21.15.28:0/409554828 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22015e2b0 con 0x7ff220137750 2024-04-23T18:22:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.421+0000 7ff21fe00640 1 -- 172.21.15.28:0/409554828 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff220068cd0 con 0x7ff220137750 2024-04-23T18:22:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.425+0000 7ff216a00640 1 -- 172.21.15.28:0/409554828 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff2180b6020 con 0x7ff220137750 2024-04-23T18:22:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.425+0000 7ff216a00640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff200068380 0x7ff20006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.425+0000 7ff216a00640 1 -- 172.21.15.28:0/409554828 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff218120550 con 0x7ff220137750 2024-04-23T18:22:29.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.425+0000 7ff21ea00640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff200068380 0x7ff20006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.425+0000 7ff21ea00640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff200068380 0x7ff20006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff210007fd0 tx=0x7ff210009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:29.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.429+0000 7ff216a00640 1 -- 172.21.15.28:0/409554828 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff218017010 con 0x7ff220137750 2024-04-23T18:22:29.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.629+0000 7ff21fe00640 1 -- 172.21.15.28:0/409554828 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2200cadc0 con 0x7ff220137750 2024-04-23T18:22:29.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.629+0000 7ff216a00640 1 -- 172.21.15.28:0/409554828 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5518 (secure 0 0 0) 0x7ff2180f0e50 con 0x7ff220137750 2024-04-23T18:22:29.626 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:29.626 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-23T18:22:29.627 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 3 2024-04-23T18:22:29.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 -- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff200068380 msgr2=0x7ff20006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff200068380 0x7ff20006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff210007fd0 tx=0x7ff210009040 comp rx=0 tx=0).stop 2024-04-23T18:22:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 -- 172.21.15.28:0/409554828 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff220137750 msgr2=0x7ff2201f0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff220137750 0x7ff2201f0970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff21801dba0 tx=0x7ff204005840 comp rx=0 tx=0).stop 2024-04-23T18:22:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 -- 172.21.15.28:0/409554828 shutdown_connections 2024-04-23T18:22:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff200068380 0x7ff20006a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2200cb3d0 0x7ff220137210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff220137750 0x7ff2201f0970 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 --2- 172.21.15.28:0/409554828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff204005090 0x7ff22013b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 -- 172.21.15.28:0/409554828 >> 172.21.15.28:0/409554828 conn(0x7ff2200c9ff0 msgr2=0x7ff2201402e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 -- 172.21.15.28:0/409554828 shutdown_connections 2024-04-23T18:22:29.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.633+0000 7ff21fe00640 1 -- 172.21.15.28:0/409554828 wait complete. 2024-04-23T18:22:29.647 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:29.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe442400640 1 Processor -- start 2024-04-23T18:22:29.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe442400640 1 -- start start 2024-04-23T18:22:29.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe442400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe43c1444e0 0x7fe43c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe442400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe43c06c820 con 0x7fe43c06c3f0 2024-04-23T18:22:29.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe442400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe43c15b650 con 0x7fe43c0c91e0 2024-04-23T18:22:29.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe442400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe43c15b930 con 0x7fe43c1444e0 2024-04-23T18:22:29.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe43be00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe43c06c3f0 0x7fe43c15ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60356/0 (socket says 172.21.15.28:60356) 2024-04-23T18:22:29.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe43be00640 1 -- 172.21.15.28:0/1404198943 learned_addr learned my addr 172.21.15.28:0/1404198943 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:29.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe43b400640 1 --2- 172.21.15.28:0/1404198943 >> v2:172.21.15.137:3300/0 conn(0x7fe43c1444e0 0x7fe43c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe43aa00640 1 -- 172.21.15.28:0/1404198943 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 719996430 0 0) 0x7fe43c06c820 con 0x7fe43c06c3f0 2024-04-23T18:22:29.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe43aa00640 1 -- 172.21.15.28:0/1404198943 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe420003530 con 0x7fe43c06c3f0 2024-04-23T18:22:29.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe43b400640 1 -- 172.21.15.28:0/1404198943 >> v1:172.21.15.137:6789/0 conn(0x7fe43c0c91e0 legacy=0x7fe43c072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe43b400640 1 -- 172.21.15.28:0/1404198943 >> v1:172.21.15.28:6789/0 conn(0x7fe43c06c3f0 legacy=0x7fe43c15ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.793+0000 7fe43b400640 1 -- 172.21.15.28:0/1404198943 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c15bc10 con 0x7fe43c1444e0 2024-04-23T18:22:29.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.797+0000 7fe43b400640 1 --2- 172.21.15.28:0/1404198943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe43c1444e0 0x7fe43c0710e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0097c0 tx=0x7fe42c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c68e7c9f4ef8bf1e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:29.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.797+0000 7fe43aa00640 1 -- 172.21.15.28:0/1404198943 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0b5070 con 0x7fe43c1444e0 2024-04-23T18:22:29.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.797+0000 7fe43aa00640 1 -- 172.21.15.28:0/1404198943 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe42c0a8990 con 0x7fe43c1444e0 2024-04-23T18:22:29.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.797+0000 7fe43aa00640 1 -- 172.21.15.28:0/1404198943 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0a8d40 con 0x7fe43c1444e0 2024-04-23T18:22:29.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.797+0000 7fe442400640 1 -- 172.21.15.28:0/1404198943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe43c1444e0 msgr2=0x7fe43c0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.797+0000 7fe442400640 1 --2- 172.21.15.28:0/1404198943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe43c1444e0 0x7fe43c0710e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0097c0 tx=0x7fe42c01ec90 comp rx=0 tx=0).stop 2024-04-23T18:22:29.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.797+0000 7fe442400640 1 -- 172.21.15.28:0/1404198943 shutdown_connections 2024-04-23T18:22:29.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.797+0000 7fe442400640 1 --2- 172.21.15.28:0/1404198943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe43c1444e0 0x7fe43c0710e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.797+0000 7fe442400640 1 -- 172.21.15.28:0/1404198943 >> 172.21.15.28:0/1404198943 conn(0x7fe43c0676e0 msgr2=0x7fe43c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:29.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.797+0000 7fe442400640 1 -- 172.21.15.28:0/1404198943 shutdown_connections 2024-04-23T18:22:29.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.797+0000 7fe442400640 1 -- 172.21.15.28:0/1404198943 wait complete. 2024-04-23T18:22:29.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe442400640 1 Processor -- start 2024-04-23T18:22:29.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe442400640 1 -- start start 2024-04-23T18:22:29.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe442400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe43c06c3f0 0x7fe43c15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe442400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c0c91e0 0x7fe43c1f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe442400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe43c1444e0 0x7fe43c13b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe442400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c15b300 con 0x7fe43c0c91e0 2024-04-23T18:22:29.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe442400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c15c1d0 con 0x7fe43c06c3f0 2024-04-23T18:22:29.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe442400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe43c1448c0 con 0x7fe43c1444e0 2024-04-23T18:22:29.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe432a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c0c91e0 0x7fe43c1f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe432a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c0c91e0 0x7fe43c1f1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38466/0 (socket says 172.21.15.28:38466) 2024-04-23T18:22:29.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe432a00640 1 -- 172.21.15.28:0/2567073778 learned_addr learned my addr 172.21.15.28:0/2567073778 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:29.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe43b400640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe43c06c3f0 0x7fe43c15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe43be00640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe43c1444e0 0x7fe43c13b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe432a00640 1 -- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe43c1444e0 msgr2=0x7fe43c13b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe432a00640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe43c1444e0 0x7fe43c13b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe432a00640 1 -- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe43c06c3f0 msgr2=0x7fe43c15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe432a00640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe43c06c3f0 0x7fe43c15cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe432a00640 1 -- 172.21.15.28:0/2567073778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c15d850 con 0x7fe43c0c91e0 2024-04-23T18:22:29.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe432a00640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c0c91e0 0x7fe43c1f1690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c450 tx=0x7fe42400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:29.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe433e00640 1 -- 172.21.15.28:0/2567073778 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424016020 con 0x7fe43c0c91e0 2024-04-23T18:22:29.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe433e00640 1 -- 172.21.15.28:0/2567073778 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4240052d0 con 0x7fe43c0c91e0 2024-04-23T18:22:29.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe442400640 1 -- 172.21.15.28:0/2567073778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43c1f0ed0 con 0x7fe43c0c91e0 2024-04-23T18:22:29.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.801+0000 7fe433e00640 1 -- 172.21.15.28:0/2567073778 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424007260 con 0x7fe43c0c91e0 2024-04-23T18:22:29.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.805+0000 7fe442400640 1 -- 172.21.15.28:0/2567073778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe43c0cb430 con 0x7fe43c0c91e0 2024-04-23T18:22:29.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.805+0000 7fe442400640 1 -- 172.21.15.28:0/2567073778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe43c068cd0 con 0x7fe43c0c91e0 2024-04-23T18:22:29.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.805+0000 7fe433e00640 1 -- 172.21.15.28:0/2567073778 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe424007400 con 0x7fe43c0c91e0 2024-04-23T18:22:29.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.805+0000 7fe433e00640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4180683b0 0x7fe41806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:29.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.805+0000 7fe433e00640 1 -- 172.21.15.28:0/2567073778 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe424085fc0 con 0x7fe43c0c91e0 2024-04-23T18:22:29.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.805+0000 7fe43b400640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4180683b0 0x7fe41806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:29.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.809+0000 7fe43b400640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4180683b0 0x7fe41806a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0b2000 tx=0x7fe42c0aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:29.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.809+0000 7fe433e00640 1 -- 172.21.15.28:0/2567073778 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe424020020 con 0x7fe43c0c91e0 2024-04-23T18:22:29.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 -- 172.21.15.28:0/2567073778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe43c143300 con 0x7fe43c0c91e0 2024-04-23T18:22:29.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe433e00640 1 -- 172.21.15.28:0/2567073778 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7fe424005480 con 0x7fe43c0c91e0 2024-04-23T18:22:29.973 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:29.973 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":16,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:21.992360+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 -- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4180683b0 msgr2=0x7fe41806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4180683b0 0x7fe41806a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0b2000 tx=0x7fe42c0aa070 comp rx=0 tx=0).stop 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 -- 172.21.15.28:0/2567073778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c0c91e0 msgr2=0x7fe43c1f1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c0c91e0 0x7fe43c1f1690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c450 tx=0x7fe42400c910 comp rx=0 tx=0).stop 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 -- 172.21.15.28:0/2567073778 shutdown_connections 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4180683b0 0x7fe41806a870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe43c1444e0 0x7fe43c13b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe43c0c91e0 0x7fe43c1f1690 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 --2- 172.21.15.28:0/2567073778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe43c06c3f0 0x7fe43c15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 -- 172.21.15.28:0/2567073778 >> 172.21.15.28:0/2567073778 conn(0x7fe43c0676e0 msgr2=0x7fe43c159cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 -- 172.21.15.28:0/2567073778 shutdown_connections 2024-04-23T18:22:29.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:29.977+0000 7fe442400640 1 -- 172.21.15.28:0/2567073778 wait complete. 2024-04-23T18:22:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T18:22:19.363864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T18:22:29.995 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T18:22:30.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.141+0000 7f8682000640 1 Processor -- start 2024-04-23T18:22:30.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.141+0000 7f8682000640 1 -- start start 2024-04-23T18:22:30.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f8682000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f867c1556b0 0x7f867c15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f8682000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f867c15c0e0 con 0x7f867c15ed60 2024-04-23T18:22:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f8682000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f867c06bb80 con 0x7f867c073ad0 2024-04-23T18:22:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f8682000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f867c06c700 con 0x7f867c1556b0 2024-04-23T18:22:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867be00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f867c15ed60 0x7f867c165aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60360/0 (socket says 172.21.15.28:60360) 2024-04-23T18:22:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867be00640 1 -- 172.21.15.28:0/2953220886 learned_addr learned my addr 172.21.15.28:0/2953220886 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:30.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867b400640 1 --2- 172.21.15.28:0/2953220886 >> v2:172.21.15.137:3300/0 conn(0x7f867c1556b0 0x7f867c15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1814115788 0 0) 0x7f86740014a0 con 0x7f867c15ed60 2024-04-23T18:22:30.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8660003530 con 0x7f867c15ed60 2024-04-23T18:22:30.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35908815 0 0) 0x7f867c06bb80 con 0x7f867c073ad0 2024-04-23T18:22:30.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86740014a0 con 0x7f867c073ad0 2024-04-23T18:22:30.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2469112164 0 0) 0x7f8660003530 con 0x7f867c15ed60 2024-04-23T18:22:30.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 >> v2:172.21.15.137:3300/0 conn(0x7f867c1556b0 msgr2=0x7f867c15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:30.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 --2- 172.21.15.28:0/2953220886 >> v2:172.21.15.137:3300/0 conn(0x7f867c1556b0 0x7f867c15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 >> v1:172.21.15.137:6789/0 conn(0x7f867c073ad0 legacy=0x7f867c0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c06be60 con 0x7f867c15ed60 2024-04-23T18:22:30.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f8674001bd0 con 0x7f867c15ed60 2024-04-23T18:22:30.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 >> v1:172.21.15.28:6789/0 conn(0x7f867c15ed60 legacy=0x7f867c165aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 --2- 172.21.15.28:0/2953220886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8660003b50 0x7f8660003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 --2- 172.21.15.28:0/2953220886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8660004810 0x7f8660004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 --2- 172.21.15.28:0/2953220886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86600051d0 0x7f866000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f867c06c700 con 0x7f8660003b50 2024-04-23T18:22:30.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f866000c050 con 0x7f86600051d0 2024-04-23T18:22:30.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f866000c250 con 0x7f8660004810 2024-04-23T18:22:30.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867b400640 1 --2- 172.21.15.28:0/2953220886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8660003b50 0x7f8660003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867be00640 1 --2- 172.21.15.28:0/2953220886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86600051d0 0x7f866000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f8672a00640 1 --2- 172.21.15.28:0/2953220886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8660004810 0x7f8660004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867b400640 1 -- 172.21.15.28:0/2953220886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8660004810 msgr2=0x7f8660004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:30.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867b400640 1 --2- 172.21.15.28:0/2953220886 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8660004810 0x7f8660004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867b400640 1 -- 172.21.15.28:0/2953220886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86600051d0 msgr2=0x7f866000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:30.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867b400640 1 --2- 172.21.15.28:0/2953220886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86600051d0 0x7f866000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867b400640 1 -- 172.21.15.28:0/2953220886 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8660003530 con 0x7f8660003b50 2024-04-23T18:22:30.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.145+0000 7f867be00640 1 -- 172.21.15.28:0/2953220886 reap_dead start 2024-04-23T18:22:30.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f867b400640 1 --2- 172.21.15.28:0/2953220886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8660003b50 0x7f8660003f50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f866c009ae0 tx=0x7f866c01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bba0254930ed5e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:30.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c0b2070 con 0x7f8660003b50 2024-04-23T18:22:30.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c0a5520 con 0x7f8660003b50 2024-04-23T18:22:30.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f867aa00640 1 -- 172.21.15.28:0/2953220886 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c0096b0 con 0x7f8660003b50 2024-04-23T18:22:30.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f8682000640 1 -- 172.21.15.28:0/2953220886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8660003b50 msgr2=0x7f8660003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f8682000640 1 --2- 172.21.15.28:0/2953220886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8660003b50 0x7f8660003f50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f866c009ae0 tx=0x7f866c01ca40 comp rx=0 tx=0).stop 2024-04-23T18:22:30.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f8682000640 1 -- 172.21.15.28:0/2953220886 shutdown_connections 2024-04-23T18:22:30.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f8682000640 1 --2- 172.21.15.28:0/2953220886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8660003b50 0x7f8660003f50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f8682000640 1 -- 172.21.15.28:0/2953220886 >> 172.21.15.28:0/2953220886 conn(0x7f867c0676e0 msgr2=0x7f867c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:30.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f8682000640 1 -- 172.21.15.28:0/2953220886 shutdown_connections 2024-04-23T18:22:30.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f8682000640 1 -- 172.21.15.28:0/2953220886 wait complete. 2024-04-23T18:22:30.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f8682000640 1 Processor -- start 2024-04-23T18:22:30.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.149+0000 7f8682000640 1 -- start start 2024-04-23T18:22:30.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8682000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8660003b50 0x7f867c159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8682000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f867c153c40 0x7f867c14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8682000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f867c152d90 0x7f867c149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8682000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f867c15f580 con 0x7f867c153c40 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8682000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f867c0cbb90 con 0x7f8660003b50 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8682000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f867c073780 con 0x7f867c152d90 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8672a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f867c153c40 0x7f867c14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8672a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f867c153c40 0x7f867c14fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38488/0 (socket says 172.21.15.28:38488) 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8672a00640 1 -- 172.21.15.28:0/3318935044 learned_addr learned my addr 172.21.15.28:0/3318935044 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f867b400640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8660003b50 0x7f867c159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f867be00640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f867c152d90 0x7f867c149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8672a00640 1 -- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f867c152d90 msgr2=0x7f867c149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8672a00640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f867c152d90 0x7f867c149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8672a00640 1 -- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8660003b50 msgr2=0x7f867c159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8672a00640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8660003b50 0x7f867c159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8672a00640 1 -- 172.21.15.28:0/3318935044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c15b480 con 0x7f867c153c40 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f867b400640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8660003b50 0x7f867c159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:30.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8672a00640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f867c153c40 0x7f867c14fae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f866400e5e0 tx=0x7f866400eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:30.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8673e00640 1 -- 172.21.15.28:0/3318935044 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86640052e0 con 0x7f867c153c40 2024-04-23T18:22:30.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8673e00640 1 -- 172.21.15.28:0/3318935044 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8664018070 con 0x7f867c153c40 2024-04-23T18:22:30.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8682000640 1 -- 172.21.15.28:0/3318935044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867c1582d0 con 0x7f867c153c40 2024-04-23T18:22:30.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8673e00640 1 -- 172.21.15.28:0/3318935044 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86640054a0 con 0x7f867c153c40 2024-04-23T18:22:30.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8682000640 1 -- 172.21.15.28:0/3318935044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867c159030 con 0x7f867c153c40 2024-04-23T18:22:30.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8682000640 1 -- 172.21.15.28:0/3318935044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867c159230 con 0x7f867c153c40 2024-04-23T18:22:30.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.153+0000 7f8673e00640 1 -- 172.21.15.28:0/3318935044 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8664003840 con 0x7f867c153c40 2024-04-23T18:22:30.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.157+0000 7f8673e00640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f86580683b0 0x7f865806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.157+0000 7f8673e00640 1 -- 172.21.15.28:0/3318935044 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8664086410 con 0x7f867c153c40 2024-04-23T18:22:30.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.157+0000 7f867b400640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f86580683b0 0x7f865806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.157+0000 7f867b400640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f86580683b0 0x7f865806a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f866c0af000 tx=0x7f866c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:30.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.161+0000 7f8673e00640 1 -- 172.21.15.28:0/3318935044 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f867c159230 con 0x7f867c153c40 2024-04-23T18:22:30.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.325+0000 7f8682000640 1 -- 172.21.15.28:0/3318935044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f867c068db0 con 0x7f867c153c40 2024-04-23T18:22:30.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.325+0000 7f8673e00640 1 -- 172.21.15.28:0/3318935044 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f8664056c80 con 0x7f867c153c40 2024-04-23T18:22:30.322 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 -- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f86580683b0 msgr2=0x7f865806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f86580683b0 0x7f865806a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f866c0af000 tx=0x7f866c008040 comp rx=0 tx=0).stop 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 -- 172.21.15.28:0/3318935044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f867c153c40 msgr2=0x7f867c14fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f867c153c40 0x7f867c14fae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f866400e5e0 tx=0x7f866400eaa0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 -- 172.21.15.28:0/3318935044 shutdown_connections 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f86580683b0 0x7f865806a870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f867c152d90 0x7f867c149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f867c153c40 0x7f867c14fae0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 --2- 172.21.15.28:0/3318935044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8660003b50 0x7f867c159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 -- 172.21.15.28:0/3318935044 >> 172.21.15.28:0/3318935044 conn(0x7f867c0676e0 msgr2=0x7f867c0cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 -- 172.21.15.28:0/3318935044 shutdown_connections 2024-04-23T18:22:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.329+0000 7f8682000640 1 -- 172.21.15.28:0/3318935044 wait complete. 2024-04-23T18:22:30.343 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-23T18:22:30.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64b0c00640 1 Processor -- start 2024-04-23T18:22:30.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64b0c00640 1 -- start start 2024-04-23T18:22:30.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64b0c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64ac0cdc90 0x7f64ac0c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64b0c00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ac0c77b0 con 0x7f64ac153250 2024-04-23T18:22:30.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64b0c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ac0c4c70 con 0x7f64ac0c8670 2024-04-23T18:22:30.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64b0c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f64ac0cda90 con 0x7f64ac0cdc90 2024-04-23T18:22:30.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f64ac153250 0x7f64ac0c6e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60372/0 (socket says 172.21.15.28:60372) 2024-04-23T18:22:30.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9e00640 1 -- 172.21.15.28:0/1452137498 learned_addr learned my addr 172.21.15.28:0/1452137498 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:30.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a1400640 1 --2- 172.21.15.28:0/1452137498 >> v2:172.21.15.137:3300/0 conn(0x7f64ac0cdc90 0x7f64ac0c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2379581356 0 0) 0x7f64ac0c77b0 con 0x7f64ac153250 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6490003530 con 0x7f64ac153250 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3857654389 0 0) 0x7f6490003530 con 0x7f64ac153250 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 >> v2:172.21.15.137:3300/0 conn(0x7f64ac0cdc90 msgr2=0x7f64ac0c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 --2- 172.21.15.28:0/1452137498 >> v2:172.21.15.137:3300/0 conn(0x7f64ac0cdc90 0x7f64ac0c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 >> v1:172.21.15.137:6789/0 conn(0x7f64ac0c8670 legacy=0x7f64ac15c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac0c4f50 con 0x7f64ac153250 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f649c001680 con 0x7f64ac153250 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 >> v1:172.21.15.28:6789/0 conn(0x7f64ac153250 legacy=0x7f64ac0c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 --2- 172.21.15.28:0/1452137498 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64900039c0 0x7f6490003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 --2- 172.21.15.28:0/1452137498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6490004810 0x7f6490004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 --2- 172.21.15.28:0/1452137498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64900051d0 0x7f649000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f649000c050 con 0x7f6490004810 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f649000c200 con 0x7f64900051d0 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f649000c400 con 0x7f64900039c0 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a1400640 1 --2- 172.21.15.28:0/1452137498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6490004810 0x7f6490004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a9e00640 1 --2- 172.21.15.28:0/1452137498 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64900039c0 0x7f6490003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64aa800640 1 --2- 172.21.15.28:0/1452137498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64900051d0 0x7f649000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a1400640 1 -- 172.21.15.28:0/1452137498 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64900039c0 msgr2=0x7f6490003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a1400640 1 --2- 172.21.15.28:0/1452137498 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f64900039c0 0x7f6490003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a1400640 1 -- 172.21.15.28:0/1452137498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64900051d0 msgr2=0x7f649000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a1400640 1 --2- 172.21.15.28:0/1452137498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64900051d0 0x7f649000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64a1400640 1 -- 172.21.15.28:0/1452137498 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6490003530 con 0x7f6490004810 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.489+0000 7f64aa800640 1 -- 172.21.15.28:0/1452137498 reap_dead start 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.493+0000 7f64a1400640 1 --2- 172.21.15.28:0/1452137498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6490004810 0x7f6490004c90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6494009fc0 tx=0x7f649401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5a121d5551d5e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.493+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64940b2070 con 0x7f6490004810 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.493+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64940a5c90 con 0x7f6490004810 2024-04-23T18:22:30.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.493+0000 7f64a9400640 1 -- 172.21.15.28:0/1452137498 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494009c10 con 0x7f6490004810 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.493+0000 7f64b0c00640 1 -- 172.21.15.28:0/1452137498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6490004810 msgr2=0x7f6490004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.493+0000 7f64b0c00640 1 --2- 172.21.15.28:0/1452137498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6490004810 0x7f6490004c90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6494009fc0 tx=0x7f649401cc80 comp rx=0 tx=0).stop 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.493+0000 7f64b0c00640 1 -- 172.21.15.28:0/1452137498 shutdown_connections 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.493+0000 7f64b0c00640 1 --2- 172.21.15.28:0/1452137498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6490004810 0x7f6490004c90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.493+0000 7f64b0c00640 1 -- 172.21.15.28:0/1452137498 >> 172.21.15.28:0/1452137498 conn(0x7f64ac075e30 msgr2=0x7f64ac06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.493+0000 7f64b0c00640 1 -- 172.21.15.28:0/1452137498 shutdown_connections 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.493+0000 7f64b0c00640 1 -- 172.21.15.28:0/1452137498 wait complete. 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64b0c00640 1 Processor -- start 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64b0c00640 1 -- start start 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64b0c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6490004810 0x7f64ac142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64b0c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64ac157f30 0x7f64ac0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64b0c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64ac0ca790 0x7f64ac1eee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64b0c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac0c5510 con 0x7f64ac157f30 2024-04-23T18:22:30.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64b0c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac0ce100 con 0x7f64ac0ca790 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64b0c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f64ac0c7a70 con 0x7f6490004810 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a1400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64ac157f30 0x7f64ac0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a1400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64ac157f30 0x7f64ac0ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38518/0 (socket says 172.21.15.28:38518) 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a1400640 1 -- 172.21.15.28:0/3299756330 learned_addr learned my addr 172.21.15.28:0/3299756330 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64aa800640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64ac0ca790 0x7f64ac1eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a9e00640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6490004810 0x7f64ac142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a1400640 1 -- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6490004810 msgr2=0x7f64ac142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a1400640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6490004810 0x7f64ac142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a1400640 1 -- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64ac0ca790 msgr2=0x7f64ac1eee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a1400640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64ac0ca790 0x7f64ac1eee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a1400640 1 -- 172.21.15.28:0/3299756330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac1f2a90 con 0x7f64ac157f30 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a1400640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64ac157f30 0x7f64ac0ca250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f649401c6f0 tx=0x7f6494009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a2a00640 1 -- 172.21.15.28:0/3299756330 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64940ba070 con 0x7f64ac157f30 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a2a00640 1 -- 172.21.15.28:0/3299756330 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64940ada40 con 0x7f64ac157f30 2024-04-23T18:22:30.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64a2a00640 1 -- 172.21.15.28:0/3299756330 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64940b2040 con 0x7f64ac157f30 2024-04-23T18:22:30.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64b0c00640 1 -- 172.21.15.28:0/3299756330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ac0cd8a0 con 0x7f64ac157f30 2024-04-23T18:22:30.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.497+0000 7f64b0c00640 1 -- 172.21.15.28:0/3299756330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ac1f2d00 con 0x7f64ac157f30 2024-04-23T18:22:30.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.501+0000 7f64b0c00640 1 -- 172.21.15.28:0/3299756330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ac068cd0 con 0x7f64ac157f30 2024-04-23T18:22:30.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.501+0000 7f64a2a00640 1 -- 172.21.15.28:0/3299756330 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f64940b6410 con 0x7f64ac157f30 2024-04-23T18:22:30.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.501+0000 7f64a2a00640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f64880683b0 0x7f648806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.501+0000 7f64a2a00640 1 -- 172.21.15.28:0/3299756330 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6494120d80 con 0x7f64ac157f30 2024-04-23T18:22:30.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.501+0000 7f64a9e00640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f64880683b0 0x7f648806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.501+0000 7f64a9e00640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f64880683b0 0x7f648806a870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f649c000f70 tx=0x7f649c000ee0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:30.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.505+0000 7f64a2a00640 1 -- 172.21.15.28:0/3299756330 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f64ac0cd8a0 con 0x7f64ac157f30 2024-04-23T18:22:30.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.673+0000 7f64b0c00640 1 -- 172.21.15.28:0/3299756330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f64ac1eea70 con 0x7f64ac157f30 2024-04-23T18:22:30.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.673+0000 7f64a2a00640 1 -- 172.21.15.28:0/3299756330 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f6494016990 con 0x7f64ac157f30 2024-04-23T18:22:30.671 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:30.671 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2024-04-23T18:22:30.671 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-04-23T18:22:30.671 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2024-04-23T18:22:30.671 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2024-04-23T18:22:30.671 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:22:30.672 INFO:teuthology.orchestra.run.smithi028.stdout:] 2024-04-23T18:22:30.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 -- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f64880683b0 msgr2=0x7f648806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f64880683b0 0x7f648806a870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f649c000f70 tx=0x7f649c000ee0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 -- 172.21.15.28:0/3299756330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64ac157f30 msgr2=0x7f64ac0ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64ac157f30 0x7f64ac0ca250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f649401c6f0 tx=0x7f6494009750 comp rx=0 tx=0).stop 2024-04-23T18:22:30.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 -- 172.21.15.28:0/3299756330 shutdown_connections 2024-04-23T18:22:30.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f64880683b0 0x7f648806a870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64ac0ca790 0x7f64ac1eee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64ac157f30 0x7f64ac0ca250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 --2- 172.21.15.28:0/3299756330 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6490004810 0x7f64ac142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 -- 172.21.15.28:0/3299756330 >> 172.21.15.28:0/3299756330 conn(0x7f64ac075e30 msgr2=0x7f64ac06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:30.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 -- 172.21.15.28:0/3299756330 shutdown_connections 2024-04-23T18:22:30.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.677+0000 7f64b0c00640 1 -- 172.21.15.28:0/3299756330 wait complete. 2024-04-23T18:22:30.691 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-23T18:22:30.692 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-23T18:22:30.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.841+0000 7f4d7a200640 1 Processor -- start 2024-04-23T18:22:30.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.841+0000 7f4d7a200640 1 -- start start 2024-04-23T18:22:30.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.841+0000 7f4d7a200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d74070070 0x7f4d7415f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.841+0000 7f4d7a200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7415b0b0 con 0x7f4d74144470 2024-04-23T18:22:30.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.841+0000 7f4d7a200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7415b330 con 0x7f4d7415ce60 2024-04-23T18:22:30.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.841+0000 7f4d7a200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4d7415b610 con 0x7f4d74070070 2024-04-23T18:22:30.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.841+0000 7f4d73400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4d74144470 0x7f4d7415c750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60382/0 (socket says 172.21.15.28:60382) 2024-04-23T18:22:30.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.841+0000 7f4d73400640 1 -- 172.21.15.28:0/379323668 learned_addr learned my addr 172.21.15.28:0/379323668 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:30.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.841+0000 7f4d6aa00640 1 --2- 172.21.15.28:0/379323668 >> v2:172.21.15.137:3300/0 conn(0x7f4d74070070 0x7f4d7415f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996143823 0 0) 0x7f4d64001120 con 0x7f4d74144470 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d58003530 con 0x7f4d74144470 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3848183571 0 0) 0x7f4d58003530 con 0x7f4d74144470 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 >> v2:172.21.15.137:3300/0 conn(0x7f4d74070070 msgr2=0x7f4d7415f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 --2- 172.21.15.28:0/379323668 >> v2:172.21.15.137:3300/0 conn(0x7f4d74070070 0x7f4d7415f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 >> v1:172.21.15.137:6789/0 conn(0x7f4d7415ce60 legacy=0x7f4d740676e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7415b8f0 con 0x7f4d74144470 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f4d64001850 con 0x7f4d74144470 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 >> v1:172.21.15.28:6789/0 conn(0x7f4d74144470 legacy=0x7f4d7415c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 --2- 172.21.15.28:0/379323668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d580039c0 0x7f4d58003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 --2- 172.21.15.28:0/379323668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d58004810 0x7f4d58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 --2- 172.21.15.28:0/379323668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d580051d0 0x7f4d5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7415b610 con 0x7f4d58004810 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5800c080 con 0x7f4d580051d0 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4d5800c280 con 0x7f4d580039c0 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d6aa00640 1 --2- 172.21.15.28:0/379323668 >> v2:172.21.15.137:3300/0 conn(0x7f4d74070070 0x7f4d7415f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d6aa00640 1 --2- 172.21.15.28:0/379323668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d58004810 0x7f4d58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d73400640 1 --2- 172.21.15.28:0/379323668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d580039c0 0x7f4d58003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d73e00640 1 --2- 172.21.15.28:0/379323668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d580051d0 0x7f4d5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d6aa00640 1 -- 172.21.15.28:0/379323668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d580039c0 msgr2=0x7f4d58003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d6aa00640 1 --2- 172.21.15.28:0/379323668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d580039c0 0x7f4d58003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d6aa00640 1 -- 172.21.15.28:0/379323668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d580051d0 msgr2=0x7f4d5800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d6aa00640 1 --2- 172.21.15.28:0/379323668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d580051d0 0x7f4d5800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d6aa00640 1 -- 172.21.15.28:0/379323668 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d58003530 con 0x7f4d58004810 2024-04-23T18:22:30.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.845+0000 7f4d73e00640 1 -- 172.21.15.28:0/379323668 reap_dead start 2024-04-23T18:22:30.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d6aa00640 1 --2- 172.21.15.28:0/379323668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d58004810 0x7f4d58004c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009c90 tx=0x7f4d5c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab08cbc9f0d60305 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:30.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c009860 con 0x7f4d58004810 2024-04-23T18:22:30.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c004020 con 0x7f4d58004810 2024-04-23T18:22:30.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d72a00640 1 -- 172.21.15.28:0/379323668 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c004450 con 0x7f4d58004810 2024-04-23T18:22:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 -- 172.21.15.28:0/379323668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d58004810 msgr2=0x7f4d58004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 --2- 172.21.15.28:0/379323668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d58004810 0x7f4d58004c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009c90 tx=0x7f4d5c01cbf0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 -- 172.21.15.28:0/379323668 shutdown_connections 2024-04-23T18:22:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 --2- 172.21.15.28:0/379323668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d58004810 0x7f4d58004c90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 -- 172.21.15.28:0/379323668 >> 172.21.15.28:0/379323668 conn(0x7f4d740cd740 msgr2=0x7f4d740cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 -- 172.21.15.28:0/379323668 shutdown_connections 2024-04-23T18:22:30.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 -- 172.21.15.28:0/379323668 wait complete. 2024-04-23T18:22:30.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 Processor -- start 2024-04-23T18:22:30.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 -- start start 2024-04-23T18:22:30.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d58004810 0x7f4d741559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d74141400 0x7f4d74140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d740c6c10 0x7f4d740c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74144850 con 0x7f4d74141400 2024-04-23T18:22:30.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7415beb0 con 0x7f4d740c6c10 2024-04-23T18:22:30.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d7a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7415f0b0 con 0x7f4d58004810 2024-04-23T18:22:30.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d6aa00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d74141400 0x7f4d74140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d6aa00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d74141400 0x7f4d74140cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38546/0 (socket says 172.21.15.28:38546) 2024-04-23T18:22:30.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.849+0000 7f4d6aa00640 1 -- 172.21.15.28:0/2334549120 learned_addr learned my addr 172.21.15.28:0/2334549120 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d73e00640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d740c6c10 0x7f4d740c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d73400640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d58004810 0x7f4d741559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d6aa00640 1 -- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d58004810 msgr2=0x7f4d741559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d6aa00640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d58004810 0x7f4d741559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d6aa00640 1 -- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d740c6c10 msgr2=0x7f4d740c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d6aa00640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d740c6c10 0x7f4d740c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d6aa00640 1 -- 172.21.15.28:0/2334549120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d74141200 con 0x7f4d74141400 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d6aa00640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d74141400 0x7f4d74140cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c01ca20 tx=0x7f4d58005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d6be00640 1 -- 172.21.15.28:0/2334549120 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c005db0 con 0x7f4d74141400 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d6be00640 1 -- 172.21.15.28:0/2334549120 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c0bc070 con 0x7f4d74141400 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d7a200640 1 -- 172.21.15.28:0/2334549120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d741f1a40 con 0x7f4d74141400 2024-04-23T18:22:30.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d6be00640 1 -- 172.21.15.28:0/2334549120 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0a5ab0 con 0x7f4d74141400 2024-04-23T18:22:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d7a200640 1 -- 172.21.15.28:0/2334549120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d740c4f90 con 0x7f4d74141400 2024-04-23T18:22:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d7a200640 1 -- 172.21.15.28:0/2334549120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d74068e50 con 0x7f4d74141400 2024-04-23T18:22:30.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.853+0000 7f4d6be00640 1 -- 172.21.15.28:0/2334549120 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d5c0a5c50 con 0x7f4d74141400 2024-04-23T18:22:30.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.857+0000 7f4d6be00640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4d500683b0 0x7f4d5006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:30.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.857+0000 7f4d6be00640 1 -- 172.21.15.28:0/2334549120 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4d5c120fd0 con 0x7f4d74141400 2024-04-23T18:22:30.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.857+0000 7f4d73400640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4d500683b0 0x7f4d5006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:30.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.857+0000 7f4d73400640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4d500683b0 0x7f4d5006a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d64001300 tx=0x7f4d64009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:30.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:30.861+0000 7f4d6be00640 1 -- 172.21.15.28:0/2334549120 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d74141200 con 0x7f4d74141400 2024-04-23T18:22:31.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.025+0000 7f4d7a200640 1 -- 172.21.15.28:0/2334549120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4d740c8280 con 0x7f4d74141400 2024-04-23T18:22:31.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.329+0000 7f4d6be00640 1 -- 172.21.15.28:0/2334549120 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f4d5c016900 con 0x7f4d74141400 2024-04-23T18:22:31.327 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2024-04-23T18:22:31.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 -- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4d500683b0 msgr2=0x7f4d5006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:31.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4d500683b0 0x7f4d5006a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d64001300 tx=0x7f4d64009040 comp rx=0 tx=0).stop 2024-04-23T18:22:31.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 -- 172.21.15.28:0/2334549120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d74141400 msgr2=0x7f4d74140cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:31.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d74141400 0x7f4d74140cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c01ca20 tx=0x7f4d58005840 comp rx=0 tx=0).stop 2024-04-23T18:22:31.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 -- 172.21.15.28:0/2334549120 shutdown_connections 2024-04-23T18:22:31.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4d500683b0 0x7f4d5006a870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:31.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d740c6c10 0x7f4d740c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:31.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d74141400 0x7f4d74140cc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:31.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 --2- 172.21.15.28:0/2334549120 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4d58004810 0x7f4d741559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:31.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 -- 172.21.15.28:0/2334549120 >> 172.21.15.28:0/2334549120 conn(0x7f4d740cd740 msgr2=0x7f4d740ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:31.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 -- 172.21.15.28:0/2334549120 shutdown_connections 2024-04-23T18:22:31.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.333+0000 7f4d7a200640 1 -- 172.21.15.28:0/2334549120 wait complete. 2024-04-23T18:22:31.356 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-23T18:22:31.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e14400640 1 Processor -- start 2024-04-23T18:22:31.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e14400640 1 -- start start 2024-04-23T18:22:31.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e14400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e0c1555a0 0x7f6e0c06f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:31.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e14400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6e0c06b9e0 0x7f6e0c0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:31.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e14400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e0c0c9690 con 0x7f6e0c15bf70 2024-04-23T18:22:31.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e14400640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f6e0c155980 con 0x7f6e0c06b9e0 2024-04-23T18:22:31.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e14400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e0c15b1d0 con 0x7f6e0c1555a0 2024-04-23T18:22:31.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e12400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6e0c06b9e0 0x7f6e0c0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:31.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e12400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6e0c06b9e0 0x7f6e0c0cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38556/0 (socket says 172.21.15.28:38556) 2024-04-23T18:22:31.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e12400640 1 -- 172.21.15.28:0/3554117076 learned_addr learned my addr 172.21.15.28:0/3554117076 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:31.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e11a00640 1 --2- 172.21.15.28:0/3554117076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e0c1555a0 0x7f6e0c06f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:31.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e12400640 1 -- 172.21.15.28:0/3554117076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e0c1555a0 msgr2=0x7f6e0c06f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:31.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e12400640 1 --2- 172.21.15.28:0/3554117076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e0c1555a0 0x7f6e0c06f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:31.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e12400640 1 -- 172.21.15.28:0/3554117076 >> v1:172.21.15.137:6789/0 conn(0x7f6e0c15bf70 legacy=0x7f6e0c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:31.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.509+0000 7f6e12400640 1 -- 172.21.15.28:0/3554117076 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c06c300 con 0x7f6e0c06b9e0 2024-04-23T18:22:31.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e12400640 1 --2- 172.21.15.28:0/3554117076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c06b9e0 0x7f6e0c0cb3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009870 tx=0x7f6e0401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cef678c9f697d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:31.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e0be00640 1 -- 172.21.15.28:0/3554117076 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e040b5070 con 0x7f6e0c06b9e0 2024-04-23T18:22:31.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e0be00640 1 -- 172.21.15.28:0/3554117076 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040a8a50 con 0x7f6e0c06b9e0 2024-04-23T18:22:31.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e0be00640 1 -- 172.21.15.28:0/3554117076 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e040a8e20 con 0x7f6e0c06b9e0 2024-04-23T18:22:31.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e14400640 1 -- 172.21.15.28:0/3554117076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c06b9e0 msgr2=0x7f6e0c0cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:31.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e14400640 1 --2- 172.21.15.28:0/3554117076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c06b9e0 0x7f6e0c0cb3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009870 tx=0x7f6e0401ed50 comp rx=0 tx=0).stop 2024-04-23T18:22:31.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e14400640 1 -- 172.21.15.28:0/3554117076 shutdown_connections 2024-04-23T18:22:31.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e14400640 1 --2- 172.21.15.28:0/3554117076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c06b9e0 0x7f6e0c0cb3f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:31.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e14400640 1 --2- 172.21.15.28:0/3554117076 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e0c1555a0 0x7f6e0c06f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:31.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e14400640 1 -- 172.21.15.28:0/3554117076 >> 172.21.15.28:0/3554117076 conn(0x7f6e0c0676e0 msgr2=0x7f6e0c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:31.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e14400640 1 -- 172.21.15.28:0/3554117076 shutdown_connections 2024-04-23T18:22:31.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.513+0000 7f6e14400640 1 -- 172.21.15.28:0/3554117076 wait complete. 2024-04-23T18:22:31.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e14400640 1 Processor -- start 2024-04-23T18:22:31.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e14400640 1 -- start start 2024-04-23T18:22:31.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e14400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e0c06b9e0 0x7f6e0c1425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:31.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e14400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1555a0 0x7f6e0c13c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:31.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e14400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e0c15bf70 0x7f6e0c140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:31.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e14400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c15b770 con 0x7f6e0c1555a0 2024-04-23T18:22:31.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e14400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c15b490 con 0x7f6e0c06b9e0 2024-04-23T18:22:31.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e14400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e0c06be90 con 0x7f6e0c15bf70 2024-04-23T18:22:31.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e11000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1555a0 0x7f6e0c13c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:31.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e11000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1555a0 0x7f6e0c13c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38560/0 (socket says 172.21.15.28:38560) 2024-04-23T18:22:31.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e11000640 1 -- 172.21.15.28:0/87213911 learned_addr learned my addr 172.21.15.28:0/87213911 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:31.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e11a00640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e0c06b9e0 0x7f6e0c1425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:31.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e12400640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e0c15bf70 0x7f6e0c140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:31.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e11000640 1 -- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e0c15bf70 msgr2=0x7f6e0c140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:31.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e11000640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e0c15bf70 0x7f6e0c140970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:31.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e11000640 1 -- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e0c06b9e0 msgr2=0x7f6e0c1425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:31.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e11000640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e0c06b9e0 0x7f6e0c1425e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:31.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e11000640 1 -- 172.21.15.28:0/87213911 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c0c8780 con 0x7f6e0c1555a0 2024-04-23T18:22:31.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e12400640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e0c15bf70 0x7f6e0c140970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:31.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e11000640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1555a0 0x7f6e0c13c690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6df800c3a0 tx=0x7f6df800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:31.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e09600640 1 -- 172.21.15.28:0/87213911 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df80052d0 con 0x7f6e0c1555a0 2024-04-23T18:22:31.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e09600640 1 -- 172.21.15.28:0/87213911 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df8005470 con 0x7f6e0c1555a0 2024-04-23T18:22:31.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e14400640 1 -- 172.21.15.28:0/87213911 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0c0c8a20 con 0x7f6e0c1555a0 2024-04-23T18:22:31.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e09600640 1 -- 172.21.15.28:0/87213911 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8007260 con 0x7f6e0c1555a0 2024-04-23T18:22:31.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.517+0000 7f6e14400640 1 -- 172.21.15.28:0/87213911 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e0c140170 con 0x7f6e0c1555a0 2024-04-23T18:22:31.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.521+0000 7f6e14400640 1 -- 172.21.15.28:0/87213911 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e0c068db0 con 0x7f6e0c1555a0 2024-04-23T18:22:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.521+0000 7f6e09600640 1 -- 172.21.15.28:0/87213911 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6df8007400 con 0x7f6e0c1555a0 2024-04-23T18:22:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.521+0000 7f6e09600640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6dec068380 0x7f6dec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.521+0000 7f6e09600640 1 -- 172.21.15.28:0/87213911 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f6df8086510 con 0x7f6e0c1555a0 2024-04-23T18:22:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.521+0000 7f6e11a00640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6dec068380 0x7f6dec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.521+0000 7f6e11a00640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6dec068380 0x7f6dec06a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6e00003fd0 tx=0x7f6e000039a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:31.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.525+0000 7f6e09600640 1 -- 172.21.15.28:0/87213911 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6e0c0c9690 con 0x7f6e0c1555a0 2024-04-23T18:22:31.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:31.689+0000 7f6e14400640 1 -- 172.21.15.28:0/87213911 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f6e0c0c5920 con 0x7f6e0c1555a0 2024-04-23T18:22:32.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.341+0000 7f6e09600640 1 -- 172.21.15.28:0/87213911 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f6df8056c90 con 0x7f6e0c1555a0 2024-04-23T18:22:32.336 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2024-04-23T18:22:32.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 -- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6dec068380 msgr2=0x7f6dec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:32.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6dec068380 0x7f6dec06a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6e00003fd0 tx=0x7f6e000039a0 comp rx=0 tx=0).stop 2024-04-23T18:22:32.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 -- 172.21.15.28:0/87213911 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1555a0 msgr2=0x7f6e0c13c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:32.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1555a0 0x7f6e0c13c690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6df800c3a0 tx=0x7f6df800c860 comp rx=0 tx=0).stop 2024-04-23T18:22:32.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 -- 172.21.15.28:0/87213911 shutdown_connections 2024-04-23T18:22:32.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6dec068380 0x7f6dec06a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:32.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e0c15bf70 0x7f6e0c140970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:32.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e0c1555a0 0x7f6e0c13c690 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:32.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 --2- 172.21.15.28:0/87213911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e0c06b9e0 0x7f6e0c1425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:32.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 -- 172.21.15.28:0/87213911 >> 172.21.15.28:0/87213911 conn(0x7f6e0c0676e0 msgr2=0x7f6e0c15a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:32.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 -- 172.21.15.28:0/87213911 shutdown_connections 2024-04-23T18:22:32.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.345+0000 7f6e14400640 1 -- 172.21.15.28:0/87213911 wait complete. 2024-04-23T18:22:32.383 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-23T18:22:32.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa292200640 1 Processor -- start 2024-04-23T18:22:32.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa292200640 1 -- start start 2024-04-23T18:22:32.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa292200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa28c073050 0x7fa28c158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:32.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa292200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa28c0c9e50 0x7fa28c0c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:32.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa292200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa28c073520 con 0x7fa28c14f8d0 2024-04-23T18:22:32.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa292200640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fa28c073da0 con 0x7fa28c0c9e50 2024-04-23T18:22:32.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa292200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa28c0737e0 con 0x7fa28c073050 2024-04-23T18:22:32.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa28be00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa28c0c9e50 0x7fa28c0c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:32.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa28be00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa28c0c9e50 0x7fa28c0c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38566/0 (socket says 172.21.15.28:38566) 2024-04-23T18:22:32.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa28be00640 1 -- 172.21.15.28:0/1644175626 learned_addr learned my addr 172.21.15.28:0/1644175626 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:32.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa283e00640 1 --2- 172.21.15.28:0/1644175626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa28c073050 0x7fa28c158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:32.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa28be00640 1 -- 172.21.15.28:0/1644175626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa28c073050 msgr2=0x7fa28c158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:32.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa28be00640 1 --2- 172.21.15.28:0/1644175626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa28c073050 0x7fa28c158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:32.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa28be00640 1 -- 172.21.15.28:0/1644175626 >> v1:172.21.15.137:6789/0 conn(0x7fa28c14f8d0 legacy=0x7fa28c0c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:32.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.533+0000 7fa28be00640 1 -- 172.21.15.28:0/1644175626 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c073ac0 con 0x7fa28c0c9e50 2024-04-23T18:22:32.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa28be00640 1 --2- 172.21.15.28:0/1644175626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa28c0c9e50 0x7fa28c0c6900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa284009e50 tx=0x7fa28401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97d44ae785e9585 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:32.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa28aa00640 1 -- 172.21.15.28:0/1644175626 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2840a5850 con 0x7fa28c0c9e50 2024-04-23T18:22:32.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa28aa00640 1 -- 172.21.15.28:0/1644175626 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2840a59f0 con 0x7fa28c0c9e50 2024-04-23T18:22:32.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa28aa00640 1 -- 172.21.15.28:0/1644175626 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2840a5dc0 con 0x7fa28c0c9e50 2024-04-23T18:22:32.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa292200640 1 -- 172.21.15.28:0/1644175626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa28c0c9e50 msgr2=0x7fa28c0c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:32.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa292200640 1 --2- 172.21.15.28:0/1644175626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa28c0c9e50 0x7fa28c0c6900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa284009e50 tx=0x7fa28401c970 comp rx=0 tx=0).stop 2024-04-23T18:22:32.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa292200640 1 -- 172.21.15.28:0/1644175626 shutdown_connections 2024-04-23T18:22:32.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa292200640 1 --2- 172.21.15.28:0/1644175626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa28c0c9e50 0x7fa28c0c6900 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:32.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa292200640 1 --2- 172.21.15.28:0/1644175626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa28c073050 0x7fa28c158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:32.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa292200640 1 -- 172.21.15.28:0/1644175626 >> 172.21.15.28:0/1644175626 conn(0x7fa28c0c9330 msgr2=0x7fa28c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:32.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa292200640 1 -- 172.21.15.28:0/1644175626 shutdown_connections 2024-04-23T18:22:32.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.537+0000 7fa292200640 1 -- 172.21.15.28:0/1644175626 wait complete. 2024-04-23T18:22:32.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa292200640 1 Processor -- start 2024-04-23T18:22:32.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa292200640 1 -- start start 2024-04-23T18:22:32.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa292200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa28c073050 0x7fa28c1f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa292200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa28c0c9e50 0x7fa28c14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa292200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa28c14f8d0 0x7fa28c156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa292200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c0c7940 con 0x7fa28c14f8d0 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa292200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c14fcb0 con 0x7fa28c073050 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa292200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa28c0c7ac0 con 0x7fa28c0c9e50 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa28be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa28c14f8d0 0x7fa28c156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa28be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa28c14f8d0 0x7fa28c156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38578/0 (socket says 172.21.15.28:38578) 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa28be00640 1 -- 172.21.15.28:0/3050731942 learned_addr learned my addr 172.21.15.28:0/3050731942 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa28b400640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa28c073050 0x7fa28c1f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa283e00640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa28c0c9e50 0x7fa28c14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa28be00640 1 -- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa28c0c9e50 msgr2=0x7fa28c14e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:32.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa28be00640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa28c0c9e50 0x7fa28c14e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:32.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa28be00640 1 -- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa28c073050 msgr2=0x7fa28c1f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:32.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa28be00640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa28c073050 0x7fa28c1f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:32.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa28be00640 1 -- 172.21.15.28:0/3050731942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c0c4c70 con 0x7fa28c14f8d0 2024-04-23T18:22:32.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa28b400640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa28c073050 0x7fa28c1f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:32.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa28be00640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa28c14f8d0 0x7fa28c156a50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa28401a5a0 tx=0x7fa284019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:32.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa283400640 1 -- 172.21.15.28:0/3050731942 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2840bc020 con 0x7fa28c14f8d0 2024-04-23T18:22:32.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa283400640 1 -- 172.21.15.28:0/3050731942 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2840b8670 con 0x7fa28c14f8d0 2024-04-23T18:22:32.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa283400640 1 -- 172.21.15.28:0/3050731942 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2840b8a60 con 0x7fa28c14f8d0 2024-04-23T18:22:32.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa292200640 1 -- 172.21.15.28:0/3050731942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28c157f30 con 0x7fa28c14f8d0 2024-04-23T18:22:32.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.541+0000 7fa292200640 1 -- 172.21.15.28:0/3050731942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28c1584f0 con 0x7fa28c14f8d0 2024-04-23T18:22:32.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.545+0000 7fa292200640 1 -- 172.21.15.28:0/3050731942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa28c068db0 con 0x7fa28c14f8d0 2024-04-23T18:22:32.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.545+0000 7fa283400640 1 -- 172.21.15.28:0/3050731942 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa2840bf020 con 0x7fa28c14f8d0 2024-04-23T18:22:32.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.545+0000 7fa283400640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa268068380 0x7fa26806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:32.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.545+0000 7fa283400640 1 -- 172.21.15.28:0/3050731942 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fa284121850 con 0x7fa28c14f8d0 2024-04-23T18:22:32.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.545+0000 7fa28b400640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa268068380 0x7fa26806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:32.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.545+0000 7fa28b400640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa268068380 0x7fa26806a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa27c001670 tx=0x7fa27c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:32.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.549+0000 7fa283400640 1 -- 172.21.15.28:0/3050731942 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa2840c6030 con 0x7fa28c14f8d0 2024-04-23T18:22:32.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:32.753+0000 7fa292200640 1 -- 172.21.15.28:0/3050731942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa28c14b570 con 0x7fa28c14f8d0 2024-04-23T18:22:33.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.361+0000 7fa283400640 1 -- 172.21.15.28:0/3050731942 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fa284016620 con 0x7fa28c14f8d0 2024-04-23T18:22:33.359 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 2 and data pool 3 2024-04-23T18:22:33.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.365+0000 7fa292200640 1 -- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa268068380 msgr2=0x7fa26806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:33.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.365+0000 7fa292200640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa268068380 0x7fa26806a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa27c001670 tx=0x7fa27c009040 comp rx=0 tx=0).stop 2024-04-23T18:22:33.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.365+0000 7fa292200640 1 -- 172.21.15.28:0/3050731942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa28c14f8d0 msgr2=0x7fa28c156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:33.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.365+0000 7fa292200640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa28c14f8d0 0x7fa28c156a50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa28401a5a0 tx=0x7fa284019710 comp rx=0 tx=0).stop 2024-04-23T18:22:33.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.369+0000 7fa292200640 1 -- 172.21.15.28:0/3050731942 shutdown_connections 2024-04-23T18:22:33.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.369+0000 7fa292200640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa268068380 0x7fa26806a840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:33.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.369+0000 7fa292200640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa28c0c9e50 0x7fa28c14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:33.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.369+0000 7fa292200640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa28c14f8d0 0x7fa28c156a50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:33.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.369+0000 7fa292200640 1 --2- 172.21.15.28:0/3050731942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa28c073050 0x7fa28c1f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:33.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.369+0000 7fa292200640 1 -- 172.21.15.28:0/3050731942 >> 172.21.15.28:0/3050731942 conn(0x7fa28c0c9330 msgr2=0x7fa28c06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:33.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.369+0000 7fa292200640 1 -- 172.21.15.28:0/3050731942 shutdown_connections 2024-04-23T18:22:33.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.369+0000 7fa292200640 1 -- 172.21.15.28:0/3050731942 wait complete. 2024-04-23T18:22:33.392 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-23T18:22:33.392 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-23T18:22:33.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.541+0000 7f6661800640 1 Processor -- start 2024-04-23T18:22:33.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f6661800640 1 -- start start 2024-04-23T18:22:33.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f6661800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f665c0cea60 0x7f665c06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:33.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f6661800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665c15e930 con 0x7f665c0cee40 2024-04-23T18:22:33.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f6661800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665c15ec10 con 0x7f665c0c92f0 2024-04-23T18:22:33.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f6661800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f665c15eef0 con 0x7f665c0cea60 2024-04-23T18:22:33.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f665aa00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f665c0cea60 0x7f665c06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:33.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f665b400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f665c0cee40 0x7f665c15b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60392/0 (socket says 172.21.15.28:60392) 2024-04-23T18:22:33.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f665b400640 1 -- 172.21.15.28:0/2009384917 learned_addr learned my addr 172.21.15.28:0/2009384917 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:33.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f665aa00640 1 -- 172.21.15.28:0/2009384917 >> v1:172.21.15.137:6789/0 conn(0x7f665c0c92f0 legacy=0x7f665c144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:33.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f665aa00640 1 -- 172.21.15.28:0/2009384917 >> v1:172.21.15.28:6789/0 conn(0x7f665c0cee40 legacy=0x7f665c15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:33.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f665aa00640 1 -- 172.21.15.28:0/2009384917 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c15f1d0 con 0x7f665c0cea60 2024-04-23T18:22:33.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.545+0000 7f665a000640 1 -- 172.21.15.28:0/2009384917 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2057840511 0 0) 0x7f665c15e930 con 0x7f665c0cee40 2024-04-23T18:22:33.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f665aa00640 1 --2- 172.21.15.28:0/2009384917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665c0cea60 0x7f665c06c3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f664c0097c0 tx=0x7f664c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec2114832f28041 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:33.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f665a000640 1 -- 172.21.15.28:0/2009384917 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c0b0070 con 0x7f665c0cea60 2024-04-23T18:22:33.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f665a000640 1 -- 172.21.15.28:0/2009384917 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c0ab600 con 0x7f665c0cea60 2024-04-23T18:22:33.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f665a000640 1 -- 172.21.15.28:0/2009384917 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c0ab9d0 con 0x7f665c0cea60 2024-04-23T18:22:33.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f6661800640 1 -- 172.21.15.28:0/2009384917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665c0cea60 msgr2=0x7f665c06c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:33.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f6661800640 1 --2- 172.21.15.28:0/2009384917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665c0cea60 0x7f665c06c3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f664c0097c0 tx=0x7f664c01c460 comp rx=0 tx=0).stop 2024-04-23T18:22:33.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f6661800640 1 -- 172.21.15.28:0/2009384917 shutdown_connections 2024-04-23T18:22:33.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f6661800640 1 --2- 172.21.15.28:0/2009384917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665c0cea60 0x7f665c06c3f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:33.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f6661800640 1 -- 172.21.15.28:0/2009384917 >> 172.21.15.28:0/2009384917 conn(0x7f665c070b60 msgr2=0x7f665c070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:33.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f6661800640 1 -- 172.21.15.28:0/2009384917 shutdown_connections 2024-04-23T18:22:33.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f6661800640 1 -- 172.21.15.28:0/2009384917 wait complete. 2024-04-23T18:22:33.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f6661800640 1 Processor -- start 2024-04-23T18:22:33.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.549+0000 7f6661800640 1 -- start start 2024-04-23T18:22:33.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6661800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f665c0c92f0 0x7f665c13f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:33.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6661800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665c0cea60 0x7f665c0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6661800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f665c0cee40 0x7f665c0c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6661800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f665c169720 con 0x7f665c0cea60 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6661800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f665c144aa0 con 0x7f665c0c92f0 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6661800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f665c1698a0 con 0x7f665c0cee40 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6653e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665c0cea60 0x7f665c0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6653e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665c0cea60 0x7f665c0c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38610/0 (socket says 172.21.15.28:38610) 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6653e00640 1 -- 172.21.15.28:0/96960159 learned_addr learned my addr 172.21.15.28:0/96960159 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f665aa00640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f665c0c92f0 0x7f665c13f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f665b400640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f665c0cee40 0x7f665c0c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6653e00640 1 -- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f665c0cee40 msgr2=0x7f665c0c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6653e00640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f665c0cee40 0x7f665c0c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6653e00640 1 -- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f665c0c92f0 msgr2=0x7f665c13f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6653e00640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f665c0c92f0 0x7f665c13f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:33.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6653e00640 1 -- 172.21.15.28:0/96960159 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c158f20 con 0x7f665c0cea60 2024-04-23T18:22:33.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6653e00640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665c0cea60 0x7f665c0c8100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f664400c460 tx=0x7f664400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:33.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6652a00640 1 -- 172.21.15.28:0/96960159 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644016020 con 0x7f665c0cea60 2024-04-23T18:22:33.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6652a00640 1 -- 172.21.15.28:0/96960159 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6644012870 con 0x7f665c0cea60 2024-04-23T18:22:33.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6661800640 1 -- 172.21.15.28:0/96960159 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665c1f4b80 con 0x7f665c0cea60 2024-04-23T18:22:33.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6652a00640 1 -- 172.21.15.28:0/96960159 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644012c60 con 0x7f665c0cea60 2024-04-23T18:22:33.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6661800640 1 -- 172.21.15.28:0/96960159 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c1f4e40 con 0x7f665c0cea60 2024-04-23T18:22:33.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6661800640 1 -- 172.21.15.28:0/96960159 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665c068e50 con 0x7f665c0cea60 2024-04-23T18:22:33.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.553+0000 7f6652a00640 1 -- 172.21.15.28:0/96960159 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6644019020 con 0x7f665c0cea60 2024-04-23T18:22:33.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.557+0000 7f6652a00640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6638068380 0x7f663806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:33.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.557+0000 7f6652a00640 1 -- 172.21.15.28:0/96960159 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f6644086720 con 0x7f665c0cea60 2024-04-23T18:22:33.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.557+0000 7f665aa00640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6638068380 0x7f663806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:33.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.557+0000 7f665aa00640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6638068380 0x7f663806a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f664c0ad000 tx=0x7f664c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:33.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.561+0000 7f6652a00640 1 -- 172.21.15.28:0/96960159 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f66440212a0 con 0x7f665c0cea60 2024-04-23T18:22:33.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:33.733+0000 7f6661800640 1 -- 172.21.15.28:0/96960159 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f665c0c9740 con 0x7f665c0cea60 2024-04-23T18:22:34.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.345+0000 7f6652a00640 1 -- 172.21.15.28:0/96960159 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f6644056cd0 con 0x7f665c0cea60 2024-04-23T18:22:34.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.345+0000 7f6661800640 1 -- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6638068380 msgr2=0x7f663806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:34.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.345+0000 7f6661800640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6638068380 0x7f663806a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f664c0ad000 tx=0x7f664c008040 comp rx=0 tx=0).stop 2024-04-23T18:22:34.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.349+0000 7f6661800640 1 -- 172.21.15.28:0/96960159 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665c0cea60 msgr2=0x7f665c0c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:34.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.349+0000 7f6661800640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665c0cea60 0x7f665c0c8100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f664400c460 tx=0x7f664400c920 comp rx=0 tx=0).stop 2024-04-23T18:22:34.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.349+0000 7f6661800640 1 -- 172.21.15.28:0/96960159 shutdown_connections 2024-04-23T18:22:34.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.349+0000 7f6661800640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6638068380 0x7f663806a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:34.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.349+0000 7f6661800640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f665c0cee40 0x7f665c0c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:34.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.349+0000 7f6661800640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f665c0cea60 0x7f665c0c8100 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:34.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.349+0000 7f6661800640 1 --2- 172.21.15.28:0/96960159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f665c0c92f0 0x7f665c13f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:34.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.349+0000 7f6661800640 1 -- 172.21.15.28:0/96960159 >> 172.21.15.28:0/96960159 conn(0x7f665c070b60 msgr2=0x7f665c0ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:34.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.349+0000 7f6661800640 1 -- 172.21.15.28:0/96960159 shutdown_connections 2024-04-23T18:22:34.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.349+0000 7f6661800640 1 -- 172.21.15.28:0/96960159 wait complete. 2024-04-23T18:22:34.366 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-23T18:22:34.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.521+0000 7f669da00640 1 Processor -- start 2024-04-23T18:22:34.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.521+0000 7f669da00640 1 -- start start 2024-04-23T18:22:34.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f669da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6698073b00 0x7f66980cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:34.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f669da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f66980cbe90 0x7f66980cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:34.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f669da00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66980c6c80 con 0x7f669815d210 2024-04-23T18:22:34.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f669da00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f669815c580 con 0x7f66980cbe90 2024-04-23T18:22:34.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f669da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f66980c6100 con 0x7f6698073b00 2024-04-23T18:22:34.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f6697400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f66980cbe90 0x7f66980cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:34.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f6696a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f669815d210 0x7f66981596c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:54458/0 (socket says 172.21.15.28:54458) 2024-04-23T18:22:34.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f6696a00640 1 -- 172.21.15.28:0/3788815022 learned_addr learned my addr 172.21.15.28:0/3788815022 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:34.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f668fe00640 1 --2- 172.21.15.28:0/3788815022 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6698073b00 0x7f66980cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:34.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f6697400640 1 -- 172.21.15.28:0/3788815022 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6698073b00 msgr2=0x7f66980cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:34.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f6697400640 1 --2- 172.21.15.28:0/3788815022 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6698073b00 0x7f66980cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:34.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f6697400640 1 -- 172.21.15.28:0/3788815022 >> v1:172.21.15.137:6789/0 conn(0x7f669815d210 legacy=0x7f66981596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:34.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f6697400640 1 -- 172.21.15.28:0/3788815022 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66980c63e0 con 0x7f66980cbe90 2024-04-23T18:22:34.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.525+0000 7f668fe00640 1 --2- 172.21.15.28:0/3788815022 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6698073b00 0x7f66980cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:34.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f6697400640 1 --2- 172.21.15.28:0/3788815022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980cbe90 0x7f66980cb820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6690009d90 tx=0x7f669001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=428f4bf5114b9eb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f6696000640 1 -- 172.21.15.28:0/3788815022 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900b2070 con 0x7f66980cbe90 2024-04-23T18:22:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f6696000640 1 -- 172.21.15.28:0/3788815022 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66900a5890 con 0x7f66980cbe90 2024-04-23T18:22:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f6696000640 1 -- 172.21.15.28:0/3788815022 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900a5c60 con 0x7f66980cbe90 2024-04-23T18:22:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f669da00640 1 -- 172.21.15.28:0/3788815022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980cbe90 msgr2=0x7f66980cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f669da00640 1 --2- 172.21.15.28:0/3788815022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980cbe90 0x7f66980cb820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6690009d90 tx=0x7f669001c8e0 comp rx=0 tx=0).stop 2024-04-23T18:22:34.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f669da00640 1 -- 172.21.15.28:0/3788815022 shutdown_connections 2024-04-23T18:22:34.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f669da00640 1 --2- 172.21.15.28:0/3788815022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980cbe90 0x7f66980cb820 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:34.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f669da00640 1 --2- 172.21.15.28:0/3788815022 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6698073b00 0x7f66980cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:34.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f669da00640 1 -- 172.21.15.28:0/3788815022 >> 172.21.15.28:0/3788815022 conn(0x7f6698072f30 msgr2=0x7f6698073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:34.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f669da00640 1 -- 172.21.15.28:0/3788815022 shutdown_connections 2024-04-23T18:22:34.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f669da00640 1 -- 172.21.15.28:0/3788815022 wait complete. 2024-04-23T18:22:34.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f669da00640 1 Processor -- start 2024-04-23T18:22:34.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.529+0000 7f669da00640 1 -- start start 2024-04-23T18:22:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f669da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6698073b00 0x7f6698145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f669da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980cbe90 0x7f66981f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f669da00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f669815d210 0x7f669814d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f669da00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f66980c5d50 con 0x7f669815d210 2024-04-23T18:22:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f669da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6698159dd0 con 0x7f66980cbe90 2024-04-23T18:22:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f669da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6698158c30 con 0x7f6698073b00 2024-04-23T18:22:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f6697400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f669815d210 0x7f669814d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f6697400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f669815d210 0x7f669814d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38612/0 (socket says 172.21.15.28:38612) 2024-04-23T18:22:34.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f6697400640 1 -- 172.21.15.28:0/2413843271 learned_addr learned my addr 172.21.15.28:0/2413843271 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:34.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f6696a00640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6698073b00 0x7f6698145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:34.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f668fe00640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980cbe90 0x7f66981f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f6697400640 1 -- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6698073b00 msgr2=0x7f6698145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f6697400640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6698073b00 0x7f6698145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f6697400640 1 -- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980cbe90 msgr2=0x7f66981f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f6697400640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980cbe90 0x7f66981f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f6697400640 1 -- 172.21.15.28:0/2413843271 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66981f8640 con 0x7f669815d210 2024-04-23T18:22:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f6697400640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f669815d210 0x7f669814d270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6690009d90 tx=0x7f6690019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f668ea00640 1 -- 172.21.15.28:0/2413843271 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900bd020 con 0x7f669815d210 2024-04-23T18:22:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f668ea00640 1 -- 172.21.15.28:0/2413843271 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66900b8470 con 0x7f669815d210 2024-04-23T18:22:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f669da00640 1 -- 172.21.15.28:0/2413843271 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6698158950 con 0x7f669815d210 2024-04-23T18:22:34.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f668ea00640 1 -- 172.21.15.28:0/2413843271 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900b2040 con 0x7f669815d210 2024-04-23T18:22:34.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f669da00640 1 -- 172.21.15.28:0/2413843271 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66981f7b60 con 0x7f669815d210 2024-04-23T18:22:34.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.533+0000 7f669da00640 1 -- 172.21.15.28:0/2413843271 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6698068db0 con 0x7f669815d210 2024-04-23T18:22:34.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.537+0000 7f668ea00640 1 -- 172.21.15.28:0/2413843271 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66900c0020 con 0x7f669815d210 2024-04-23T18:22:34.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.537+0000 7f668ea00640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6674068380 0x7f667406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:34.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.537+0000 7f668ea00640 1 -- 172.21.15.28:0/2413843271 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f66901218d0 con 0x7f669815d210 2024-04-23T18:22:34.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.537+0000 7f6696a00640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6674068380 0x7f667406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:34.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.537+0000 7f6696a00640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6674068380 0x7f667406a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6688000f70 tx=0x7f6688007e90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:34.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.541+0000 7f668ea00640 1 -- 172.21.15.28:0/2413843271 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f66900c7030 con 0x7f669815d210 2024-04-23T18:22:34.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:34.705+0000 7f669da00640 1 -- 172.21.15.28:0/2413843271 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f66980cad80 con 0x7f669815d210 2024-04-23T18:22:36.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.373+0000 7f668ea00640 1 -- 172.21.15.28:0/2413843271 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f6690016560 con 0x7f669815d210 2024-04-23T18:22:36.370 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data_ec' created 2024-04-23T18:22:36.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 -- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6674068380 msgr2=0x7f667406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:36.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6674068380 0x7f667406a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6688000f70 tx=0x7f6688007e90 comp rx=0 tx=0).stop 2024-04-23T18:22:36.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 -- 172.21.15.28:0/2413843271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f669815d210 msgr2=0x7f669814d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:36.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f669815d210 0x7f669814d270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6690009d90 tx=0x7f6690019680 comp rx=0 tx=0).stop 2024-04-23T18:22:36.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 -- 172.21.15.28:0/2413843271 shutdown_connections 2024-04-23T18:22:36.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6674068380 0x7f667406a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:36.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f669815d210 0x7f669814d270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:36.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66980cbe90 0x7f66981f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:36.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 --2- 172.21.15.28:0/2413843271 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6698073b00 0x7f6698145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:36.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 -- 172.21.15.28:0/2413843271 >> 172.21.15.28:0/2413843271 conn(0x7f6698072f30 msgr2=0x7f6698162c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:36.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 -- 172.21.15.28:0/2413843271 shutdown_connections 2024-04-23T18:22:36.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.377+0000 7f669da00640 1 -- 172.21.15.28:0/2413843271 wait complete. 2024-04-23T18:22:36.406 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-23T18:22:36.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a9c400640 1 Processor -- start 2024-04-23T18:22:36.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a9c400640 1 -- start start 2024-04-23T18:22:36.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a9c400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a94073220 0x7f6a940c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:36.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a9c400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6a94141d50 0x7f6a941421e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:36.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a9c400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a94158ff0 con 0x7f6a94073600 2024-04-23T18:22:36.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a9c400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6a94142720 con 0x7f6a94141d50 2024-04-23T18:22:36.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a9c400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9406f770 con 0x7f6a94073220 2024-04-23T18:22:36.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a9a400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6a94141d50 0x7f6a941421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:36.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a99a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a94073220 0x7f6a940c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:36.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a99000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6a94073600 0x7f6a9406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:54466/0 (socket says 172.21.15.28:54466) 2024-04-23T18:22:36.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a99000640 1 -- 172.21.15.28:0/3571493314 learned_addr learned my addr 172.21.15.28:0/3571493314 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:36.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a99a00640 1 -- 172.21.15.28:0/3571493314 >> v2:172.21.15.137:3300/0 conn(0x7f6a94141d50 msgr2=0x7f6a941421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:36.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a99a00640 1 --2- 172.21.15.28:0/3571493314 >> v2:172.21.15.137:3300/0 conn(0x7f6a94141d50 0x7f6a941421e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:36.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a99a00640 1 -- 172.21.15.28:0/3571493314 >> v1:172.21.15.137:6789/0 conn(0x7f6a94073600 legacy=0x7f6a9406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:36.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a99a00640 1 -- 172.21.15.28:0/3571493314 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a940c5f20 con 0x7f6a94073220 2024-04-23T18:22:36.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.561+0000 7f6a9a400640 1 --2- 172.21.15.28:0/3571493314 >> v2:172.21.15.137:3300/0 conn(0x7f6a94141d50 0x7f6a941421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:36.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a99a00640 1 --2- 172.21.15.28:0/3571493314 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a94073220 0x7f6a940c4540 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6a880097c0 tx=0x7f6a8801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd038da1f483a5e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:36.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a93e00640 1 -- 172.21.15.28:0/3571493314 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a880a7070 con 0x7f6a94073220 2024-04-23T18:22:36.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a93e00640 1 -- 172.21.15.28:0/3571493314 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a880b0070 con 0x7f6a94073220 2024-04-23T18:22:36.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a93e00640 1 -- 172.21.15.28:0/3571493314 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a880ab890 con 0x7f6a94073220 2024-04-23T18:22:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a9c400640 1 -- 172.21.15.28:0/3571493314 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a94073220 msgr2=0x7f6a940c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a9c400640 1 --2- 172.21.15.28:0/3571493314 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a94073220 0x7f6a940c4540 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6a880097c0 tx=0x7f6a8801c470 comp rx=0 tx=0).stop 2024-04-23T18:22:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a9c400640 1 -- 172.21.15.28:0/3571493314 shutdown_connections 2024-04-23T18:22:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a9c400640 1 --2- 172.21.15.28:0/3571493314 >> v2:172.21.15.137:3300/0 conn(0x7f6a94141d50 0x7f6a941421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a9c400640 1 --2- 172.21.15.28:0/3571493314 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a94073220 0x7f6a940c4540 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a9c400640 1 -- 172.21.15.28:0/3571493314 >> 172.21.15.28:0/3571493314 conn(0x7f6a9406d400 msgr2=0x7f6a940676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a9c400640 1 -- 172.21.15.28:0/3571493314 shutdown_connections 2024-04-23T18:22:36.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.565+0000 7f6a9c400640 1 -- 172.21.15.28:0/3571493314 wait complete. 2024-04-23T18:22:36.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a9c400640 1 Processor -- start 2024-04-23T18:22:36.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a9c400640 1 -- start start 2024-04-23T18:22:36.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a9c400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a94073220 0x7f6a94154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:36.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a9c400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a94073600 0x7f6a941402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a9c400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94141d50 0x7f6a941f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a9c400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6a940c71f0 con 0x7f6a94073220 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a9c400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a940c6aa0 con 0x7f6a94141d50 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a9c400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6a94165870 con 0x7f6a94073600 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a99a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a94073220 0x7f6a94154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a99a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a94073220 0x7f6a94154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38626/0 (socket says 172.21.15.28:38626) 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a99a00640 1 -- 172.21.15.28:0/2423648630 learned_addr learned my addr 172.21.15.28:0/2423648630 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a99000640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a94073600 0x7f6a941402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a9a400640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94141d50 0x7f6a941f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a99a00640 1 -- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a94073600 msgr2=0x7f6a941402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a99a00640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a94073600 0x7f6a941402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:36.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a99a00640 1 -- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94141d50 msgr2=0x7f6a941f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:36.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a99a00640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94141d50 0x7f6a941f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:36.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a99a00640 1 -- 172.21.15.28:0/2423648630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a94154880 con 0x7f6a94073220 2024-04-23T18:22:36.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a99a00640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a94073220 0x7f6a94154340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a8801a0a0 tx=0x7f6a8801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:36.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a91600640 1 -- 172.21.15.28:0/2423648630 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88006e20 con 0x7f6a94073220 2024-04-23T18:22:36.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a91600640 1 -- 172.21.15.28:0/2423648630 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a880bf630 con 0x7f6a94073220 2024-04-23T18:22:36.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a9c400640 1 -- 172.21.15.28:0/2423648630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a94154af0 con 0x7f6a94073220 2024-04-23T18:22:36.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a91600640 1 -- 172.21.15.28:0/2423648630 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a880bfa20 con 0x7f6a94073220 2024-04-23T18:22:36.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.569+0000 7f6a9c400640 1 -- 172.21.15.28:0/2423648630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a941f7340 con 0x7f6a94073220 2024-04-23T18:22:36.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.573+0000 7f6a9c400640 1 -- 172.21.15.28:0/2423648630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a94068e50 con 0x7f6a94073220 2024-04-23T18:22:36.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.573+0000 7f6a91600640 1 -- 172.21.15.28:0/2423648630 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a880bd020 con 0x7f6a94073220 2024-04-23T18:22:36.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.573+0000 7f6a91600640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a740683b0 0x7f6a7406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:36.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.573+0000 7f6a91600640 1 -- 172.21.15.28:0/2423648630 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f6a88121200 con 0x7f6a94073220 2024-04-23T18:22:36.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.573+0000 7f6a99000640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a740683b0 0x7f6a7406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:36.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.573+0000 7f6a99000640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a740683b0 0x7f6a7406a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a94155300 tx=0x7f6a80009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:36.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.577+0000 7f6a91600640 1 -- 172.21.15.28:0/2423648630 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a88016090 con 0x7f6a94073220 2024-04-23T18:22:36.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:36.745+0000 7f6a9c400640 1 -- 172.21.15.28:0/2423648630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f6a94140eb0 con 0x7f6a94073220 2024-04-23T18:22:37.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.381+0000 7f6a91600640 1 -- 172.21.15.28:0/2423648630 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f6a88121020 con 0x7f6a94073220 2024-04-23T18:22:37.379 INFO:teuthology.orchestra.run.smithi028.stderr:set pool 4 allow_ec_overwrites to true 2024-04-23T18:22:37.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.385+0000 7f6a9c400640 1 -- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a740683b0 msgr2=0x7f6a7406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:37.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.385+0000 7f6a9c400640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a740683b0 0x7f6a7406a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a94155300 tx=0x7f6a80009040 comp rx=0 tx=0).stop 2024-04-23T18:22:37.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.385+0000 7f6a9c400640 1 -- 172.21.15.28:0/2423648630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a94073220 msgr2=0x7f6a94154340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:37.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.385+0000 7f6a9c400640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a94073220 0x7f6a94154340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a8801a0a0 tx=0x7f6a8801acb0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.389+0000 7f6a9c400640 1 -- 172.21.15.28:0/2423648630 shutdown_connections 2024-04-23T18:22:37.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.389+0000 7f6a9c400640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a740683b0 0x7f6a7406a870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.389+0000 7f6a9c400640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a94073600 0x7f6a941402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.389+0000 7f6a9c400640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a94141d50 0x7f6a941f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.389+0000 7f6a9c400640 1 --2- 172.21.15.28:0/2423648630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a94073220 0x7f6a94154340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.389+0000 7f6a9c400640 1 -- 172.21.15.28:0/2423648630 >> 172.21.15.28:0/2423648630 conn(0x7f6a9406d400 msgr2=0x7f6a9406f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:37.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.389+0000 7f6a9c400640 1 -- 172.21.15.28:0/2423648630 shutdown_connections 2024-04-23T18:22:37.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.389+0000 7f6a9c400640 1 -- 172.21.15.28:0/2423648630 wait complete. 2024-04-23T18:22:37.431 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-23T18:22:37.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.577+0000 7fd266600640 1 Processor -- start 2024-04-23T18:22:37.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd266600640 1 -- start start 2024-04-23T18:22:37.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd266600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2601551b0 0x7fd26015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:37.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd266600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2600c9fc0 0x7fd2600ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:37.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd266600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd260073710 0x7fd260073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd266600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fd26015bbe0 con 0x7fd260073710 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd266600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd26015aff0 con 0x7fd2601551b0 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd266600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd26006c530 con 0x7fd2600c9fc0 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd25fe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd260073710 0x7fd260073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd25fe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd260073710 0x7fd260073ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38628/0 (socket says 172.21.15.28:38628) 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd25fe00640 1 -- 172.21.15.28:0/3682712912 learned_addr learned my addr 172.21.15.28:0/3682712912 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd256a00640 1 --2- 172.21.15.28:0/3682712912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2600c9fc0 0x7fd2600ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd25f400640 1 --2- 172.21.15.28:0/3682712912 >> v2:172.21.15.137:3300/0 conn(0x7fd2601551b0 0x7fd26015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd25fe00640 1 -- 172.21.15.28:0/3682712912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2600c9fc0 msgr2=0x7fd2600ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd25fe00640 1 --2- 172.21.15.28:0/3682712912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2600c9fc0 0x7fd2600ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd25fe00640 1 -- 172.21.15.28:0/3682712912 >> v2:172.21.15.137:3300/0 conn(0x7fd2601551b0 msgr2=0x7fd26015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd25fe00640 1 --2- 172.21.15.28:0/3682712912 >> v2:172.21.15.137:3300/0 conn(0x7fd2601551b0 0x7fd26015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.581+0000 7fd25fe00640 1 -- 172.21.15.28:0/3682712912 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26015b2b0 con 0x7fd260073710 2024-04-23T18:22:37.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd25fe00640 1 --2- 172.21.15.28:0/3682712912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd260073710 0x7fd260073ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd2600cf930 tx=0x7fd25801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18130a4eb3f41f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:37.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd25ea00640 1 -- 172.21.15.28:0/3682712912 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580a5670 con 0x7fd260073710 2024-04-23T18:22:37.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd25ea00640 1 -- 172.21.15.28:0/3682712912 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2580a5810 con 0x7fd260073710 2024-04-23T18:22:37.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd25ea00640 1 -- 172.21.15.28:0/3682712912 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580a5be0 con 0x7fd260073710 2024-04-23T18:22:37.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd266600640 1 -- 172.21.15.28:0/3682712912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd260073710 msgr2=0x7fd260073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:37.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd266600640 1 --2- 172.21.15.28:0/3682712912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd260073710 0x7fd260073ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd2600cf930 tx=0x7fd25801c9f0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd266600640 1 -- 172.21.15.28:0/3682712912 shutdown_connections 2024-04-23T18:22:37.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd266600640 1 --2- 172.21.15.28:0/3682712912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd260073710 0x7fd260073ba0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd266600640 1 --2- 172.21.15.28:0/3682712912 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2600c9fc0 0x7fd2600ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd266600640 1 --2- 172.21.15.28:0/3682712912 >> v2:172.21.15.137:3300/0 conn(0x7fd2601551b0 0x7fd26015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd266600640 1 -- 172.21.15.28:0/3682712912 >> 172.21.15.28:0/3682712912 conn(0x7fd2600676e0 msgr2=0x7fd260067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:37.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd266600640 1 -- 172.21.15.28:0/3682712912 shutdown_connections 2024-04-23T18:22:37.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd266600640 1 -- 172.21.15.28:0/3682712912 wait complete. 2024-04-23T18:22:37.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd266600640 1 Processor -- start 2024-04-23T18:22:37.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.585+0000 7fd266600640 1 -- start start 2024-04-23T18:22:37.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd266600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd260073710 0x7fd2601566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:37.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd266600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2600c9fc0 0x7fd2600c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:37.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd266600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2601551b0 0x7fd260157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:37.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd266600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd260070ba0 con 0x7fd2601551b0 2024-04-23T18:22:37.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd266600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd260070a20 con 0x7fd260073710 2024-04-23T18:22:37.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd266600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd260070d20 con 0x7fd2600c9fc0 2024-04-23T18:22:37.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd25fe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2601551b0 0x7fd260157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:37.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd25fe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2601551b0 0x7fd260157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38638/0 (socket says 172.21.15.28:38638) 2024-04-23T18:22:37.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd25fe00640 1 -- 172.21.15.28:0/240325982 learned_addr learned my addr 172.21.15.28:0/240325982 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd25f400640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd260073710 0x7fd2601566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd256a00640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2600c9fc0 0x7fd2600c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd25fe00640 1 -- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2600c9fc0 msgr2=0x7fd2600c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd25fe00640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2600c9fc0 0x7fd2600c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd25fe00640 1 -- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd260073710 msgr2=0x7fd2601566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd25fe00640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd260073710 0x7fd2601566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd25fe00640 1 -- 172.21.15.28:0/240325982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd260156bf0 con 0x7fd2601551b0 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd25fe00640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2601551b0 0x7fd260157b00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2580af040 tx=0x7fd258019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd257e00640 1 -- 172.21.15.28:0/240325982 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580bc020 con 0x7fd2601551b0 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd257e00640 1 -- 172.21.15.28:0/240325982 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2580b8690 con 0x7fd2601551b0 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd257e00640 1 -- 172.21.15.28:0/240325982 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580b8a80 con 0x7fd2601551b0 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd266600640 1 -- 172.21.15.28:0/240325982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2600c7260 con 0x7fd2601551b0 2024-04-23T18:22:37.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd266600640 1 -- 172.21.15.28:0/240325982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd26014ec50 con 0x7fd2601551b0 2024-04-23T18:22:37.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd266600640 1 -- 172.21.15.28:0/240325982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd260068db0 con 0x7fd2601551b0 2024-04-23T18:22:37.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.589+0000 7fd257e00640 1 -- 172.21.15.28:0/240325982 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2580bf020 con 0x7fd2601551b0 2024-04-23T18:22:37.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.593+0000 7fd257e00640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd23c068380 0x7fd23c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:37.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.593+0000 7fd257e00640 1 -- 172.21.15.28:0/240325982 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fd258121740 con 0x7fd2601551b0 2024-04-23T18:22:37.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.593+0000 7fd25f400640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd23c068380 0x7fd23c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:37.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.593+0000 7fd25f400640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd23c068380 0x7fd23c06a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd250007940 tx=0x7fd250008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:37.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.601+0000 7fd257e00640 1 -- 172.21.15.28:0/240325982 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd2580c6070 con 0x7fd2601551b0 2024-04-23T18:22:37.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:37.809+0000 7fd266600640 1 -- 172.21.15.28:0/240325982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fd26015a130 con 0x7fd2601551b0 2024-04-23T18:22:38.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.385+0000 7fd257e00640 1 -- 172.21.15.28:0/240325982 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fd2580165e0 con 0x7fd2601551b0 2024-04-23T18:22:38.382 INFO:teuthology.orchestra.run.smithi028.stderr:added data pool 4 to fsmap 2024-04-23T18:22:38.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 -- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd23c068380 msgr2=0x7fd23c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd23c068380 0x7fd23c06a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd250007940 tx=0x7fd250008040 comp rx=0 tx=0).stop 2024-04-23T18:22:38.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 -- 172.21.15.28:0/240325982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2601551b0 msgr2=0x7fd260157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2601551b0 0x7fd260157b00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2580af040 tx=0x7fd258019790 comp rx=0 tx=0).stop 2024-04-23T18:22:38.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 -- 172.21.15.28:0/240325982 shutdown_connections 2024-04-23T18:22:38.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd23c068380 0x7fd23c06a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2600c9fc0 0x7fd2600c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2601551b0 0x7fd260157b00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 --2- 172.21.15.28:0/240325982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd260073710 0x7fd2601566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 -- 172.21.15.28:0/240325982 >> 172.21.15.28:0/240325982 conn(0x7fd2600676e0 msgr2=0x7fd260152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:38.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 -- 172.21.15.28:0/240325982 shutdown_connections 2024-04-23T18:22:38.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.389+0000 7fd266600640 1 -- 172.21.15.28:0/240325982 wait complete. 2024-04-23T18:22:38.407 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:22:38.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.553+0000 7fc007a00640 1 Processor -- start 2024-04-23T18:22:38.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.553+0000 7fc007a00640 1 -- start start 2024-04-23T18:22:38.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fc007a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc000151f90 0x7fc0000718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fc007a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc000072080 0x7fc0000c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fc007a00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0000c9de0 con 0x7fc000152370 2024-04-23T18:22:38.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fc007a00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fc0000ca080 con 0x7fc000072080 2024-04-23T18:22:38.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fc007a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc000158cf0 con 0x7fc000151f90 2024-04-23T18:22:38.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fbfffe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc000072080 0x7fc0000c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fc005a00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc000152370 0x7fc00015b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60404/0 (socket says 172.21.15.28:60404) 2024-04-23T18:22:38.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fc005a00640 1 -- 172.21.15.28:0/3937111508 learned_addr learned my addr 172.21.15.28:0/3937111508 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:38.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fbfffe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc000072080 0x7fc0000c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38642/0 (socket says 172.21.15.28:38642) 2024-04-23T18:22:38.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fc005000640 1 --2- 172.21.15.28:0/3937111508 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc000151f90 0x7fc0000718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fbfffe00640 1 -- 172.21.15.28:0/3937111508 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc000151f90 msgr2=0x7fc0000718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:38.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fbfffe00640 1 --2- 172.21.15.28:0/3937111508 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc000151f90 0x7fc0000718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fbfffe00640 1 -- 172.21.15.28:0/3937111508 >> v1:172.21.15.28:6789/0 conn(0x7fc000152370 legacy=0x7fc00015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fbfffe00640 1 -- 172.21.15.28:0/3937111508 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc000157f30 con 0x7fc000072080 2024-04-23T18:22:38.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.557+0000 7fbfff400640 1 -- 172.21.15.28:0/3937111508 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1160697025 0 0) 0x7fc0000c9de0 con 0x7fc000152370 2024-04-23T18:22:38.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fbfffe00640 1 --2- 172.21.15.28:0/3937111508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc000072080 0x7fc0000c96a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0097c0 tx=0x7fbfec01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5eb0f5e7f269 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:38.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fbfff400640 1 -- 172.21.15.28:0/3937111508 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0b5070 con 0x7fc000072080 2024-04-23T18:22:38.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fbfff400640 1 -- 172.21.15.28:0/3937111508 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec0a8990 con 0x7fc000072080 2024-04-23T18:22:38.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fbfff400640 1 -- 172.21.15.28:0/3937111508 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0a8d60 con 0x7fc000072080 2024-04-23T18:22:38.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 -- 172.21.15.28:0/3937111508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc000072080 msgr2=0x7fc0000c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 --2- 172.21.15.28:0/3937111508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc000072080 0x7fc0000c96a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0097c0 tx=0x7fbfec01ec90 comp rx=0 tx=0).stop 2024-04-23T18:22:38.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 -- 172.21.15.28:0/3937111508 shutdown_connections 2024-04-23T18:22:38.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 --2- 172.21.15.28:0/3937111508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc000072080 0x7fc0000c96a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 --2- 172.21.15.28:0/3937111508 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc000151f90 0x7fc0000718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 -- 172.21.15.28:0/3937111508 >> 172.21.15.28:0/3937111508 conn(0x7fc00006d0a0 msgr2=0x7fc0000676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:38.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 -- 172.21.15.28:0/3937111508 shutdown_connections 2024-04-23T18:22:38.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 -- 172.21.15.28:0/3937111508 wait complete. 2024-04-23T18:22:38.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 Processor -- start 2024-04-23T18:22:38.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 -- start start 2024-04-23T18:22:38.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc000072080 0x7fc00015a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.561+0000 7fc007a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc000151f90 0x7fc00015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc007a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc000152370 0x7fc0000cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc007a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc0001587d0 con 0x7fc000072080 2024-04-23T18:22:38.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc007a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0001584f0 con 0x7fc000151f90 2024-04-23T18:22:38.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc007a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc00015baa0 con 0x7fc000152370 2024-04-23T18:22:38.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc005000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc000072080 0x7fc00015a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc005000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc000072080 0x7fc00015a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38646/0 (socket says 172.21.15.28:38646) 2024-04-23T18:22:38.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc005000640 1 -- 172.21.15.28:0/2643285842 learned_addr learned my addr 172.21.15.28:0/2643285842 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:38.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc005a00640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc000152370 0x7fc0000cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fbfffe00640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc000151f90 0x7fc00015aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc005000640 1 -- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc000152370 msgr2=0x7fc0000cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc005000640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc000152370 0x7fc0000cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc005000640 1 -- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc000151f90 msgr2=0x7fc00015aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc005000640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc000151f90 0x7fc00015aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc005000640 1 -- 172.21.15.28:0/2643285842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0001f1960 con 0x7fc000072080 2024-04-23T18:22:38.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc005000640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc000072080 0x7fc00015a570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbff400d830 tx=0x7fbff400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:38.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fbffcc00640 1 -- 172.21.15.28:0/2643285842 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff400b6c0 con 0x7fc000072080 2024-04-23T18:22:38.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fbffcc00640 1 -- 172.21.15.28:0/2643285842 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff4019070 con 0x7fc000072080 2024-04-23T18:22:38.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fbffcc00640 1 -- 172.21.15.28:0/2643285842 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff400ba60 con 0x7fc000072080 2024-04-23T18:22:38.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc007a00640 1 -- 172.21.15.28:0/2643285842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0000ca5f0 con 0x7fc000072080 2024-04-23T18:22:38.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc007a00640 1 -- 172.21.15.28:0/2643285842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0000ca890 con 0x7fc000072080 2024-04-23T18:22:38.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fc007a00640 1 -- 172.21.15.28:0/2643285842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc000068cd0 con 0x7fc000072080 2024-04-23T18:22:38.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.565+0000 7fbffcc00640 1 -- 172.21.15.28:0/2643285842 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbff401e460 con 0x7fc000072080 2024-04-23T18:22:38.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.569+0000 7fbffcc00640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbfe00683b0 0x7fbfe006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.569+0000 7fbffcc00640 1 -- 172.21.15.28:0/2643285842 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbff40873d0 con 0x7fc000072080 2024-04-23T18:22:38.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.569+0000 7fbfffe00640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbfe00683b0 0x7fbfe006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.569+0000 7fbfffe00640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbfe00683b0 0x7fbfe006a870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0b2000 tx=0x7fbfec0aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:38.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.573+0000 7fbffcc00640 1 -- 172.21.15.28:0/2643285842 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbff4057640 con 0x7fc000072080 2024-04-23T18:22:38.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 -- 172.21.15.28:0/2643285842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0000c4420 con 0x7fc000072080 2024-04-23T18:22:38.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fbffcc00640 1 -- 172.21.15.28:0/2643285842 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6826 (secure 0 0 0) 0x7fbff4056f40 con 0x7fc000072080 2024-04-23T18:22:38.768 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:38.768 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:22:37.816413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T18:22:38.768 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 5 2024-04-23T18:22:38.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 -- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbfe00683b0 msgr2=0x7fbfe006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbfe00683b0 0x7fbfe006a870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0b2000 tx=0x7fbfec0aa070 comp rx=0 tx=0).stop 2024-04-23T18:22:38.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 -- 172.21.15.28:0/2643285842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc000072080 msgr2=0x7fc00015a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc000072080 0x7fc00015a570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbff400d830 tx=0x7fbff400dcf0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 -- 172.21.15.28:0/2643285842 shutdown_connections 2024-04-23T18:22:38.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbfe00683b0 0x7fbfe006a870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc000152370 0x7fc0000cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc000151f90 0x7fc00015aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 --2- 172.21.15.28:0/2643285842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc000072080 0x7fc00015a570 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 -- 172.21.15.28:0/2643285842 >> 172.21.15.28:0/2643285842 conn(0x7fc00006d0a0 msgr2=0x7fc0000c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:38.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 -- 172.21.15.28:0/2643285842 shutdown_connections 2024-04-23T18:22:38.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.773+0000 7fc007a00640 1 -- 172.21.15.28:0/2643285842 wait complete. 2024-04-23T18:22:38.790 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:38.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd4a6200640 1 Processor -- start 2024-04-23T18:22:38.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd4a6200640 1 -- start start 2024-04-23T18:22:38.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd4a6200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd4a0072080 0x7fd4a00718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd4a6200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4a0152370 0x7fd4a00c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd4a6200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4a00c9de0 con 0x7fd4a0151f90 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd4a6200640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fd4a00ca080 con 0x7fd4a0072080 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd4a6200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd4a0158cf0 con 0x7fd4a0152370 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd49ea00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd4a0072080 0x7fd4a00718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd49ea00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd4a0072080 0x7fd4a00718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46956/0 (socket says 172.21.15.28:46956) 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd49ea00640 1 -- 172.21.15.28:0/4201503516 learned_addr learned my addr 172.21.15.28:0/4201503516 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd49fe00640 1 --2- 172.21.15.28:0/4201503516 >> v2:172.21.15.137:3300/0 conn(0x7fd4a0152370 0x7fd4a00c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd49ea00640 1 -- 172.21.15.28:0/4201503516 >> v2:172.21.15.137:3300/0 conn(0x7fd4a0152370 msgr2=0x7fd4a00c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd49ea00640 1 --2- 172.21.15.28:0/4201503516 >> v2:172.21.15.137:3300/0 conn(0x7fd4a0152370 0x7fd4a00c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd49ea00640 1 -- 172.21.15.28:0/4201503516 >> v1:172.21.15.28:6789/0 conn(0x7fd4a0151f90 legacy=0x7fd4a015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd49e000640 1 -- 172.21.15.28:0/4201503516 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781546165 0 0) 0x7fd4a00c9de0 con 0x7fd4a0151f90 2024-04-23T18:22:38.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.937+0000 7fd49ea00640 1 -- 172.21.15.28:0/4201503516 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a0157f30 con 0x7fd4a0072080 2024-04-23T18:22:38.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd49ea00640 1 --2- 172.21.15.28:0/4201503516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4a0072080 0x7fd4a00718d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00c4d00 tx=0x7fd48c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c40922975763d99 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:38.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd49e000640 1 -- 172.21.15.28:0/4201503516 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0b5070 con 0x7fd4a0072080 2024-04-23T18:22:38.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd49e000640 1 -- 172.21.15.28:0/4201503516 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48c0a8a10 con 0x7fd4a0072080 2024-04-23T18:22:38.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd49e000640 1 -- 172.21.15.28:0/4201503516 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0a8de0 con 0x7fd4a0072080 2024-04-23T18:22:38.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd4a6200640 1 -- 172.21.15.28:0/4201503516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4a0072080 msgr2=0x7fd4a00718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd4a6200640 1 --2- 172.21.15.28:0/4201503516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4a0072080 0x7fd4a00718d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00c4d00 tx=0x7fd48c01ed10 comp rx=0 tx=0).stop 2024-04-23T18:22:38.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd4a6200640 1 -- 172.21.15.28:0/4201503516 shutdown_connections 2024-04-23T18:22:38.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd4a6200640 1 --2- 172.21.15.28:0/4201503516 >> v2:172.21.15.137:3300/0 conn(0x7fd4a0152370 0x7fd4a00c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd4a6200640 1 --2- 172.21.15.28:0/4201503516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4a0072080 0x7fd4a00718d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd4a6200640 1 -- 172.21.15.28:0/4201503516 >> 172.21.15.28:0/4201503516 conn(0x7fd4a006d0a0 msgr2=0x7fd4a00676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:38.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd4a6200640 1 -- 172.21.15.28:0/4201503516 shutdown_connections 2024-04-23T18:22:38.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd4a6200640 1 -- 172.21.15.28:0/4201503516 wait complete. 2024-04-23T18:22:38.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd4a6200640 1 Processor -- start 2024-04-23T18:22:38.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.941+0000 7fd4a6200640 1 -- start start 2024-04-23T18:22:38.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd4a6200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4a0072080 0x7fd4a0147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd4a6200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4a0151f90 0x7fd4a01484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd4a6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a0152370 0x7fd4a0163f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd4a6200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a01587d0 con 0x7fd4a0072080 2024-04-23T18:22:38.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd4a6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a01584f0 con 0x7fd4a0152370 2024-04-23T18:22:38.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd4a6200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd4a015baa0 con 0x7fd4a0151f90 2024-04-23T18:22:38.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4a0072080 0x7fd4a0147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4a0072080 0x7fd4a0147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46966/0 (socket says 172.21.15.28:46966) 2024-04-23T18:22:38.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49f400640 1 -- 172.21.15.28:0/3434011892 learned_addr learned my addr 172.21.15.28:0/3434011892 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:38.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49fe00640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a0152370 0x7fd4a0163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49ea00640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4a0151f90 0x7fd4a01484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49f400640 1 -- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4a0151f90 msgr2=0x7fd4a01484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49f400640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4a0151f90 0x7fd4a01484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49f400640 1 -- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a0152370 msgr2=0x7fd4a0163f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:38.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49f400640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a0152370 0x7fd4a0163f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:38.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49f400640 1 -- 172.21.15.28:0/3434011892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a0159010 con 0x7fd4a0072080 2024-04-23T18:22:38.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49fe00640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a0152370 0x7fd4a0163f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:22:38.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd49f400640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4a0072080 0x7fd4a0147fb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c4d0 tx=0x7fd49000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:38.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd497400640 1 -- 172.21.15.28:0/3434011892 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490017070 con 0x7fd4a0072080 2024-04-23T18:22:38.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd497400640 1 -- 172.21.15.28:0/3434011892 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd490005480 con 0x7fd4a0072080 2024-04-23T18:22:38.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd4a6200640 1 -- 172.21.15.28:0/3434011892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a0163790 con 0x7fd4a0072080 2024-04-23T18:22:38.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd497400640 1 -- 172.21.15.28:0/3434011892 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490003840 con 0x7fd4a0072080 2024-04-23T18:22:38.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd4a6200640 1 -- 172.21.15.28:0/3434011892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a01652e0 con 0x7fd4a0072080 2024-04-23T18:22:38.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd4a6200640 1 -- 172.21.15.28:0/3434011892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4a0068cd0 con 0x7fd4a0072080 2024-04-23T18:22:38.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.945+0000 7fd497400640 1 -- 172.21.15.28:0/3434011892 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd49001a070 con 0x7fd4a0072080 2024-04-23T18:22:38.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.949+0000 7fd497400640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd4800683d0 0x7fd48006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:38.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.949+0000 7fd497400640 1 -- 172.21.15.28:0/3434011892 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd490086040 con 0x7fd4a0072080 2024-04-23T18:22:38.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.949+0000 7fd49ea00640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd4800683d0 0x7fd48006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:38.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.949+0000 7fd49ea00640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd4800683d0 0x7fd48006a890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0b2000 tx=0x7fd48c0aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:38.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:38.953+0000 7fd497400640 1 -- 172.21.15.28:0/3434011892 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd4a0159010 con 0x7fd4a0072080 2024-04-23T18:22:39.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.117+0000 7fd4a6200640 1 -- 172.21.15.28:0/3434011892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4a01634d0 con 0x7fd4a0072080 2024-04-23T18:22:39.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.117+0000 7fd497400640 1 -- 172.21.15.28:0/3434011892 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fd4900564f0 con 0x7fd4a0072080 2024-04-23T18:22:39.114 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:39.114 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 -- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd4800683d0 msgr2=0x7fd48006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd4800683d0 0x7fd48006a890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0b2000 tx=0x7fd48c0aa070 comp rx=0 tx=0).stop 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 -- 172.21.15.28:0/3434011892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4a0072080 msgr2=0x7fd4a0147fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4a0072080 0x7fd4a0147fb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c4d0 tx=0x7fd49000c990 comp rx=0 tx=0).stop 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 -- 172.21.15.28:0/3434011892 shutdown_connections 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd4800683d0 0x7fd48006a890 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd4a0151f90 0x7fd4a01484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4a0152370 0x7fd4a0163f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 --2- 172.21.15.28:0/3434011892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4a0072080 0x7fd4a0147fb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 -- 172.21.15.28:0/3434011892 >> 172.21.15.28:0/3434011892 conn(0x7fd4a006d0a0 msgr2=0x7fd4a00c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 -- 172.21.15.28:0/3434011892 shutdown_connections 2024-04-23T18:22:39.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.121+0000 7fd4a6200640 1 -- 172.21.15.28:0/3434011892 wait complete. 2024-04-23T18:22:39.135 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:39.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc47400640 1 Processor -- start 2024-04-23T18:22:39.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc47400640 1 -- start start 2024-04-23T18:22:39.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc47400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc401444e0 0x7efc400710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc47400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc4006c3f0 0x7efc4015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc47400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc4015b650 con 0x7efc400c91e0 2024-04-23T18:22:39.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc47400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7efc4015b930 con 0x7efc4006c3f0 2024-04-23T18:22:39.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc47400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efc4015bc10 con 0x7efc401444e0 2024-04-23T18:22:39.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc45400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc4006c3f0 0x7efc4015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc44a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc401444e0 0x7efc400710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc45400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc4006c3f0 0x7efc4015ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:56478/0 (socket says 172.21.15.28:56478) 2024-04-23T18:22:39.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc45400640 1 -- 172.21.15.28:0/1640860511 learned_addr learned my addr 172.21.15.28:0/1640860511 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:39.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc37e00640 1 --1- 172.21.15.28:0/1640860511 >> v1:172.21.15.137:6789/0 conn(0x7efc400c91e0 0x7efc40072dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:55210/0 (socket says 172.21.15.28:55210) 2024-04-23T18:22:39.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc45400640 1 -- 172.21.15.28:0/1640860511 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc401444e0 msgr2=0x7efc400710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:39.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc45400640 1 --2- 172.21.15.28:0/1640860511 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc401444e0 0x7efc400710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc45400640 1 -- 172.21.15.28:0/1640860511 >> v1:172.21.15.137:6789/0 conn(0x7efc400c91e0 legacy=0x7efc40072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.281+0000 7efc45400640 1 -- 172.21.15.28:0/1640860511 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4015bef0 con 0x7efc4006c3f0 2024-04-23T18:22:39.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc45400640 1 --2- 172.21.15.28:0/1640860511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc4006c3f0 0x7efc4015ca50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc38009e50 tx=0x7efc3801f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e86b706029ac3c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:39.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc3fe00640 1 -- 172.21.15.28:0/1640860511 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380b4070 con 0x7efc4006c3f0 2024-04-23T18:22:39.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc3fe00640 1 -- 172.21.15.28:0/1640860511 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc380af400 con 0x7efc4006c3f0 2024-04-23T18:22:39.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc3fe00640 1 -- 172.21.15.28:0/1640860511 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380af7d0 con 0x7efc4006c3f0 2024-04-23T18:22:39.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc47400640 1 -- 172.21.15.28:0/1640860511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc4006c3f0 msgr2=0x7efc4015ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc47400640 1 --2- 172.21.15.28:0/1640860511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc4006c3f0 0x7efc4015ca50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc38009e50 tx=0x7efc3801f210 comp rx=0 tx=0).stop 2024-04-23T18:22:39.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc47400640 1 -- 172.21.15.28:0/1640860511 shutdown_connections 2024-04-23T18:22:39.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc47400640 1 --2- 172.21.15.28:0/1640860511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc4006c3f0 0x7efc4015ca50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc47400640 1 --2- 172.21.15.28:0/1640860511 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc401444e0 0x7efc400710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc47400640 1 -- 172.21.15.28:0/1640860511 >> 172.21.15.28:0/1640860511 conn(0x7efc400676e0 msgr2=0x7efc40067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:39.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc47400640 1 -- 172.21.15.28:0/1640860511 shutdown_connections 2024-04-23T18:22:39.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.285+0000 7efc47400640 1 -- 172.21.15.28:0/1640860511 wait complete. 2024-04-23T18:22:39.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc47400640 1 Processor -- start 2024-04-23T18:22:39.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc47400640 1 -- start start 2024-04-23T18:22:39.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc47400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc4006c3f0 0x7efc400c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc47400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc400c91e0 0x7efc400ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc47400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc401444e0 0x7efc4013b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc47400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7efc401448c0 con 0x7efc401444e0 2024-04-23T18:22:39.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc47400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efc4015b300 con 0x7efc400c91e0 2024-04-23T18:22:39.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc47400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efc40144a40 con 0x7efc4006c3f0 2024-04-23T18:22:39.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc45400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc401444e0 0x7efc4013b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc45400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc401444e0 0x7efc4013b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46970/0 (socket says 172.21.15.28:46970) 2024-04-23T18:22:39.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc45400640 1 -- 172.21.15.28:0/770207541 learned_addr learned my addr 172.21.15.28:0/770207541 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:39.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc37e00640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc400c91e0 0x7efc400ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc44a00640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc4006c3f0 0x7efc400c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc45400640 1 -- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc4006c3f0 msgr2=0x7efc400c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc45400640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc4006c3f0 0x7efc400c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc45400640 1 -- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc400c91e0 msgr2=0x7efc400ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc45400640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc400c91e0 0x7efc400ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc45400640 1 -- 172.21.15.28:0/770207541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc400cdd70 con 0x7efc401444e0 2024-04-23T18:22:39.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc45400640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc401444e0 0x7efc4013b210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efc38009e50 tx=0x7efc3801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:39.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc3d600640 1 -- 172.21.15.28:0/770207541 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380b4040 con 0x7efc401444e0 2024-04-23T18:22:39.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc3d600640 1 -- 172.21.15.28:0/770207541 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc380afd80 con 0x7efc401444e0 2024-04-23T18:22:39.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc47400640 1 -- 172.21.15.28:0/770207541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc400ccca0 con 0x7efc401444e0 2024-04-23T18:22:39.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc3d600640 1 -- 172.21.15.28:0/770207541 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38009510 con 0x7efc401444e0 2024-04-23T18:22:39.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.289+0000 7efc47400640 1 -- 172.21.15.28:0/770207541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc4013fd00 con 0x7efc401444e0 2024-04-23T18:22:39.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.293+0000 7efc47400640 1 -- 172.21.15.28:0/770207541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc40068cd0 con 0x7efc401444e0 2024-04-23T18:22:39.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.293+0000 7efc3d600640 1 -- 172.21.15.28:0/770207541 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efc380c3020 con 0x7efc401444e0 2024-04-23T18:22:39.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.293+0000 7efc3d600640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc1c0683b0 0x7efc1c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.293+0000 7efc3d600640 1 -- 172.21.15.28:0/770207541 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efc38124760 con 0x7efc401444e0 2024-04-23T18:22:39.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.293+0000 7efc44a00640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc1c0683b0 0x7efc1c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.297+0000 7efc44a00640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc1c0683b0 0x7efc1c06a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc30009a50 tx=0x7efc30008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:39.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.297+0000 7efc3d600640 1 -- 172.21.15.28:0/770207541 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efc380ca020 con 0x7efc401444e0 2024-04-23T18:22:39.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 -- 172.21.15.28:0/770207541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc400cba00 con 0x7efc401444e0 2024-04-23T18:22:39.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc3d600640 1 -- 172.21.15.28:0/770207541 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7efc38018d70 con 0x7efc401444e0 2024-04-23T18:22:39.465 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:39.465 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 -- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc1c0683b0 msgr2=0x7efc1c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc1c0683b0 0x7efc1c06a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc30009a50 tx=0x7efc30008040 comp rx=0 tx=0).stop 2024-04-23T18:22:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 -- 172.21.15.28:0/770207541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc401444e0 msgr2=0x7efc4013b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc401444e0 0x7efc4013b210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efc38009e50 tx=0x7efc3801bfb0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 -- 172.21.15.28:0/770207541 shutdown_connections 2024-04-23T18:22:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efc1c0683b0 0x7efc1c06a870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc401444e0 0x7efc4013b210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc400c91e0 0x7efc400ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 --2- 172.21.15.28:0/770207541 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc4006c3f0 0x7efc400c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 -- 172.21.15.28:0/770207541 >> 172.21.15.28:0/770207541 conn(0x7efc400676e0 msgr2=0x7efc4015ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:39.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 -- 172.21.15.28:0/770207541 shutdown_connections 2024-04-23T18:22:39.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.469+0000 7efc47400640 1 -- 172.21.15.28:0/770207541 wait complete. 2024-04-23T18:22:39.504 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:22:39.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa90da00640 1 Processor -- start 2024-04-23T18:22:39.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa90da00640 1 -- start start 2024-04-23T18:22:39.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa90da00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa9080c5750 0x7fa908070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa90da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c8980 0x7fa908159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa90da00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9080714f0 con 0x7fa908073020 2024-04-23T18:22:39.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa90da00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fa9080c5c50 con 0x7fa9080c5750 2024-04-23T18:22:39.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa90da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa9080c5f30 con 0x7fa9080c8980 2024-04-23T18:22:39.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa8fe000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa9080c5750 0x7fa908070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa8fe000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa9080c5750 0x7fa908070e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46986/0 (socket says 172.21.15.28:46986) 2024-04-23T18:22:39.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa8fe000640 1 -- 172.21.15.28:0/1519919420 learned_addr learned my addr 172.21.15.28:0/1519919420 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:39.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa907400640 1 --2- 172.21.15.28:0/1519919420 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c8980 0x7fa908159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa8fe000640 1 -- 172.21.15.28:0/1519919420 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c8980 msgr2=0x7fa908159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:39.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa8fe000640 1 --2- 172.21.15.28:0/1519919420 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c8980 0x7fa908159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa8fe000640 1 -- 172.21.15.28:0/1519919420 >> v1:172.21.15.28:6789/0 conn(0x7fa908073020 legacy=0x7fa908142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa8fe000640 1 -- 172.21.15.28:0/1519919420 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9080c6210 con 0x7fa9080c5750 2024-04-23T18:22:39.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.649+0000 7fa907400640 1 --2- 172.21.15.28:0/1519919420 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c8980 0x7fa908159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:22:39.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa8fe000640 1 --2- 172.21.15.28:0/1519919420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9080c5750 0x7fa908070e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009e50 tx=0x7fa8f001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c6f85372972ba9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:39.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa906000640 1 -- 172.21.15.28:0/1519919420 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00b4070 con 0x7fa9080c5750 2024-04-23T18:22:39.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa906000640 1 -- 172.21.15.28:0/1519919420 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f00af400 con 0x7fa9080c5750 2024-04-23T18:22:39.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa906000640 1 -- 172.21.15.28:0/1519919420 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00af7d0 con 0x7fa9080c5750 2024-04-23T18:22:39.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa90da00640 1 -- 172.21.15.28:0/1519919420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9080c5750 msgr2=0x7fa908070e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa90da00640 1 --2- 172.21.15.28:0/1519919420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9080c5750 0x7fa908070e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009e50 tx=0x7fa8f001f210 comp rx=0 tx=0).stop 2024-04-23T18:22:39.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa90da00640 1 -- 172.21.15.28:0/1519919420 shutdown_connections 2024-04-23T18:22:39.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa90da00640 1 --2- 172.21.15.28:0/1519919420 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c8980 0x7fa908159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa90da00640 1 --2- 172.21.15.28:0/1519919420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9080c5750 0x7fa908070e90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa90da00640 1 -- 172.21.15.28:0/1519919420 >> 172.21.15.28:0/1519919420 conn(0x7fa9080676e0 msgr2=0x7fa908067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:39.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa90da00640 1 -- 172.21.15.28:0/1519919420 shutdown_connections 2024-04-23T18:22:39.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.653+0000 7fa90da00640 1 -- 172.21.15.28:0/1519919420 wait complete. 2024-04-23T18:22:39.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa90da00640 1 Processor -- start 2024-04-23T18:22:39.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa90da00640 1 -- start start 2024-04-23T18:22:39.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa90da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908073020 0x7fa90815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa90da00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9080c5750 0x7fa9080cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa90da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c8980 0x7fa90815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa90da00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa908073400 con 0x7fa9080c5750 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa90da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9080c67d0 con 0x7fa908073020 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa90da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa908073580 con 0x7fa9080c8980 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8fe000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9080c5750 0x7fa9080cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8fe000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9080c5750 0x7fa9080cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47002/0 (socket says 172.21.15.28:47002) 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8fe000640 1 -- 172.21.15.28:0/1129482122 learned_addr learned my addr 172.21.15.28:0/1129482122 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa907400640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c8980 0x7fa90815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa906a00640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908073020 0x7fa90815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8fe000640 1 -- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c8980 msgr2=0x7fa90815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8fe000640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c8980 0x7fa90815c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8fe000640 1 -- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908073020 msgr2=0x7fa90815ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8fe000640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908073020 0x7fa90815ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8fe000640 1 -- 172.21.15.28:0/1129482122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90815d380 con 0x7fa9080c5750 2024-04-23T18:22:39.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8fe000640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9080c5750 0x7fa9080cea00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00b2040 tx=0x7fa8f001bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:39.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8ff400640 1 -- 172.21.15.28:0/1129482122 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00c0070 con 0x7fa9080c5750 2024-04-23T18:22:39.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8ff400640 1 -- 172.21.15.28:0/1129482122 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f00afe10 con 0x7fa9080c5750 2024-04-23T18:22:39.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa90da00640 1 -- 172.21.15.28:0/1129482122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9081f14b0 con 0x7fa9080c5750 2024-04-23T18:22:39.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa8ff400640 1 -- 172.21.15.28:0/1129482122 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00b4040 con 0x7fa9080c5750 2024-04-23T18:22:39.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa90da00640 1 -- 172.21.15.28:0/1129482122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9081f1a70 con 0x7fa9080c5750 2024-04-23T18:22:39.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.657+0000 7fa90da00640 1 -- 172.21.15.28:0/1129482122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa908068cd0 con 0x7fa9080c5750 2024-04-23T18:22:39.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.661+0000 7fa8ff400640 1 -- 172.21.15.28:0/1129482122 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8f00c3070 con 0x7fa9080c5750 2024-04-23T18:22:39.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.661+0000 7fa8ff400640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e4068380 0x7fa8e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:39.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.661+0000 7fa8ff400640 1 -- 172.21.15.28:0/1129482122 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa8f0124460 con 0x7fa9080c5750 2024-04-23T18:22:39.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.661+0000 7fa906a00640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e4068380 0x7fa8e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:39.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.661+0000 7fa906a00640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e4068380 0x7fa8e406a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8000f70 tx=0x7fa8f8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:39.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.665+0000 7fa8ff400640 1 -- 172.21.15.28:0/1129482122 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa8f0018d70 con 0x7fa9080c5750 2024-04-23T18:22:39.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 -- 172.21.15.28:0/1129482122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa90813f980 con 0x7fa9080c5750 2024-04-23T18:22:39.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa8ff400640 1 -- 172.21.15.28:0/1129482122 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6831 (secure 0 0 0) 0x7fa8f00f4700 con 0x7fa9080c5750 2024-04-23T18:22:39.860 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:39.860 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:22:39.399751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-23T18:22:39.860 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2024-04-23T18:22:39.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 -- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e4068380 msgr2=0x7fa8e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e4068380 0x7fa8e406a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8000f70 tx=0x7fa8f8009040 comp rx=0 tx=0).stop 2024-04-23T18:22:39.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 -- 172.21.15.28:0/1129482122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9080c5750 msgr2=0x7fa9080cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:39.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9080c5750 0x7fa9080cea00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00b2040 tx=0x7fa8f001bfb0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 -- 172.21.15.28:0/1129482122 shutdown_connections 2024-04-23T18:22:39.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e4068380 0x7fa8e406a840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c8980 0x7fa90815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9080c5750 0x7fa9080cea00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 --2- 172.21.15.28:0/1129482122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908073020 0x7fa90815ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:39.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 -- 172.21.15.28:0/1129482122 >> 172.21.15.28:0/1129482122 conn(0x7fa9080676e0 msgr2=0x7fa90806b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:39.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 -- 172.21.15.28:0/1129482122 shutdown_connections 2024-04-23T18:22:39.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:39.865+0000 7fa90da00640 1 -- 172.21.15.28:0/1129482122 wait complete. 2024-04-23T18:22:39.881 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:40.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.025+0000 7f0022400640 1 Processor -- start 2024-04-23T18:22:40.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.025+0000 7f0022400640 1 -- start start 2024-04-23T18:22:40.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.025+0000 7f0022400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f001c0c4ac0 0x7f001c1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:40.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.025+0000 7f0022400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c158f10 con 0x7f001c15c500 2024-04-23T18:22:40.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.025+0000 7f0022400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c0c5020 con 0x7f001c1533b0 2024-04-23T18:22:40.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.029+0000 7f0022400640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f001c159f10 con 0x7f001c0c4ac0 2024-04-23T18:22:40.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.029+0000 7f0012a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f001c0c4ac0 0x7f001c1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:40.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.029+0000 7f001be00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f001c15c500 0x7f001c0676e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57576/0 (socket says 172.21.15.28:57576) 2024-04-23T18:22:40.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.029+0000 7f001be00640 1 -- 172.21.15.28:0/1739247670 learned_addr learned my addr 172.21.15.28:0/1739247670 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:40.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.029+0000 7f0012a00640 1 -- 172.21.15.28:0/1739247670 >> v1:172.21.15.137:6789/0 conn(0x7f001c1533b0 legacy=0x7f001c0ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:40.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.029+0000 7f0012a00640 1 -- 172.21.15.28:0/1739247670 >> v1:172.21.15.28:6789/0 conn(0x7f001c15c500 legacy=0x7f001c0676e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:40.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.029+0000 7f0012a00640 1 -- 172.21.15.28:0/1739247670 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c0c5300 con 0x7f001c0c4ac0 2024-04-23T18:22:40.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.029+0000 7f0012a00640 1 --2- 172.21.15.28:0/1739247670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f001c0c4ac0 0x7f001c1599d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00040097c0 tx=0x7f000401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d159c3d8732dcd50 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:40.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.029+0000 7f001aa00640 1 -- 172.21.15.28:0/1739247670 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00040a7070 con 0x7f001c0c4ac0 2024-04-23T18:22:40.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.029+0000 7f001aa00640 1 -- 172.21.15.28:0/1739247670 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00040b0070 con 0x7f001c0c4ac0 2024-04-23T18:22:40.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.029+0000 7f001aa00640 1 -- 172.21.15.28:0/1739247670 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00040ab890 con 0x7f001c0c4ac0 2024-04-23T18:22:40.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 -- 172.21.15.28:0/1739247670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f001c0c4ac0 msgr2=0x7f001c1599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:40.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 --2- 172.21.15.28:0/1739247670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f001c0c4ac0 0x7f001c1599d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00040097c0 tx=0x7f000401c470 comp rx=0 tx=0).stop 2024-04-23T18:22:40.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 -- 172.21.15.28:0/1739247670 shutdown_connections 2024-04-23T18:22:40.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 --2- 172.21.15.28:0/1739247670 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f001c0c4ac0 0x7f001c1599d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 -- 172.21.15.28:0/1739247670 >> 172.21.15.28:0/1739247670 conn(0x7f001c06b9e0 msgr2=0x7f001c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:40.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 -- 172.21.15.28:0/1739247670 shutdown_connections 2024-04-23T18:22:40.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 -- 172.21.15.28:0/1739247670 wait complete. 2024-04-23T18:22:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 Processor -- start 2024-04-23T18:22:40.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 -- start start 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001c0c4ac0 0x7f001c15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f001c1533b0 0x7f001c1f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f001c15c500 0x7f001c14c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f001c0cad70 con 0x7f001c15c500 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f001c0c81f0 con 0x7f001c0c4ac0 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0022400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f001c067df0 con 0x7f001c1533b0 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f001be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f001c15c500 0x7f001c14c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f001be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f001c15c500 0x7f001c14c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47020/0 (socket says 172.21.15.28:47020) 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f001be00640 1 -- 172.21.15.28:0/1412219533 learned_addr learned my addr 172.21.15.28:0/1412219533 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f001b400640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001c0c4ac0 0x7f001c15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f0012a00640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f001c1533b0 0x7f001c1f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f001be00640 1 -- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f001c1533b0 msgr2=0x7f001c1f76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:40.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f001be00640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f001c1533b0 0x7f001c1f76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f001be00640 1 -- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001c0c4ac0 msgr2=0x7f001c15b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:40.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f001be00640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001c0c4ac0 0x7f001c15b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.033+0000 7f001be00640 1 -- 172.21.15.28:0/1412219533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c14ff30 con 0x7f001c15c500 2024-04-23T18:22:40.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.037+0000 7f001be00640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f001c15c500 0x7f001c14c650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f001400ca80 tx=0x7f001400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:40.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.037+0000 7f0013e00640 1 -- 172.21.15.28:0/1412219533 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0014017070 con 0x7f001c15c500 2024-04-23T18:22:40.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.037+0000 7f0013e00640 1 -- 172.21.15.28:0/1412219533 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f001400ac30 con 0x7f001c15c500 2024-04-23T18:22:40.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.037+0000 7f0013e00640 1 -- 172.21.15.28:0/1412219533 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0014012600 con 0x7f001c15c500 2024-04-23T18:22:40.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.037+0000 7f0022400640 1 -- 172.21.15.28:0/1412219533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001c0cd260 con 0x7f001c15c500 2024-04-23T18:22:40.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.037+0000 7f0022400640 1 -- 172.21.15.28:0/1412219533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c150480 con 0x7f001c15c500 2024-04-23T18:22:40.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.037+0000 7f0022400640 1 -- 172.21.15.28:0/1412219533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001c068cd0 con 0x7f001c15c500 2024-04-23T18:22:40.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.037+0000 7f0013e00640 1 -- 172.21.15.28:0/1412219533 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f001401a070 con 0x7f001c15c500 2024-04-23T18:22:40.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.037+0000 7f0013e00640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efff80683b0 0x7efff806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:40.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.037+0000 7f0013e00640 1 -- 172.21.15.28:0/1412219533 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f00140868c0 con 0x7f001c15c500 2024-04-23T18:22:40.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.037+0000 7f001b400640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efff80683b0 0x7efff806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:40.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.041+0000 7f001b400640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efff80683b0 0x7efff806a870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f000c001650 tx=0x7f000c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:40.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.041+0000 7f0013e00640 1 -- 172.21.15.28:0/1412219533 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f001400ae20 con 0x7f001c15c500 2024-04-23T18:22:40.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.213+0000 7f0022400640 1 -- 172.21.15.28:0/1412219533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f001c0c7af0 con 0x7f001c15c500 2024-04-23T18:22:40.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.213+0000 7f0013e00640 1 -- 172.21.15.28:0/1412219533 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f00140564e0 con 0x7f001c15c500 2024-04-23T18:22:40.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:40.210 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:40.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 -- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efff80683b0 msgr2=0x7efff806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:40.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efff80683b0 0x7efff806a870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f000c001650 tx=0x7f000c009040 comp rx=0 tx=0).stop 2024-04-23T18:22:40.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 -- 172.21.15.28:0/1412219533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f001c15c500 msgr2=0x7f001c14c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:40.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f001c15c500 0x7f001c14c650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f001400ca80 tx=0x7f001400cf40 comp rx=0 tx=0).stop 2024-04-23T18:22:40.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 -- 172.21.15.28:0/1412219533 shutdown_connections 2024-04-23T18:22:40.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efff80683b0 0x7efff806a870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f001c1533b0 0x7f001c1f76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f001c15c500 0x7f001c14c650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 --2- 172.21.15.28:0/1412219533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001c0c4ac0 0x7f001c15b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 -- 172.21.15.28:0/1412219533 >> 172.21.15.28:0/1412219533 conn(0x7f001c06b9e0 msgr2=0x7f001c0cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:40.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 -- 172.21.15.28:0/1412219533 shutdown_connections 2024-04-23T18:22:40.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.217+0000 7f0022400640 1 -- 172.21.15.28:0/1412219533 wait complete. 2024-04-23T18:22:40.834 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T18:22:32.759537+0000', 'modified': '2024-04-23T18:22:39.399751+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.137:6839/1022932690', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6837', 'nonce': 1022932690}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 1022932690}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4297, 'qdb_cluster': [4297]} 2024-04-23T18:22:40.835 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-23T18:22:40.835 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-23T18:22:40.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfea00640 1 Processor -- start 2024-04-23T18:22:40.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfea00640 1 -- start start 2024-04-23T18:22:40.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6cf8155310 0x7f6cf80d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:40.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfea00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6cf815f180 0x7f6cf80c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:40.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfea00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf815b290 con 0x7f6cf80d0c90 2024-04-23T18:22:40.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfea00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf815b550 con 0x7f6cf815f180 2024-04-23T18:22:40.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfea00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf815b830 con 0x7f6cf8155310 2024-04-23T18:22:40.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfe000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6cf815f180 0x7f6cf80c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:40.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfd600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6cf8155310 0x7f6cf80d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:40.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfe000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6cf815f180 0x7f6cf80c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47028/0 (socket says 172.21.15.28:47028) 2024-04-23T18:22:40.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfe000640 1 -- 172.21.15.28:0/1939470497 learned_addr learned my addr 172.21.15.28:0/1939470497 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:40.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfe000640 1 -- 172.21.15.28:0/1939470497 >> v2:172.21.15.137:3300/0 conn(0x7f6cf8155310 msgr2=0x7f6cf80d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:40.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfe000640 1 --2- 172.21.15.28:0/1939470497 >> v2:172.21.15.137:3300/0 conn(0x7f6cf8155310 0x7f6cf80d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfe000640 1 -- 172.21.15.28:0/1939470497 >> v1:172.21.15.137:6789/0 conn(0x7f6cf80d0c90 legacy=0x7f6cf815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:40.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.993+0000 7f6cfe000640 1 -- 172.21.15.28:0/1939470497 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf815bb10 con 0x7f6cf815f180 2024-04-23T18:22:40.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cfe000640 1 --2- 172.21.15.28:0/1939470497 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cf815f180 0x7f6cf80c5730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80d15d0 tx=0x7f6cf001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774853897da944d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:40.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cf7e00640 1 -- 172.21.15.28:0/1939470497 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00a5730 con 0x7f6cf815f180 2024-04-23T18:22:40.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cf7e00640 1 -- 172.21.15.28:0/1939470497 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf00a58d0 con 0x7f6cf815f180 2024-04-23T18:22:40.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cf7e00640 1 -- 172.21.15.28:0/1939470497 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00a5ca0 con 0x7f6cf815f180 2024-04-23T18:22:40.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cfea00640 1 -- 172.21.15.28:0/1939470497 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cf815f180 msgr2=0x7f6cf80c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:40.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cfea00640 1 --2- 172.21.15.28:0/1939470497 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cf815f180 0x7f6cf80c5730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80d15d0 tx=0x7f6cf001c960 comp rx=0 tx=0).stop 2024-04-23T18:22:40.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cfea00640 1 -- 172.21.15.28:0/1939470497 shutdown_connections 2024-04-23T18:22:40.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cfea00640 1 --2- 172.21.15.28:0/1939470497 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cf815f180 0x7f6cf80c5730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cfea00640 1 --2- 172.21.15.28:0/1939470497 >> v2:172.21.15.137:3300/0 conn(0x7f6cf8155310 0x7f6cf80d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cfea00640 1 -- 172.21.15.28:0/1939470497 >> 172.21.15.28:0/1939470497 conn(0x7f6cf80759a0 msgr2=0x7f6cf8072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:40.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cfea00640 1 -- 172.21.15.28:0/1939470497 shutdown_connections 2024-04-23T18:22:40.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:40.997+0000 7f6cfea00640 1 -- 172.21.15.28:0/1939470497 wait complete. 2024-04-23T18:22:40.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfea00640 1 Processor -- start 2024-04-23T18:22:40.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfea00640 1 -- start start 2024-04-23T18:22:40.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cf80d0c90 0x7f6cf8145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:40.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cf8155310 0x7f6cf8146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:40.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6cf815f180 0x7f6cf80cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:40.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfea00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80c6200 con 0x7f6cf8155310 2024-04-23T18:22:40.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80c6080 con 0x7f6cf80d0c90 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfea00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf8168240 con 0x7f6cf815f180 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfcc00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cf8155310 0x7f6cf8146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfcc00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cf8155310 0x7f6cf8146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47032/0 (socket says 172.21.15.28:47032) 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfcc00640 1 -- 172.21.15.28:0/3235463847 learned_addr learned my addr 172.21.15.28:0/3235463847 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfd600640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cf80d0c90 0x7f6cf8145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfe000640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6cf815f180 0x7f6cf80cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfcc00640 1 -- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6cf815f180 msgr2=0x7f6cf80cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6cf815f180 0x7f6cf80cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfcc00640 1 -- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cf80d0c90 msgr2=0x7f6cf8145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cf80d0c90 0x7f6cf8145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfcc00640 1 -- 172.21.15.28:0/3235463847 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf81460a0 con 0x7f6cf8155310 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cf8155310 0x7f6cf8146e00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400c450 tx=0x7f6ce400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cf5600640 1 -- 172.21.15.28:0/3235463847 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4016020 con 0x7f6cf8155310 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cf5600640 1 -- 172.21.15.28:0/3235463847 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce40052d0 con 0x7f6cf8155310 2024-04-23T18:22:40.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cf5600640 1 -- 172.21.15.28:0/3235463847 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4007260 con 0x7f6cf8155310 2024-04-23T18:22:41.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfea00640 1 -- 172.21.15.28:0/3235463847 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf81f7490 con 0x7f6cf8155310 2024-04-23T18:22:41.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.001+0000 7f6cfea00640 1 -- 172.21.15.28:0/3235463847 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf81f7a50 con 0x7f6cf8155310 2024-04-23T18:22:41.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6cf5600640 1 -- 172.21.15.28:0/3235463847 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6ce4007400 con 0x7f6cf8155310 2024-04-23T18:22:41.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6cf5600640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6cd80683b0 0x7f6cd806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:41.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6cf5600640 1 -- 172.21.15.28:0/3235463847 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6ce40866e0 con 0x7f6cf8155310 2024-04-23T18:22:41.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6d034d9000 1 Processor -- start 2024-04-23T18:22:41.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6cfd600640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6cd80683b0 0x7f6cd806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:41.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6d034d9000 1 -- start start 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6cfd600640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6cd80683b0 0x7f6cd806a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009b60 tx=0x7f6cec009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0fc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f137080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f1375c0 0x55837f1379a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6d034d9000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55837ef45420 con 0x55837f0fcab0 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6d034d9000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55837eedfbf0 con 0x55837f1375c0 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.005+0000 7f6d034d9000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55837ef413e0 con 0x55837f0fc190 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfcc00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f137080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfcc00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f137080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47048/0 (socket says 172.21.15.28:47048) 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfcc00640 1 -- 172.21.15.28:0/146187078 learned_addr learned my addr 172.21.15.28:0/146187078 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfd600640 1 --2- 172.21.15.28:0/146187078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0fc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfe000640 1 --2- 172.21.15.28:0/146187078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f1375c0 0x55837f1379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:41.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfcc00640 1 -- 172.21.15.28:0/146187078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 msgr2=0x55837f0fc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/146187078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0fc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfcc00640 1 -- 172.21.15.28:0/146187078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f1375c0 msgr2=0x55837f1379a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/146187078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f1375c0 0x55837f1379a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfcc00640 1 -- 172.21.15.28:0/146187078 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837efed450 con 0x55837f0fcab0 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/146187078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f137080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4055ec0 tx=0x7f6ce4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d067ff8875d61d38 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cea000640 1 -- 172.21.15.28:0/146187078 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce405eda0 con 0x55837f0fcab0 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cea000640 1 -- 172.21.15.28:0/146187078 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce40544c0 con 0x55837f0fcab0 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cea000640 1 -- 172.21.15.28:0/146187078 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce406abd0 con 0x55837f0fcab0 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 -- 172.21.15.28:0/146187078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 msgr2=0x55837f137080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 --2- 172.21.15.28:0/146187078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f137080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4055ec0 tx=0x7f6ce4011000 comp rx=0 tx=0).stop 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 -- 172.21.15.28:0/146187078 shutdown_connections 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 --2- 172.21.15.28:0/146187078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f1375c0 0x55837f1379a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:41.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 --2- 172.21.15.28:0/146187078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f137080 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:41.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 --2- 172.21.15.28:0/146187078 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0fc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:41.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 -- 172.21.15.28:0/146187078 >> 172.21.15.28:0/146187078 conn(0x55837f133e40 msgr2=0x55837f136260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:41.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 -- 172.21.15.28:0/146187078 shutdown_connections 2024-04-23T18:22:41.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 -- 172.21.15.28:0/146187078 wait complete. 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 -- start start 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 Processor -- start 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0f8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f0fcab0 0x55837f0f9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f1375c0 0x55837f0f9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55837eee5ec0 con 0x55837f1375c0 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55837efc6120 con 0x55837f0fcab0 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55837ef50350 con 0x55837f0fc190 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6d034d9000 10 client.0 _ll_register_callbacks cb 0x55837ef224d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfe000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f1375c0 0x55837f0f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfe000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f1375c0 0x55837f0f9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47052/0 (socket says 172.21.15.28:47052) 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfe000640 1 -- 172.21.15.28:0/3568537595 learned_addr learned my addr 172.21.15.28:0/3568537595 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.009+0000 7f6cfd600640 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0f8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f0fcab0 0x55837f0f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:41.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cfe000640 1 -- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 msgr2=0x55837f0f8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:41.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cfe000640 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0f8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:41.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cfe000640 1 -- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f0fcab0 msgr2=0x55837f0f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:41.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cfe000640 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f0fcab0 0x55837f0f9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:41.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cfe000640 1 -- 172.21.15.28:0/3568537595 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837ef8af80 con 0x55837f1375c0 2024-04-23T18:22:41.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cfe000640 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f1375c0 0x55837f0f9640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6cf001a590 tx=0x7f6cf001b1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e8d9b864bc2b50 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:41.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cdea00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:22:41.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cdea00640 1 -- 172.21.15.28:0/3568537595 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00bc070 con 0x55837f1375c0 2024-04-23T18:22:41.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6d034d9000 1 -- 172.21.15.28:0/3568537595 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ce40544c0 con 0x55837f1375c0 2024-04-23T18:22:41.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cdea00640 1 -- 172.21.15.28:0/3568537595 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6cf00c1e00 con 0x55837f1375c0 2024-04-23T18:22:41.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cdea00640 1 -- 172.21.15.28:0/3568537595 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f6cf00a5a70 con 0x55837f1375c0 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6d034d9000 10 client.4404 fetch_fsmap learned FSMap version 7 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6d034d9000 1 -- 172.21.15.28:0/3568537595 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55837ef1ef00 con 0x55837f1375c0 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cdea00640 1 -- 172.21.15.28:0/3568537595 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce40544c0 con 0x55837f1375c0 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cdea00640 1 -- 172.21.15.28:0/3568537595 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f6cf00c8050 con 0x55837f1375c0 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6d034d9000 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6d034d9000 10 client.4404 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6d034d9000 20 client.4404 populate_metadata read hostname 'smithi028' 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6d034d9000 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f14bd90 0x55837f14e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6d034d9000 4 client.4404 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6d034d9000 1 -- 172.21.15.28:0/3568537595 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55837eedebc0 con 0x55837f14bd90 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cfd600640 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f14bd90 0x55837f14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:41.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cfd600640 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f14bd90 0x55837f14e180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1854e357f8e01a0c server_cookie=d2d0782e1dc5b007 in_seq=0 out_seq=0 2024-04-23T18:22:41.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:41.013+0000 7f6cdea00640 10 client.4404 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:22:44.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6cdea00640 1 -- 172.21.15.28:0/3568537595 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55837eedebc0 con 0x55837f14bd90 2024-04-23T18:22:44.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6cdea00640 10 client.4404 handle_command_reply: tid=0 2024-04-23T18:22:44.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 1 client.4404 shutdown 2024-04-23T18:22:44.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 1 -- 172.21.15.28:0/3568537595 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f1375c0 msgr2=0x55837f0f9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:44.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f1375c0 0x55837f0f9640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6cf001a590 tx=0x7f6cf001b1a0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 1 -- 172.21.15.28:0/3568537595 shutdown_connections 2024-04-23T18:22:44.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f14bd90 0x55837f14e180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f1375c0 0x55837f0f9640 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f0fcab0 0x55837f0f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6cdea00640 0 client.4404 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:22:44.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 1 --2- 172.21.15.28:0/3568537595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0f8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 1 -- 172.21.15.28:0/3568537595 >> 172.21.15.28:0/3568537595 conn(0x55837f133e40 msgr2=0x55837f1351c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:44.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 1 -- 172.21.15.28:0/3568537595 shutdown_connections 2024-04-23T18:22:44.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 1 -- 172.21.15.28:0/3568537595 wait complete. 2024-04-23T18:22:44.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.401+0000 7f6d034d9000 20 client.4404 trim_cache size 0 max 16384 2024-04-23T18:22:44.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 Processor -- start 2024-04-23T18:22:44.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 -- start start 2024-04-23T18:22:44.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0f5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f0f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f1375c0 0x55837f14e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8201150 con 0x55837f0fcab0 2024-04-23T18:22:44.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf82004b0 con 0x55837f1375c0 2024-04-23T18:22:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf8200b00 con 0x55837f0fc190 2024-04-23T18:22:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfcc00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f0f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfcc00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f0f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47058/0 (socket says 172.21.15.28:47058) 2024-04-23T18:22:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfcc00640 1 -- 172.21.15.28:0/2058464933 learned_addr learned my addr 172.21.15.28:0/2058464933 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfd600640 1 --2- 172.21.15.28:0/2058464933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfe000640 1 --2- 172.21.15.28:0/2058464933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f1375c0 0x55837f14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfcc00640 1 -- 172.21.15.28:0/2058464933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 msgr2=0x55837f0f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/2058464933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfcc00640 1 -- 172.21.15.28:0/2058464933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f1375c0 msgr2=0x55837f14e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/2058464933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f1375c0 0x55837f14e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfcc00640 1 -- 172.21.15.28:0/2058464933 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837eecbe80 con 0x55837f0fcab0 2024-04-23T18:22:44.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfd600640 1 --2- 172.21.15.28:0/2058464933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:44.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/2058464933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f0f5dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4005630 tx=0x7f6ce405a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d10e85a8ded7e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:44.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6ce9600640 1 -- 172.21.15.28:0/2058464933 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4074070 con 0x55837f0fcab0 2024-04-23T18:22:44.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6ce9600640 1 -- 172.21.15.28:0/2058464933 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce405eda0 con 0x55837f0fcab0 2024-04-23T18:22:44.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6ce9600640 1 -- 172.21.15.28:0/2058464933 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40076f0 con 0x55837f0fcab0 2024-04-23T18:22:44.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 -- 172.21.15.28:0/2058464933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 msgr2=0x55837f0f5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:44.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 --2- 172.21.15.28:0/2058464933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f0f5dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4005630 tx=0x7f6ce405a040 comp rx=0 tx=0).stop 2024-04-23T18:22:44.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 -- 172.21.15.28:0/2058464933 shutdown_connections 2024-04-23T18:22:44.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 --2- 172.21.15.28:0/2058464933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f1375c0 0x55837f14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 --2- 172.21.15.28:0/2058464933 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fcab0 0x55837f0f5dd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 --2- 172.21.15.28:0/2058464933 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f0fc190 0x55837f0f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 -- 172.21.15.28:0/2058464933 >> 172.21.15.28:0/2058464933 conn(0x55837f133e40 msgr2=0x55837f131e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:44.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 -- 172.21.15.28:0/2058464933 shutdown_connections 2024-04-23T18:22:44.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.425+0000 7f6d034d9000 1 -- 172.21.15.28:0/2058464933 wait complete. 2024-04-23T18:22:44.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 1 -- start start 2024-04-23T18:22:44.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 1 Processor -- start 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fc190 0x55837f1a9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f0fcab0 0x55837f1a9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f1375c0 0x55837f1a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55837ef44730 con 0x55837f0fc190 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55837ef119e0 con 0x55837f0fcab0 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55837ef49a50 con 0x55837f1375c0 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 10 client.0 _ll_register_callbacks cb 0x7f6cec009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cfd600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fc190 0x55837f1a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cfd600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fc190 0x55837f1a9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47068/0 (socket says 172.21.15.28:47068) 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cfd600640 1 -- 172.21.15.28:0/2895168694 learned_addr learned my addr 172.21.15.28:0/2895168694 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f0fcab0 0x55837f1a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cfe000640 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f1375c0 0x55837f1a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cfd600640 1 -- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f1375c0 msgr2=0x55837f1a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cfd600640 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f1375c0 0x55837f1a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cfd600640 1 -- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f0fcab0 msgr2=0x55837f1a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cfd600640 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f0fcab0 0x55837f1a9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cfd600640 1 -- 172.21.15.28:0/2895168694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837ef0db30 con 0x55837f0fc190 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cfd600640 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fc190 0x55837f1a9100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6cec011750 tx=0x7f6cec004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e6c0cef16001d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cdea00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cdea00640 1 -- 172.21.15.28:0/2895168694 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec003b20 con 0x55837f0fc190 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cdea00640 1 -- 172.21.15.28:0/2895168694 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6cec003cc0 con 0x55837f0fc190 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 1 -- 172.21.15.28:0/2895168694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ce405eda0 con 0x55837f0fc190 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cdea00640 1 -- 172.21.15.28:0/2895168694 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f6cec0059a0 con 0x55837f0fc190 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 10 client.4410 fetch_fsmap learned FSMap version 7 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6d034d9000 1 -- 172.21.15.28:0/2895168694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55837efc65b0 con 0x55837f0fc190 2024-04-23T18:22:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.429+0000 7f6cdea00640 1 -- 172.21.15.28:0/2895168694 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce405eda0 con 0x55837f0fc190 2024-04-23T18:22:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.433+0000 7f6cdea00640 1 -- 172.21.15.28:0/2895168694 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f6cec03c080 con 0x55837f0fc190 2024-04-23T18:22:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.433+0000 7f6d034d9000 10 client.4410 fetch_fsmap finished waiting for FSMap version 7 2024-04-23T18:22:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.433+0000 7f6d034d9000 10 client.4410 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T18:22:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.433+0000 7f6d034d9000 20 client.4410 populate_metadata read hostname 'smithi028' 2024-04-23T18:22:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.433+0000 7f6d034d9000 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f1b3010 0x55837f1aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.433+0000 7f6d034d9000 4 client.4410 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T18:22:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.433+0000 7f6d034d9000 1 -- 172.21.15.28:0/2895168694 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "status"}) -- 0x55837ef52e40 con 0x55837f1b3010 2024-04-23T18:22:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.433+0000 7f6cfcc00640 1 -- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f1b3010 msgr2=0x55837f1aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-04-23T18:22:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.433+0000 7f6cfcc00640 1 -- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f1b3010 msgr2=0x55837f1aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T18:22:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.433+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f1b3010 0x55837f1aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2024-04-23T18:22:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.433+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f1b3010 0x55837f1aac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T18:22:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f1b3010 0x55837f1aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6cfcc00640 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f1b3010 0x55837f1aac50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4236eab9bdfe10a3 server_cookie=11dd20cb51b3f14d in_seq=0 out_seq=0 2024-04-23T18:22:44.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6cdea00640 10 client.4410 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:22:44.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6cdea00640 1 -- 172.21.15.28:0/2895168694 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55837ef52e40 con 0x55837f1b3010 2024-04-23T18:22:44.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6cdea00640 10 client.4410 handle_command_reply: tid=0 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 1 client.4410 shutdown 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 1 -- 172.21.15.28:0/2895168694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fc190 msgr2=0x55837f1a9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fc190 0x55837f1a9100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6cec011750 tx=0x7f6cec004740 comp rx=0 tx=0).stop 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 1 -- 172.21.15.28:0/2895168694 shutdown_connections 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55837f1b3010 0x55837f1aac50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55837f1375c0 0x55837f1a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55837f0fcab0 0x55837f1a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 1 --2- 172.21.15.28:0/2895168694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55837f0fc190 0x55837f1a9100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 1 -- 172.21.15.28:0/2895168694 >> 172.21.15.28:0/2895168694 conn(0x55837f133e40 msgr2=0x55837f1329c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6cdea00640 0 client.4410 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 1 -- 172.21.15.28:0/2895168694 shutdown_connections 2024-04-23T18:22:44.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 1 -- 172.21.15.28:0/2895168694 wait complete. 2024-04-23T18:22:44.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6d034d9000 20 client.4410 trim_cache size 0 max 16384 2024-04-23T18:22:44.636 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:22:44.636 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "d84cc156-ceaf-4cae-a89c-ee7e55af72c5", 2024-04-23T18:22:44.636 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2024-04-23T18:22:44.636 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4297, 2024-04-23T18:22:44.637 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-04-23T18:22:44.637 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-04-23T18:22:44.637 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-04-23T18:22:44.637 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 11.270953575, 2024-04-23T18:22:44.637 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 6, 2024-04-23T18:22:44.637 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 24, 2024-04-23T18:22:44.637 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T18:22:44.637 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 18.704308450999999 2024-04-23T18:22:44.637 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:22:44.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6cfea00640 1 -- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6cd80683b0 msgr2=0x7f6cd806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:44.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6cfea00640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6cd80683b0 0x7f6cd806a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009b60 tx=0x7f6cec009190 comp rx=0 tx=0).stop 2024-04-23T18:22:44.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6cfea00640 1 -- 172.21.15.28:0/3235463847 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cf8155310 msgr2=0x7f6cf8146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:44.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.637+0000 7f6cfea00640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cf8155310 0x7f6cf8146e00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400c450 tx=0x7f6ce400c910 comp rx=0 tx=0).stop 2024-04-23T18:22:44.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.641+0000 7f6cfea00640 1 -- 172.21.15.28:0/3235463847 shutdown_connections 2024-04-23T18:22:44.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.641+0000 7f6cfea00640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6cd80683b0 0x7f6cd806a870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.641+0000 7f6cfea00640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6cf815f180 0x7f6cf80cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.641+0000 7f6cfea00640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6cf8155310 0x7f6cf8146e00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.641+0000 7f6cfea00640 1 --2- 172.21.15.28:0/3235463847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6cf80d0c90 0x7f6cf8145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.641+0000 7f6cfea00640 1 -- 172.21.15.28:0/3235463847 >> 172.21.15.28:0/3235463847 conn(0x7f6cf80759a0 msgr2=0x7f6cf80b6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:44.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.641+0000 7f6cfea00640 1 -- 172.21.15.28:0/3235463847 shutdown_connections 2024-04-23T18:22:44.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.641+0000 7f6cfea00640 1 -- 172.21.15.28:0/3235463847 wait complete. 2024-04-23T18:22:44.660 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-23T18:22:44.661 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-23T18:22:44.661 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-23T18:22:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.813+0000 7fbb56a00640 1 Processor -- start 2024-04-23T18:22:44.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.813+0000 7fbb56a00640 1 -- start start 2024-04-23T18:22:44.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.813+0000 7fbb56a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbb501444e0 0x7fbb500710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.813+0000 7fbb56a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb500c91e0 0x7fbb5006c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.813+0000 7fbb56a00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5015b650 con 0x7fbb50072dc0 2024-04-23T18:22:44.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.813+0000 7fbb56a00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5015b930 con 0x7fbb501444e0 2024-04-23T18:22:44.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.813+0000 7fbb56a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5015bc10 con 0x7fbb500c91e0 2024-04-23T18:22:44.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.813+0000 7fbb54a00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbb50072dc0 0x7fbb5015ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57590/0 (socket says 172.21.15.28:57590) 2024-04-23T18:22:44.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.813+0000 7fbb54a00640 1 -- 172.21.15.28:0/3345767714 learned_addr learned my addr 172.21.15.28:0/3345767714 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:44.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.813+0000 7fbb4fe00640 1 --2- 172.21.15.28:0/3345767714 >> v2:172.21.15.28:3300/0 conn(0x7fbb501444e0 0x7fbb500710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb47e00640 1 --2- 172.21.15.28:0/3345767714 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb500c91e0 0x7fbb5006c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb4fe00640 1 -- 172.21.15.28:0/3345767714 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb500c91e0 msgr2=0x7fbb5006c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:44.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb4fe00640 1 --2- 172.21.15.28:0/3345767714 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb500c91e0 0x7fbb5006c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb4fe00640 1 -- 172.21.15.28:0/3345767714 >> v1:172.21.15.28:6789/0 conn(0x7fbb50072dc0 legacy=0x7fbb5015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:44.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb4fe00640 1 -- 172.21.15.28:0/3345767714 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5015bef0 con 0x7fbb501444e0 2024-04-23T18:22:44.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb4f400640 1 -- 172.21.15.28:0/3345767714 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3358749898 0 0) 0x7fbb5015b650 con 0x7fbb50072dc0 2024-04-23T18:22:44.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb4fe00640 1 --2- 172.21.15.28:0/3345767714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb501444e0 0x7fbb500710e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb400097c0 tx=0x7fbb4001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5a18819897b364 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:44.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb4f400640 1 -- 172.21.15.28:0/3345767714 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb400b5070 con 0x7fbb501444e0 2024-04-23T18:22:44.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb4f400640 1 -- 172.21.15.28:0/3345767714 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb400a8990 con 0x7fbb501444e0 2024-04-23T18:22:44.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb4f400640 1 -- 172.21.15.28:0/3345767714 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb400a8d60 con 0x7fbb501444e0 2024-04-23T18:22:44.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb56a00640 1 -- 172.21.15.28:0/3345767714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb501444e0 msgr2=0x7fbb500710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:44.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.817+0000 7fbb56a00640 1 --2- 172.21.15.28:0/3345767714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb501444e0 0x7fbb500710e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb400097c0 tx=0x7fbb4001ec90 comp rx=0 tx=0).stop 2024-04-23T18:22:44.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 -- 172.21.15.28:0/3345767714 shutdown_connections 2024-04-23T18:22:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 --2- 172.21.15.28:0/3345767714 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb500c91e0 0x7fbb5006c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 --2- 172.21.15.28:0/3345767714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb501444e0 0x7fbb500710e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 -- 172.21.15.28:0/3345767714 >> 172.21.15.28:0/3345767714 conn(0x7fbb500676e0 msgr2=0x7fbb50067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 -- 172.21.15.28:0/3345767714 shutdown_connections 2024-04-23T18:22:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 -- 172.21.15.28:0/3345767714 wait complete. 2024-04-23T18:22:44.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 Processor -- start 2024-04-23T18:22:44.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 -- start start 2024-04-23T18:22:44.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb50072dc0 0x7fbb501f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb500c91e0 0x7fbb50158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb501444e0 0x7fbb500ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbb501448c0 con 0x7fbb500c91e0 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5015b300 con 0x7fbb501444e0 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb56a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbb50144a40 con 0x7fbb50072dc0 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb47e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb500c91e0 0x7fbb50158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb47e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb500c91e0 0x7fbb50158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47084/0 (socket says 172.21.15.28:47084) 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb47e00640 1 -- 172.21.15.28:0/413669677 learned_addr learned my addr 172.21.15.28:0/413669677 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb4fe00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb50072dc0 0x7fbb501f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb54a00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb501444e0 0x7fbb500ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb47e00640 1 -- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb50072dc0 msgr2=0x7fbb501f1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb47e00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb50072dc0 0x7fbb501f1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb47e00640 1 -- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb501444e0 msgr2=0x7fbb500ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb47e00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb501444e0 0x7fbb500ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb47e00640 1 -- 172.21.15.28:0/413669677 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb501e4670 con 0x7fbb500c91e0 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb47e00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb500c91e0 0x7fbb50158350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800e930 tx=0x7fbb3800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb4cc00640 1 -- 172.21.15.28:0/413669677 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38017070 con 0x7fbb500c91e0 2024-04-23T18:22:44.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.821+0000 7fbb4cc00640 1 -- 172.21.15.28:0/413669677 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3800ca00 con 0x7fbb500c91e0 2024-04-23T18:22:44.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.825+0000 7fbb56a00640 1 -- 172.21.15.28:0/413669677 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb501e4950 con 0x7fbb500c91e0 2024-04-23T18:22:44.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.825+0000 7fbb4cc00640 1 -- 172.21.15.28:0/413669677 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800cdd0 con 0x7fbb500c91e0 2024-04-23T18:22:44.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.825+0000 7fbb56a00640 1 -- 172.21.15.28:0/413669677 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb500c9d00 con 0x7fbb500c91e0 2024-04-23T18:22:44.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.825+0000 7fbb56a00640 1 -- 172.21.15.28:0/413669677 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb501e4e70 con 0x7fbb500c91e0 2024-04-23T18:22:44.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.825+0000 7fbb4cc00640 1 -- 172.21.15.28:0/413669677 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb3801a070 con 0x7fbb500c91e0 2024-04-23T18:22:44.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.825+0000 7fbb4cc00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb2c068380 0x7fbb2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:44.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.825+0000 7fbb4cc00640 1 -- 172.21.15.28:0/413669677 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbb38086ff0 con 0x7fbb500c91e0 2024-04-23T18:22:44.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.825+0000 7fbb4fe00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb2c068380 0x7fbb2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:44.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.829+0000 7fbb4fe00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb2c068380 0x7fbb2c06a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb400b2000 tx=0x7fbb40008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:44.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:44.829+0000 7fbb4cc00640 1 -- 172.21.15.28:0/413669677 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb38056c80 con 0x7fbb500c91e0 2024-04-23T18:22:45.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.033+0000 7fbb56a00640 1 -- 172.21.15.28:0/413669677 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbb50068cd0 con 0x7fbb500c91e0 2024-04-23T18:22:45.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb4cc00640 1 -- 172.21.15.28:0/413669677 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fbb3805af80 con 0x7fbb500c91e0 2024-04-23T18:22:45.031 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-23T18:22:45.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 -- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb2c068380 msgr2=0x7fbb2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:45.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb2c068380 0x7fbb2c06a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb400b2000 tx=0x7fbb40008040 comp rx=0 tx=0).stop 2024-04-23T18:22:45.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 -- 172.21.15.28:0/413669677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb500c91e0 msgr2=0x7fbb50158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:45.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb500c91e0 0x7fbb50158350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800e930 tx=0x7fbb3800edf0 comp rx=0 tx=0).stop 2024-04-23T18:22:45.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 -- 172.21.15.28:0/413669677 shutdown_connections 2024-04-23T18:22:45.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb2c068380 0x7fbb2c06a840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:45.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb501444e0 0x7fbb500ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:45.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb500c91e0 0x7fbb50158350 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:45.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 --2- 172.21.15.28:0/413669677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb50072dc0 0x7fbb501f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:45.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 -- 172.21.15.28:0/413669677 >> 172.21.15.28:0/413669677 conn(0x7fbb500676e0 msgr2=0x7fbb50141c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:45.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 -- 172.21.15.28:0/413669677 shutdown_connections 2024-04-23T18:22:45.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45.037+0000 7fbb56a00640 1 -- 172.21.15.28:0/413669677 wait complete. 2024-04-23T18:22:45.052 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-23T18:22:45.052 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-23T18:22:45.052 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-04-23T18:22:45.053 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-23T18:22:45.053 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-23T18:22:45.053 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-23T18:22:45.053 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-23T18:22:45.053 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-23T18:22:45.053 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-23T18:22:45.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:45.053 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-04-23T18:22:45.062 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-23T18:22:45.062 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-23T18:22:45.062 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-04-23T18:22:45.062 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-04-23T18:22:45.062 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-04-23T18:22:45.062 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42435sec preferred_lft 42435sec 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-04-23T18:22:45.063 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T18:22:45.064 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-04-23T18:22:45.064 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-04-23T18:22:45.064 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-23T18:22:45.064 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:b1:95:a8:69 brd ff:ff:ff:ff:ff:ff 2024-04-23T18:22:45.064 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-23T18:22:45.064 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-04-23T18:22:45.065 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-23T18:22:45.065 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T18:22:45.065 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-04-23T18:22:45.065 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add name ceph-brx type bridge 2024-04-23T18:22:45.065 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr flush dev ceph-brx 2024-04-23T18:22:45.065 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set ceph-brx up 2024-04-23T18:22:45.066 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-23T18:22:45.066 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-04-23T18:22:45.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T18:22:45.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:22:45.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:45.224 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-23T18:22:45.243 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-04-23T18:22:45.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:45.246 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-04-23T18:22:45.309 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-04-23T18:22:45.309 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-23T18:22:45.309 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-23T18:22:45.309 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-23T18:22:45.309 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-23T18:22:45.309 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-23T18:22:45.310 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T18:22:45.310 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-04-23T18:22:45.310 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-23T18:22:45.310 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-23T18:22:45.310 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-23T18:22:45.310 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-04-23T18:22:45.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T18:22:45.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:22:45.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:45.451 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-04-23T18:22:45.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:45.461 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list-id 2024-04-23T18:22:45.512 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T18:22:45.513 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-04-23T18:22:45.513 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T18:22:45.513 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-23T18:22:45.513 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-04-23T18:22:45.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T18:22:45.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:22:45.640 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-23T18:22:45.641 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T18:22:45.641 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-04-23T18:22:45.641 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-23T18:22:45.641 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-23T18:22:45.641 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-23T18:22:45.642 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-23T18:22:45.642 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-23T18:22:45.642 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-04-23T18:22:45.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T18:22:45.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:22:45.811 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T18:22:45.811 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-04-23T18:22:45.812 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2024-04-23T18:22:45.812 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set dev brx.0 master ceph-brx 2024-04-23T18:22:45.812 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-04-23T18:22:45.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T18:22:45.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:22:45.898 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-23T18:22:45.898 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T18:22:45.898 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-23T18:22:45.907 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-23T18:22:45.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T18:22:45.907 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-23T18:22:45.963 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-04-23T18:22:46.031 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T18:22:46.088 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-04-23T18:22:46.088 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-04-23T18:22:46.088 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-04-23T18:22:46.089 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T18:22:46.090 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-04-23T18:22:46.091 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T18:22:46.091 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T18:22:46.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:46.092 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-04-23T18:22:46.147 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-23T18:22:46.147 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-23T18:22:46.198 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-04-23T18:22:46.218 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T18:22:46.268 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-04-23T18:22:46.268 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-04-23T18:22:46.268 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-04-23T18:22:46.268 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-04-23T18:22:46.268 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-04-23T18:22:46.268 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-04-23T18:22:46.268 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-04-23T18:22:46.268 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-04-23T18:22:46.269 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T18:22:46.270 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-04-23T18:22:46.270 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-04-23T18:22:46.270 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-04-23T18:22:46.270 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T18:22:46.270 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T18:22:46.270 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T18:22:46.270 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T18:22:46.270 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-04-23T18:22:46.270 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T18:22:46.270 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T18:22:46.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:46.271 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-04-23T18:22:46.295 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi028.stderr:2024-04-23T18:22:46.297+0000 7fb373c38580 -1 init, newargv = 0x55a2621e10e0 newargc=15 2024-04-23T18:22:46.295 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi028.stderr:ceph-fuse[32454]: starting ceph client 2024-04-23T18:22:46.308 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi028.stderr:ceph-fuse[32454]: starting fuse 2024-04-23T18:22:47.405 DEBUG:teuthology.orchestra.run.smithi028:> sudo modprobe fuse 2024-04-23T18:22:47.432 DEBUG:teuthology.orchestra.run.smithi028:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T18:22:47.485 INFO:teuthology.orchestra.run.smithi028.stdout:/sys 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/proc 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/dev 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/pts 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/run 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/ 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/security 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/shm 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/run/lock 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/cgroup 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/pstore 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/bpf 2024-04-23T18:22:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/hugepages 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/dev/mqueue 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/debug 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/tracing 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/proc/fs/nfsd 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/fs/fuse/connections 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/sys/kernel/config 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/run/rpc_pipefs 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/run/user/1000 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T18:22:47.487 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T18:22:47.488 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T18:22:47.488 INFO:teuthology.orchestra.run.smithi028.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T18:22:47.488 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns 2024-04-23T18:22:47.488 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T18:22:47.488 INFO:teuthology.orchestra.run.smithi028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T18:22:47.488 INFO:teuthology.orchestra.run.smithi028.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-23T18:22:47.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:47.489 DEBUG:teuthology.orchestra.run.smithi028:> ls /sys/fs/fuse/connections 2024-04-23T18:22:47.540 INFO:teuthology.orchestra.run.smithi028.stdout:44 2024-04-23T18:22:47.540 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-23T18:22:47.540 DEBUG:teuthology.orchestra.run.smithi028:> sudo stdin-killer -- python3 -c ' 2024-04-23T18:22:47.540 DEBUG:teuthology.orchestra.run.smithi028:> import glob 2024-04-23T18:22:47.540 DEBUG:teuthology.orchestra.run.smithi028:> import re 2024-04-23T18:22:47.540 DEBUG:teuthology.orchestra.run.smithi028:> import os 2024-04-23T18:22:47.540 DEBUG:teuthology.orchestra.run.smithi028:> import subprocess 2024-04-23T18:22:47.540 DEBUG:teuthology.orchestra.run.smithi028:> 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> def _find_admin_socket(client_name): 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> files = glob.glob(asok_path) 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> # Given a non-glob path, it better be there 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> if "*" not in asok_path: 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> assert(len(files) == 1) 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> return files[0] 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> for f in files: 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> contents = proc_f.read() 2024-04-23T18:22:47.541 DEBUG:teuthology.orchestra.run.smithi028:> if mountpoint in contents: 2024-04-23T18:22:47.542 DEBUG:teuthology.orchestra.run.smithi028:> return f 2024-04-23T18:22:47.542 DEBUG:teuthology.orchestra.run.smithi028:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-23T18:22:47.542 DEBUG:teuthology.orchestra.run.smithi028:> 2024-04-23T18:22:47.542 DEBUG:teuthology.orchestra.run.smithi028:> print(_find_admin_socket("client.admin")) 2024-04-23T18:22:47.542 DEBUG:teuthology.orchestra.run.smithi028:> ' 2024-04-23T18:22:47.675 INFO:teuthology.orchestra.run.smithi028.stdout:/var/run/ceph/ceph-client.admin.32454.asok 2024-04-23T18:22:47.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:22:47.688 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32454.asok 2024-04-23T18:22:47.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:47.688 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32454.asok status 2024-04-23T18:22:47.867 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:22:47.867 INFO:teuthology.orchestra.run.smithi028.stdout: "metadata": { 2024-04-23T18:22:47.867 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-23T18:22:47.867 INFO:teuthology.orchestra.run.smithi028.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-23T18:22:47.867 INFO:teuthology.orchestra.run.smithi028.stdout: "entity_id": "admin", 2024-04-23T18:22:47.868 INFO:teuthology.orchestra.run.smithi028.stdout: "hostname": "smithi028", 2024-04-23T18:22:47.868 INFO:teuthology.orchestra.run.smithi028.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-23T18:22:47.868 INFO:teuthology.orchestra.run.smithi028.stdout: "pid": "32454", 2024-04-23T18:22:47.868 INFO:teuthology.orchestra.run.smithi028.stdout: "root": "/" 2024-04-23T18:22:47.868 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:22:47.868 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_count": 0, 2024-04-23T18:22:47.868 INFO:teuthology.orchestra.run.smithi028.stdout: "dentry_pinned_count": 0, 2024-04-23T18:22:47.868 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4425, 2024-04-23T18:22:47.868 INFO:teuthology.orchestra.run.smithi028.stdout: "inst": { 2024-04-23T18:22:47.869 INFO:teuthology.orchestra.run.smithi028.stdout: "name": { 2024-04-23T18:22:47.869 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "client", 2024-04-23T18:22:47.869 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 4425 2024-04-23T18:22:47.869 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:22:47.869 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-04-23T18:22:47.869 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-04-23T18:22:47.869 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 202499295 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": { 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "192.168.0.1:0", 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 202499295 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: "inst_str": "client.4425 192.168.0.1:0/202499295", 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: "addr_str": "192.168.0.1:0/202499295", 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: "inode_count": 1, 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: "mds_epoch": 6, 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch": 24, 2024-04-23T18:22:47.870 INFO:teuthology.orchestra.run.smithi028.stdout: "osd_epoch_barrier": 0, 2024-04-23T18:22:47.871 INFO:teuthology.orchestra.run.smithi028.stdout: "blocklisted": false, 2024-04-23T18:22:47.871 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs" 2024-04-23T18:22:47.871 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:22:47.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:47.882 DEBUG:teuthology.orchestra.run.smithi028:> stat --file-system '--printf=%T 2024-04-23T18:22:47.882 DEBUG:teuthology.orchestra.run.smithi028:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-23T18:22:47.892 INFO:teuthology.orchestra.run.smithi028.stdout:fuseblk 2024-04-23T18:22:47.893 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-23T18:22:47.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:47.893 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-23T18:22:47.956 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-23T18:22:48.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T18:22:48.093 INFO:teuthology.orchestra.run.smithi028.stdout:# file: . 2024-04-23T18:22:48.093 INFO:teuthology.orchestra.run.smithi028.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-23T18:22:48.093 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:48.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:22:48.100 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:22:48.100 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T18:22:48.109 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:48.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.297+0000 7f2599400640 1 Processor -- start 2024-04-23T18:22:48.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.297+0000 7f2599400640 1 -- start start 2024-04-23T18:22:48.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2599400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f25941531a0 0x7f25940c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2599400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25940c9e70 0x7f2594072f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2599400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25940c3bc0 con 0x7f25940c9a00 2024-04-23T18:22:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2599400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f25940c4940 con 0x7f25941531a0 2024-04-23T18:22:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2599400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f25940c6790 con 0x7f25940c9e70 2024-04-23T18:22:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2589e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f25940c9a00 0x7f2594158ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57598/0 (socket says 172.21.15.28:57598) 2024-04-23T18:22:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2589e00640 1 -- 172.21.15.28:0/4266290215 learned_addr learned my addr 172.21.15.28:0/4266290215 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2592800640 1 --2- 172.21.15.28:0/4266290215 >> v2:172.21.15.137:3300/0 conn(0x7f25941531a0 0x7f25940c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2593200640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25940c9e70 0x7f2594072f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311000031 0 0) 0x7f25940c3bc0 con 0x7f25940c9a00 2024-04-23T18:22:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2578003530 con 0x7f25940c9a00 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4001667268 0 0) 0x7f2578003530 con 0x7f25940c9a00 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25940c9e70 msgr2=0x7f2594072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25940c9e70 0x7f2594072f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 >> v2:172.21.15.137:3300/0 conn(0x7f25941531a0 msgr2=0x7f25940c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 --2- 172.21.15.28:0/4266290215 >> v2:172.21.15.137:3300/0 conn(0x7f25941531a0 0x7f25940c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25940c6a70 con 0x7f25940c9a00 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f257c001680 con 0x7f25940c9a00 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 >> v1:172.21.15.28:6789/0 conn(0x7f25940c9a00 legacy=0x7f2594158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 0x7f2578003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2578004810 0x7f2578004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25780051d0 0x7f257800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f25940c4940 con 0x7f25780039c0 2024-04-23T18:22:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25940c6790 con 0x7f2578004810 2024-04-23T18:22:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f257800bf10 con 0x7f25780051d0 2024-04-23T18:22:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2592800640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 0x7f2578003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2589e00640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2578004810 0x7f2578004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2593200640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25780051d0 0x7f257800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2592800640 1 -- 172.21.15.28:0/4266290215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25780051d0 msgr2=0x7f257800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2592800640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f25780051d0 0x7f257800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2592800640 1 -- 172.21.15.28:0/4266290215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2578004810 msgr2=0x7f2578004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2592800640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2578004810 0x7f2578004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.301+0000 7f2592800640 1 -- 172.21.15.28:0/4266290215 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2578003530 con 0x7f25780039c0 2024-04-23T18:22:48.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2592800640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 0x7f2578003de0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2584009ae0 tx=0x7f258401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976255289402be08 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840b2070 con 0x7f25780039c0 2024-04-23T18:22:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25840a5590 con 0x7f25780039c0 2024-04-23T18:22:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2591e00640 1 -- 172.21.15.28:0/4266290215 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840096b0 con 0x7f25780039c0 2024-04-23T18:22:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2599400640 1 -- 172.21.15.28:0/4266290215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 msgr2=0x7f2578003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2599400640 1 --2- 172.21.15.28:0/4266290215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 0x7f2578003de0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2584009ae0 tx=0x7f258401cab0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2593200640 1 -- 172.21.15.28:0/4266290215 reap_dead start 2024-04-23T18:22:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2599400640 1 -- 172.21.15.28:0/4266290215 shutdown_connections 2024-04-23T18:22:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2599400640 1 -- 172.21.15.28:0/4266290215 >> 172.21.15.28:0/4266290215 conn(0x7f259406d0a0 msgr2=0x7f25940676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2599400640 1 -- 172.21.15.28:0/4266290215 shutdown_connections 2024-04-23T18:22:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2599400640 1 -- 172.21.15.28:0/4266290215 wait complete. 2024-04-23T18:22:48.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2599400640 1 Processor -- start 2024-04-23T18:22:48.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.305+0000 7f2599400640 1 -- start start 2024-04-23T18:22:48.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2599400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 0x7f25941594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2599400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2594149cc0 0x7f259414f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2599400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f259414fa00 0x7f259414b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2599400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f25940c4420 con 0x7f25780039c0 2024-04-23T18:22:48.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2599400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25940c4140 con 0x7f259414fa00 2024-04-23T18:22:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2599400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2594153580 con 0x7f2594149cc0 2024-04-23T18:22:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2592800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 0x7f25941594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2592800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 0x7f25941594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47108/0 (socket says 172.21.15.28:47108) 2024-04-23T18:22:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2592800640 1 -- 172.21.15.28:0/2610860395 learned_addr learned my addr 172.21.15.28:0/2610860395 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2593200640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f259414fa00 0x7f259414b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2589e00640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2594149cc0 0x7f259414f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2592800640 1 -- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2594149cc0 msgr2=0x7f259414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2592800640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2594149cc0 0x7f259414f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2592800640 1 -- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f259414fa00 msgr2=0x7f259414b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2592800640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f259414fa00 0x7f259414b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2592800640 1 -- 172.21.15.28:0/2610860395 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25941562f0 con 0x7f25780039c0 2024-04-23T18:22:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2592800640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 0x7f25941594e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f258401c8e0 tx=0x7f2578005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f258b400640 1 -- 172.21.15.28:0/2610860395 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840bc020 con 0x7f25780039c0 2024-04-23T18:22:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f258b400640 1 -- 172.21.15.28:0/2610860395 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2584004020 con 0x7f25780039c0 2024-04-23T18:22:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f258b400640 1 -- 172.21.15.28:0/2610860395 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840b2040 con 0x7f25780039c0 2024-04-23T18:22:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2599400640 1 -- 172.21.15.28:0/2610860395 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25941f29f0 con 0x7f25780039c0 2024-04-23T18:22:48.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2599400640 1 -- 172.21.15.28:0/2610860395 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2594156870 con 0x7f25780039c0 2024-04-23T18:22:48.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.309+0000 7f2599400640 1 -- 172.21.15.28:0/2610860395 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2594068cd0 con 0x7f25780039c0 2024-04-23T18:22:48.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.313+0000 7f258b400640 1 -- 172.21.15.28:0/2610860395 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2584003620 con 0x7f25780039c0 2024-04-23T18:22:48.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.313+0000 7f258b400640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2570068380 0x7f257006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.313+0000 7f258b400640 1 -- 172.21.15.28:0/2610860395 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2584121090 con 0x7f25780039c0 2024-04-23T18:22:48.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.313+0000 7f2589e00640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2570068380 0x7f257006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.313+0000 7f2589e00640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2570068380 0x7f257006a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f25941ec1a0 tx=0x7f257c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:48.313 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-23T18:22:48.316+0000 7f925011a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-23T18:22:48.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.317+0000 7f258b400640 1 -- 172.21.15.28:0/2610860395 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f25840c6020 con 0x7f25780039c0 2024-04-23T18:22:48.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.485+0000 7f2599400640 1 -- 172.21.15.28:0/2610860395 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f259414ade0 con 0x7f25780039c0 2024-04-23T18:22:48.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f258b400640 1 -- 172.21.15.28:0/2610860395 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f25840167c0 con 0x7f25780039c0 2024-04-23T18:22:48.484 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:48.484 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:48.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 -- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2570068380 msgr2=0x7f257006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2570068380 0x7f257006a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f25941ec1a0 tx=0x7f257c009040 comp rx=0 tx=0).stop 2024-04-23T18:22:48.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 -- 172.21.15.28:0/2610860395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 msgr2=0x7f25941594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 0x7f25941594e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f258401c8e0 tx=0x7f2578005840 comp rx=0 tx=0).stop 2024-04-23T18:22:48.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 -- 172.21.15.28:0/2610860395 shutdown_connections 2024-04-23T18:22:48.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2570068380 0x7f257006a840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2594149cc0 0x7f259414f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f259414fa00 0x7f259414b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 --2- 172.21.15.28:0/2610860395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25780039c0 0x7f25941594e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 -- 172.21.15.28:0/2610860395 >> 172.21.15.28:0/2610860395 conn(0x7f259406d0a0 msgr2=0x7f25940c7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:48.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 -- 172.21.15.28:0/2610860395 shutdown_connections 2024-04-23T18:22:48.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.489+0000 7f2599400640 1 -- 172.21.15.28:0/2610860395 wait complete. 2024-04-23T18:22:48.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T18:22:19.363864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T18:22:31.040656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T18:22:31.703845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T18:22:35.387908+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T18:22:48.506 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T18:22:48.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.653+0000 7f12c1400640 1 Processor -- start 2024-04-23T18:22:48.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.653+0000 7f12c1400640 1 -- start start 2024-04-23T18:22:48.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.653+0000 7f12c1400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f12bc153430 0x7f12bc159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.653+0000 7f12c1400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12bc06e790 con 0x7f12bc0c6f50 2024-04-23T18:22:48.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.653+0000 7f12c1400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12bc0c77b0 con 0x7f12bc0c73a0 2024-04-23T18:22:48.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.653+0000 7f12c1400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f12bc06ea30 con 0x7f12bc153430 2024-04-23T18:22:48.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.653+0000 7f12b1e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f12bc0c6f50 0x7f12bc0676e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57608/0 (socket says 172.21.15.28:57608) 2024-04-23T18:22:48.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.653+0000 7f12b1e00640 1 -- 172.21.15.28:0/2721747718 learned_addr learned my addr 172.21.15.28:0/2721747718 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12ba800640 1 --2- 172.21.15.28:0/2721747718 >> v2:172.21.15.137:3300/0 conn(0x7f12bc153430 0x7f12bc159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1929820963 0 0) 0x7f12bc06e790 con 0x7f12bc0c6f50 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12a0003530 con 0x7f12bc0c6f50 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1681300955 0 0) 0x7f12a0003530 con 0x7f12bc0c6f50 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 >> v2:172.21.15.137:3300/0 conn(0x7f12bc153430 msgr2=0x7f12bc159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 --2- 172.21.15.28:0/2721747718 >> v2:172.21.15.137:3300/0 conn(0x7f12bc153430 0x7f12bc159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 >> v1:172.21.15.137:6789/0 conn(0x7f12bc0c73a0 legacy=0x7f12bc067df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc071e80 con 0x7f12bc0c6f50 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f12a40016a0 con 0x7f12bc0c6f50 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 >> v1:172.21.15.28:6789/0 conn(0x7f12bc0c6f50 legacy=0x7f12bc0676e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12a00039c0 0x7f12a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a0004810 0x7f12a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a00051d0 0x7f12a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc06ea30 con 0x7f12a00039c0 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12a000c080 con 0x7f12a00051d0 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f12a000c280 con 0x7f12a0004810 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12ba800640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12a00039c0 0x7f12a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b1e00640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a0004810 0x7f12a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12bb200640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a00051d0 0x7f12a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12ba800640 1 -- 172.21.15.28:0/2721747718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a0004810 msgr2=0x7f12a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12ba800640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a0004810 0x7f12a0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12ba800640 1 -- 172.21.15.28:0/2721747718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a00051d0 msgr2=0x7f12a000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12ba800640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a00051d0 0x7f12a000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12ba800640 1 -- 172.21.15.28:0/2721747718 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a0003530 con 0x7f12a00039c0 2024-04-23T18:22:48.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12bb200640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a00051d0 0x7f12a000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:22:48.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12b1e00640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12a0004810 0x7f12a0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:22:48.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.657+0000 7f12bb200640 1 -- 172.21.15.28:0/2721747718 reap_dead start 2024-04-23T18:22:48.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12ba800640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12a00039c0 0x7f12a0003de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009fc0 tx=0x7f12ac01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6b0a09f117691d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:48.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac0b2070 con 0x7f12a00039c0 2024-04-23T18:22:48.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12ac0a5c90 con 0x7f12a00039c0 2024-04-23T18:22:48.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12b9e00640 1 -- 172.21.15.28:0/2721747718 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac009c10 con 0x7f12a00039c0 2024-04-23T18:22:48.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 -- 172.21.15.28:0/2721747718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12a00039c0 msgr2=0x7f12a0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12a00039c0 0x7f12a0003de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009fc0 tx=0x7f12ac01cc80 comp rx=0 tx=0).stop 2024-04-23T18:22:48.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 -- 172.21.15.28:0/2721747718 shutdown_connections 2024-04-23T18:22:48.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 --2- 172.21.15.28:0/2721747718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12a00039c0 0x7f12a0003de0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 -- 172.21.15.28:0/2721747718 >> 172.21.15.28:0/2721747718 conn(0x7f12bc0cd840 msgr2=0x7f12bc0cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:48.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 -- 172.21.15.28:0/2721747718 shutdown_connections 2024-04-23T18:22:48.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 -- 172.21.15.28:0/2721747718 wait complete. 2024-04-23T18:22:48.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 Processor -- start 2024-04-23T18:22:48.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 -- start start 2024-04-23T18:22:48.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a00039c0 0x7f12bc151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12bc150c40 0x7f12bc147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12bc15ac60 0x7f12bc148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc159570 con 0x7f12bc15ac60 2024-04-23T18:22:48.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc072440 con 0x7f12a00039c0 2024-04-23T18:22:48.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12c1400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f12bc0c8f40 con 0x7f12bc150c40 2024-04-23T18:22:48.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12bb200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12bc15ac60 0x7f12bc148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12bb200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12bc15ac60 0x7f12bc148340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47122/0 (socket says 172.21.15.28:47122) 2024-04-23T18:22:48.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12bb200640 1 -- 172.21.15.28:0/1845449747 learned_addr learned my addr 172.21.15.28:0/1845449747 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:48.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12ba800640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a00039c0 0x7f12bc151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.661+0000 7f12b1e00640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12bc150c40 0x7f12bc147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12bb200640 1 -- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12bc150c40 msgr2=0x7f12bc147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12bb200640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12bc150c40 0x7f12bc147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12bb200640 1 -- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a00039c0 msgr2=0x7f12bc151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12bb200640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a00039c0 0x7f12bc151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12bb200640 1 -- 172.21.15.28:0/1845449747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc15b250 con 0x7f12bc15ac60 2024-04-23T18:22:48.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12bb200640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12bc15ac60 0x7f12bc148340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f12bc071c30 tx=0x7f12b400d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:48.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12b3400640 1 -- 172.21.15.28:0/1845449747 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4018070 con 0x7f12bc15ac60 2024-04-23T18:22:48.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12b3400640 1 -- 172.21.15.28:0/1845449747 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b40052f0 con 0x7f12bc15ac60 2024-04-23T18:22:48.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12b3400640 1 -- 172.21.15.28:0/1845449747 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4003840 con 0x7f12bc15ac60 2024-04-23T18:22:48.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12c1400640 1 -- 172.21.15.28:0/1845449747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12bc1efaa0 con 0x7f12bc15ac60 2024-04-23T18:22:48.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12c1400640 1 -- 172.21.15.28:0/1845449747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12bc15a700 con 0x7f12bc15ac60 2024-04-23T18:22:48.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12c1400640 1 -- 172.21.15.28:0/1845449747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12bc068db0 con 0x7f12bc15ac60 2024-04-23T18:22:48.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12b3400640 1 -- 172.21.15.28:0/1845449747 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12b401b070 con 0x7f12bc15ac60 2024-04-23T18:22:48.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12b3400640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1298068380 0x7f129806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.665+0000 7f12b3400640 1 -- 172.21.15.28:0/1845449747 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f12b4086160 con 0x7f12bc15ac60 2024-04-23T18:22:48.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.669+0000 7f12ba800640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1298068380 0x7f129806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.669+0000 7f12ba800640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1298068380 0x7f129806a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0af000 tx=0x7f12ac004ac0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:48.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.669+0000 7f12b3400640 1 -- 172.21.15.28:0/1845449747 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12b4055cf0 con 0x7f12bc15ac60 2024-04-23T18:22:48.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.833+0000 7f12c1400640 1 -- 172.21.15.28:0/1845449747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f12bc0c8bd0 con 0x7f12bc15ac60 2024-04-23T18:22:48.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.833+0000 7f12b3400640 1 -- 172.21.15.28:0/1845449747 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f12b4059ff0 con 0x7f12bc15ac60 2024-04-23T18:22:48.831 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-04-23T18:22:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 -- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1298068380 msgr2=0x7f129806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1298068380 0x7f129806a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0af000 tx=0x7f12ac004ac0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 -- 172.21.15.28:0/1845449747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12bc15ac60 msgr2=0x7f12bc148340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12bc15ac60 0x7f12bc148340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f12bc071c30 tx=0x7f12b400d890 comp rx=0 tx=0).stop 2024-04-23T18:22:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 -- 172.21.15.28:0/1845449747 shutdown_connections 2024-04-23T18:22:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1298068380 0x7f129806a840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12bc150c40 0x7f12bc147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12bc15ac60 0x7f12bc148340 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 --2- 172.21.15.28:0/1845449747 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12a00039c0 0x7f12bc151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 -- 172.21.15.28:0/1845449747 >> 172.21.15.28:0/1845449747 conn(0x7f12bc0cd840 msgr2=0x7f12bc0cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 -- 172.21.15.28:0/1845449747 shutdown_connections 2024-04-23T18:22:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:48.837+0000 7f12c1400640 1 -- 172.21.15.28:0/1845449747 wait complete. 2024-04-23T18:22:48.852 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T18:22:48.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e24600640 1 Processor -- start 2024-04-23T18:22:48.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e24600640 1 -- start start 2024-04-23T18:22:48.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e24600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7e1c152100 0x7f7e1c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e24600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7e1c0c8d50 0x7f7e1c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:48.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e24600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e1c15b520 con 0x7f7e1c0c9e50 2024-04-23T18:22:48.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e24600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f7e1c071d40 con 0x7f7e1c0c8d50 2024-04-23T18:22:48.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e24600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7e1c072020 con 0x7f7e1c152100 2024-04-23T18:22:48.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e22600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7e1c0c8d50 0x7f7e1c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e21200640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7e1c0c9e50 0x7f7e1c072300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36406/0 (socket says 172.21.15.28:36406) 2024-04-23T18:22:48.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e21200640 1 -- 172.21.15.28:0/1082631462 learned_addr learned my addr 172.21.15.28:0/1082631462 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:48.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e21c00640 1 --2- 172.21.15.28:0/1082631462 >> v2:172.21.15.137:3300/0 conn(0x7f7e1c152100 0x7f7e1c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:48.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e22600640 1 -- 172.21.15.28:0/1082631462 >> v2:172.21.15.137:3300/0 conn(0x7f7e1c152100 msgr2=0x7f7e1c15bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:48.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e22600640 1 --2- 172.21.15.28:0/1082631462 >> v2:172.21.15.137:3300/0 conn(0x7f7e1c152100 0x7f7e1c15bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:48.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e22600640 1 -- 172.21.15.28:0/1082631462 >> v1:172.21.15.28:6789/0 conn(0x7f7e1c0c9e50 legacy=0x7f7e1c072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:48.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.001+0000 7f7e22600640 1 -- 172.21.15.28:0/1082631462 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c15b7c0 con 0x7f7e1c0c8d50 2024-04-23T18:22:49.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e22600640 1 --2- 172.21.15.28:0/1082631462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e1c0c8d50 0x7f7e1c06ca30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c06c400 tx=0x7f7e1401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15e3de3feec5308 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:49.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e1be00640 1 -- 172.21.15.28:0/1082631462 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e140b4070 con 0x7f7e1c0c8d50 2024-04-23T18:22:49.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e1be00640 1 -- 172.21.15.28:0/1082631462 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e140af600 con 0x7f7e1c0c8d50 2024-04-23T18:22:49.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e1be00640 1 -- 172.21.15.28:0/1082631462 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e140af9d0 con 0x7f7e1c0c8d50 2024-04-23T18:22:49.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e24600640 1 -- 172.21.15.28:0/1082631462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e1c0c8d50 msgr2=0x7f7e1c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e24600640 1 --2- 172.21.15.28:0/1082631462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e1c0c8d50 0x7f7e1c06ca30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c06c400 tx=0x7f7e1401f110 comp rx=0 tx=0).stop 2024-04-23T18:22:49.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e24600640 1 -- 172.21.15.28:0/1082631462 shutdown_connections 2024-04-23T18:22:49.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e24600640 1 --2- 172.21.15.28:0/1082631462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e1c0c8d50 0x7f7e1c06ca30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e24600640 1 --2- 172.21.15.28:0/1082631462 >> v2:172.21.15.137:3300/0 conn(0x7f7e1c152100 0x7f7e1c15bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e24600640 1 -- 172.21.15.28:0/1082631462 >> 172.21.15.28:0/1082631462 conn(0x7f7e1c0c9330 msgr2=0x7f7e1c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:49.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e24600640 1 -- 172.21.15.28:0/1082631462 shutdown_connections 2024-04-23T18:22:49.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e24600640 1 -- 172.21.15.28:0/1082631462 wait complete. 2024-04-23T18:22:49.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.005+0000 7f7e24600640 1 Processor -- start 2024-04-23T18:22:49.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e24600640 1 -- start start 2024-04-23T18:22:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e24600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7e1c0c8d50 0x7f7e1c150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e24600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e1c0c9e50 0x7f7e1c0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e24600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e1c152100 0x7f7e1c15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e24600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c070fc0 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e24600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c070e40 con 0x7f7e1c152100 2024-04-23T18:22:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e24600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1c071140 con 0x7f7e1c0c8d50 2024-04-23T18:22:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e21200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e1c0c9e50 0x7f7e1c0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e21200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e1c0c9e50 0x7f7e1c0cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45520/0 (socket says 172.21.15.28:45520) 2024-04-23T18:22:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e21200640 1 -- 172.21.15.28:0/229644712 learned_addr learned my addr 172.21.15.28:0/229644712 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e21c00640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7e1c0c8d50 0x7f7e1c150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e22600640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e1c152100 0x7f7e1c15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e21200640 1 -- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7e1c0c8d50 msgr2=0x7f7e1c150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e21200640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7e1c0c8d50 0x7f7e1c150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e21200640 1 -- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e1c152100 msgr2=0x7f7e1c15a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e21200640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e1c152100 0x7f7e1c15a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e21200640 1 -- 172.21.15.28:0/229644712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c151590 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e22600640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e1c152100 0x7f7e1c15a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e21200640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e1c0c9e50 0x7f7e1c0cacd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800c450 tx=0x7f7e0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e19600640 1 -- 172.21.15.28:0/229644712 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08017070 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e19600640 1 -- 172.21.15.28:0/229644712 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e08005cf0 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e24600640 1 -- 172.21.15.28:0/229644712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1c1f4200 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e19600640 1 -- 172.21.15.28:0/229644712 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08007290 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e24600640 1 -- 172.21.15.28:0/229644712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1c1f47c0 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.009+0000 7f7e24600640 1 -- 172.21.15.28:0/229644712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e1c068db0 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.013+0000 7f7e19600640 1 -- 172.21.15.28:0/229644712 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7e0801a070 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.013+0000 7f7e19600640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7dfc068380 0x7f7dfc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.013+0000 7f7e19600640 1 -- 172.21.15.28:0/229644712 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7e080860a0 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.013+0000 7f7e21c00640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7dfc068380 0x7f7dfc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.013+0000 7f7e21c00640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7dfc068380 0x7f7dfc06a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000b930 tx=0x7f7e10008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:49.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.017+0000 7f7e19600640 1 -- 172.21.15.28:0/229644712 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7e08056280 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.177+0000 7f7e24600640 1 -- 172.21.15.28:0/229644712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7e1c074370 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e19600640 1 -- 172.21.15.28:0/229644712 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f7e08055b80 con 0x7f7e1c0c9e50 2024-04-23T18:22:49.175 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:22:49.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 -- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7dfc068380 msgr2=0x7f7dfc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7dfc068380 0x7f7dfc06a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000b930 tx=0x7f7e10008040 comp rx=0 tx=0).stop 2024-04-23T18:22:49.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 -- 172.21.15.28:0/229644712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e1c0c9e50 msgr2=0x7f7e1c0cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e1c0c9e50 0x7f7e1c0cacd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800c450 tx=0x7f7e0800c910 comp rx=0 tx=0).stop 2024-04-23T18:22:49.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 -- 172.21.15.28:0/229644712 shutdown_connections 2024-04-23T18:22:49.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7dfc068380 0x7f7dfc06a840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e1c152100 0x7f7e1c15a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e1c0c9e50 0x7f7e1c0cacd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 --2- 172.21.15.28:0/229644712 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7e1c0c8d50 0x7f7e1c150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 -- 172.21.15.28:0/229644712 >> 172.21.15.28:0/229644712 conn(0x7f7e1c0c9330 msgr2=0x7f7e1c0c7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:49.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 -- 172.21.15.28:0/229644712 shutdown_connections 2024-04-23T18:22:49.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.181+0000 7f7e24600640 1 -- 172.21.15.28:0/229644712 wait complete. 2024-04-23T18:22:49.196 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T18:22:49.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9454400640 1 Processor -- start 2024-04-23T18:22:49.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9454400640 1 -- start start 2024-04-23T18:22:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9454400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f944c0c8be0 0x7f944c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9454400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f944c0711f0 0x7f944c15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9454400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f944c0c7ce0 con 0x7f944c155330 2024-04-23T18:22:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9454400640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f944c0c82a0 con 0x7f944c0711f0 2024-04-23T18:22:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9454400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f944c0c7fc0 con 0x7f944c0c8be0 2024-04-23T18:22:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9451a00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f944c155330 0x7f944c06d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36408/0 (socket says 172.21.15.28:36408) 2024-04-23T18:22:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9451a00640 1 -- 172.21.15.28:0/138521823 learned_addr learned my addr 172.21.15.28:0/138521823 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9452400640 1 --2- 172.21.15.28:0/138521823 >> v2:172.21.15.28:3300/0 conn(0x7f944c0711f0 0x7f944c15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9451000640 1 --2- 172.21.15.28:0/138521823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f944c0c8be0 0x7f944c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f944be00640 1 -- 172.21.15.28:0/138521823 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3862302301 0 0) 0x7f944c0c7ce0 con 0x7f944c155330 2024-04-23T18:22:49.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f944be00640 1 -- 172.21.15.28:0/138521823 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9434003530 con 0x7f944c155330 2024-04-23T18:22:49.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9452400640 1 -- 172.21.15.28:0/138521823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f944c0c8be0 msgr2=0x7f944c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:49.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9452400640 1 --2- 172.21.15.28:0/138521823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f944c0c8be0 0x7f944c15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9452400640 1 -- 172.21.15.28:0/138521823 >> v1:172.21.15.28:6789/0 conn(0x7f944c155330 legacy=0x7f944c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.345+0000 7f9452400640 1 -- 172.21.15.28:0/138521823 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c06cad0 con 0x7f944c0711f0 2024-04-23T18:22:49.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f9452400640 1 --2- 172.21.15.28:0/138521823 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f944c0711f0 0x7f944c15ece0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9444009d90 tx=0x7f944401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791a7c490f430c91 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:49.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f944be00640 1 -- 172.21.15.28:0/138521823 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94440b4070 con 0x7f944c0711f0 2024-04-23T18:22:49.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f944be00640 1 -- 172.21.15.28:0/138521823 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94440af600 con 0x7f944c0711f0 2024-04-23T18:22:49.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f944be00640 1 -- 172.21.15.28:0/138521823 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94440af9d0 con 0x7f944c0711f0 2024-04-23T18:22:49.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f9454400640 1 -- 172.21.15.28:0/138521823 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f944c0711f0 msgr2=0x7f944c15ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f9454400640 1 --2- 172.21.15.28:0/138521823 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f944c0711f0 0x7f944c15ece0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9444009d90 tx=0x7f944401f150 comp rx=0 tx=0).stop 2024-04-23T18:22:49.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f9454400640 1 -- 172.21.15.28:0/138521823 shutdown_connections 2024-04-23T18:22:49.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f9454400640 1 --2- 172.21.15.28:0/138521823 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f944c0711f0 0x7f944c15ece0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f9454400640 1 --2- 172.21.15.28:0/138521823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f944c0c8be0 0x7f944c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f9454400640 1 -- 172.21.15.28:0/138521823 >> 172.21.15.28:0/138521823 conn(0x7f944c0c9330 msgr2=0x7f944c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:49.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f9454400640 1 -- 172.21.15.28:0/138521823 shutdown_connections 2024-04-23T18:22:49.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.349+0000 7f9454400640 1 -- 172.21.15.28:0/138521823 wait complete. 2024-04-23T18:22:49.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9454400640 1 Processor -- start 2024-04-23T18:22:49.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9454400640 1 -- start start 2024-04-23T18:22:49.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9454400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f944c0711f0 0x7f944c14ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9454400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944c0c8be0 0x7f944c1e2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9454400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f944c155330 0x7f944c151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9454400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f944c155710 con 0x7f944c0711f0 2024-04-23T18:22:49.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9454400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f944c0c90b0 con 0x7f944c0c8be0 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9454400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f944c155890 con 0x7f944c155330 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9451a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f944c0711f0 0x7f944c14ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9451a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f944c0711f0 0x7f944c14ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45530/0 (socket says 172.21.15.28:45530) 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9451a00640 1 -- 172.21.15.28:0/403185172 learned_addr learned my addr 172.21.15.28:0/403185172 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9451000640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944c0c8be0 0x7f944c1e2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9452400640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f944c155330 0x7f944c151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9451a00640 1 -- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f944c155330 msgr2=0x7f944c151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9451a00640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f944c155330 0x7f944c151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9451a00640 1 -- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944c0c8be0 msgr2=0x7f944c1e2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9451a00640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944c0c8be0 0x7f944c1e2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9451a00640 1 -- 172.21.15.28:0/403185172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c1f4df0 con 0x7f944c0711f0 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9451000640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944c0c8be0 0x7f944c1e2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:49.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9451a00640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f944c0711f0 0x7f944c14ce90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f944000c3c0 tx=0x7f944000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:49.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9449600640 1 -- 172.21.15.28:0/403185172 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440017070 con 0x7f944c0711f0 2024-04-23T18:22:49.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9449600640 1 -- 172.21.15.28:0/403185172 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9440005cf0 con 0x7f944c0711f0 2024-04-23T18:22:49.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9449600640 1 -- 172.21.15.28:0/403185172 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94400072f0 con 0x7f944c0711f0 2024-04-23T18:22:49.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9454400640 1 -- 172.21.15.28:0/403185172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944c14d790 con 0x7f944c0711f0 2024-04-23T18:22:49.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9454400640 1 -- 172.21.15.28:0/403185172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944c14d4b0 con 0x7f944c0711f0 2024-04-23T18:22:49.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.353+0000 7f9454400640 1 -- 172.21.15.28:0/403185172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f944c068db0 con 0x7f944c0711f0 2024-04-23T18:22:49.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.357+0000 7f9449600640 1 -- 172.21.15.28:0/403185172 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f944001a070 con 0x7f944c0711f0 2024-04-23T18:22:49.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.357+0000 7f9449600640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f942c068380 0x7f942c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.357+0000 7f9449600640 1 -- 172.21.15.28:0/403185172 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f94400860d0 con 0x7f944c0711f0 2024-04-23T18:22:49.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.357+0000 7f9451000640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f942c068380 0x7f942c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.357+0000 7f9451000640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f942c068380 0x7f942c06a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f944c0c6660 tx=0x7f9438008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:49.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.361+0000 7f9449600640 1 -- 172.21.15.28:0/403185172 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9440056340 con 0x7f944c0711f0 2024-04-23T18:22:49.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 -- 172.21.15.28:0/403185172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f944c06f420 con 0x7f944c0711f0 2024-04-23T18:22:49.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9449600640 1 -- 172.21.15.28:0/403185172 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f9440055c40 con 0x7f944c0711f0 2024-04-23T18:22:49.528 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2024-04-23T18:22:49.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 -- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f942c068380 msgr2=0x7f942c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f942c068380 0x7f942c06a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f944c0c6660 tx=0x7f9438008040 comp rx=0 tx=0).stop 2024-04-23T18:22:49.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 -- 172.21.15.28:0/403185172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f944c0711f0 msgr2=0x7f944c14ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f944c0711f0 0x7f944c14ce90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f944000c3c0 tx=0x7f944000c880 comp rx=0 tx=0).stop 2024-04-23T18:22:49.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 -- 172.21.15.28:0/403185172 shutdown_connections 2024-04-23T18:22:49.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f942c068380 0x7f942c06a840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f944c155330 0x7f944c151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944c0c8be0 0x7f944c1e2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 --2- 172.21.15.28:0/403185172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f944c0711f0 0x7f944c14ce90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 -- 172.21.15.28:0/403185172 >> 172.21.15.28:0/403185172 conn(0x7f944c0c9330 msgr2=0x7f944c072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:49.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 -- 172.21.15.28:0/403185172 shutdown_connections 2024-04-23T18:22:49.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.533+0000 7f9454400640 1 -- 172.21.15.28:0/403185172 wait complete. 2024-04-23T18:22:49.550 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T18:22:49.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.697+0000 7f22c5c00640 1 Processor -- start 2024-04-23T18:22:49.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.697+0000 7f22c5c00640 1 -- start start 2024-04-23T18:22:49.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22c5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22c01551b0 0x7f22c015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22c5c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22c00c9fc0 0x7f22c00ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22c5c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22c015aff0 con 0x7f22c0073710 2024-04-23T18:22:49.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22c5c00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f22c015bbe0 con 0x7f22c00c9fc0 2024-04-23T18:22:49.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22c5c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f22c006c530 con 0x7f22c01551b0 2024-04-23T18:22:49.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22b6000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22c00c9fc0 0x7f22c00ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22b6000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22c00c9fc0 0x7f22c00ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45546/0 (socket says 172.21.15.28:45546) 2024-04-23T18:22:49.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22b6000640 1 -- 172.21.15.28:0/2906585975 learned_addr learned my addr 172.21.15.28:0/2906585975 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:49.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22bea00640 1 --2- 172.21.15.28:0/2906585975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22c01551b0 0x7f22c015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22b6000640 1 -- 172.21.15.28:0/2906585975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22c01551b0 msgr2=0x7f22c015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:49.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22b6000640 1 --2- 172.21.15.28:0/2906585975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22c01551b0 0x7f22c015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22b6000640 1 -- 172.21.15.28:0/2906585975 >> v1:172.21.15.137:6789/0 conn(0x7f22c0073710 legacy=0x7f22c006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.701+0000 7f22b6000640 1 -- 172.21.15.28:0/2906585975 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c015b2b0 con 0x7f22c00c9fc0 2024-04-23T18:22:49.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22b6000640 1 --2- 172.21.15.28:0/2906585975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22c00c9fc0 0x7f22c00ca3e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009870 tx=0x7f22a801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc04b962049b04 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:49.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22be000640 1 -- 172.21.15.28:0/2906585975 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a80b2070 con 0x7f22c00c9fc0 2024-04-23T18:22:49.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22be000640 1 -- 172.21.15.28:0/2906585975 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a80a9070 con 0x7f22c00c9fc0 2024-04-23T18:22:49.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22be000640 1 -- 172.21.15.28:0/2906585975 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a80ad880 con 0x7f22c00c9fc0 2024-04-23T18:22:49.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 -- 172.21.15.28:0/2906585975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22c00c9fc0 msgr2=0x7f22c00ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 --2- 172.21.15.28:0/2906585975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22c00c9fc0 0x7f22c00ca3e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009870 tx=0x7f22a801c560 comp rx=0 tx=0).stop 2024-04-23T18:22:49.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 -- 172.21.15.28:0/2906585975 shutdown_connections 2024-04-23T18:22:49.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 --2- 172.21.15.28:0/2906585975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22c00c9fc0 0x7f22c00ca3e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 --2- 172.21.15.28:0/2906585975 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22c01551b0 0x7f22c015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 -- 172.21.15.28:0/2906585975 >> 172.21.15.28:0/2906585975 conn(0x7f22c00676e0 msgr2=0x7f22c0067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:49.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 -- 172.21.15.28:0/2906585975 shutdown_connections 2024-04-23T18:22:49.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 -- 172.21.15.28:0/2906585975 wait complete. 2024-04-23T18:22:49.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 Processor -- start 2024-04-23T18:22:49.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 -- start start 2024-04-23T18:22:49.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22c0073710 0x7f22c01f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.705+0000 7f22c5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22c00c9fc0 0x7f22c0144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22c5c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22c01551b0 0x7f22c0159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22c5c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22c0155710 con 0x7f22c0073710 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22c5c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f22c0155590 con 0x7f22c01551b0 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22c5c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f22c006c0f0 con 0x7f22c00c9fc0 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22bea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22c0073710 0x7f22c01f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22bea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22c0073710 0x7f22c01f80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45552/0 (socket says 172.21.15.28:45552) 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22bea00640 1 -- 172.21.15.28:0/3947509905 learned_addr learned my addr 172.21.15.28:0/3947509905 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22b6000640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22c00c9fc0 0x7f22c0144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22bf400640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22c01551b0 0x7f22c0159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22bea00640 1 -- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22c00c9fc0 msgr2=0x7f22c0144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22bea00640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22c00c9fc0 0x7f22c0144480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22bea00640 1 -- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22c01551b0 msgr2=0x7f22c0159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22bea00640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22c01551b0 0x7f22c0159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22bea00640 1 -- 172.21.15.28:0/3947509905 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c0155ac0 con 0x7f22c0073710 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22b6000640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22c00c9fc0 0x7f22c0144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:22:49.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22bea00640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22c0073710 0x7f22c01f80a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22b000d800 tx=0x7f22b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:49.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22b7400640 1 -- 172.21.15.28:0/3947509905 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b000b6c0 con 0x7f22c0073710 2024-04-23T18:22:49.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22b7400640 1 -- 172.21.15.28:0/3947509905 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b0019070 con 0x7f22c0073710 2024-04-23T18:22:49.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22c5c00640 1 -- 172.21.15.28:0/3947509905 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c0155da0 con 0x7f22c0073710 2024-04-23T18:22:49.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22b7400640 1 -- 172.21.15.28:0/3947509905 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b000ba60 con 0x7f22c0073710 2024-04-23T18:22:49.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22c5c00640 1 -- 172.21.15.28:0/3947509905 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c01f7b80 con 0x7f22c0073710 2024-04-23T18:22:49.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22c5c00640 1 -- 172.21.15.28:0/3947509905 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c01f7690 con 0x7f22c0073710 2024-04-23T18:22:49.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22b7400640 1 -- 172.21.15.28:0/3947509905 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f22b000bc00 con 0x7f22c0073710 2024-04-23T18:22:49.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.709+0000 7f22b7400640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f229c068380 0x7f229c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:49.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.713+0000 7f22b7400640 1 -- 172.21.15.28:0/3947509905 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f22b0087220 con 0x7f22c0073710 2024-04-23T18:22:49.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.713+0000 7f22b6000640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f229c068380 0x7f229c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:49.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.713+0000 7f22b6000640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f229c068380 0x7f229c06a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22a80af000 tx=0x7f22a8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:49.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.717+0000 7f22b7400640 1 -- 172.21.15.28:0/3947509905 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f22b0057400 con 0x7f22c0073710 2024-04-23T18:22:49.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 -- 172.21.15.28:0/3947509905 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f22c0068db0 con 0x7f22c0073710 2024-04-23T18:22:49.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22b7400640 1 -- 172.21.15.28:0/3947509905 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f22b0056d00 con 0x7f22c0073710 2024-04-23T18:22:49.884 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:22:49.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 -- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f229c068380 msgr2=0x7f229c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f229c068380 0x7f229c06a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22a80af000 tx=0x7f22a8008040 comp rx=0 tx=0).stop 2024-04-23T18:22:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 -- 172.21.15.28:0/3947509905 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22c0073710 msgr2=0x7f22c01f80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22c0073710 0x7f22c01f80a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22b000d800 tx=0x7f22b000dcc0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 -- 172.21.15.28:0/3947509905 shutdown_connections 2024-04-23T18:22:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f229c068380 0x7f229c06a840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22c00c9fc0 0x7f22c0144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22c01551b0 0x7f22c0159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 --2- 172.21.15.28:0/3947509905 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22c0073710 0x7f22c01f80a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 -- 172.21.15.28:0/3947509905 >> 172.21.15.28:0/3947509905 conn(0x7f22c00676e0 msgr2=0x7f22c00cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 -- 172.21.15.28:0/3947509905 shutdown_connections 2024-04-23T18:22:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:49.889+0000 7f22c5c00640 1 -- 172.21.15.28:0/3947509905 wait complete. 2024-04-23T18:22:49.907 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T18:22:50.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd922800640 1 Processor -- start 2024-04-23T18:22:50.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd922800640 1 -- start start 2024-04-23T18:22:50.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd922800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 0x7fd91c157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd922800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd91c158300 0x7fd91c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd922800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd91c06c8e0 con 0x7fd91c0c91a0 2024-04-23T18:22:50.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd922800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd91c073190 con 0x7fd91c158300 2024-04-23T18:22:50.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd922800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd91c0c2320 con 0x7fd91c152280 2024-04-23T18:22:50.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd921400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 0x7fd91c157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd920a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd91c158300 0x7fd91c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd920a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd91c158300 0x7fd91c0c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42814/0 (socket says 172.21.15.28:42814) 2024-04-23T18:22:50.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd920a00640 1 -- 172.21.15.28:0/736976760 learned_addr learned my addr 172.21.15.28:0/736976760 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:50.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd921400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 0x7fd91c157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:47446/0 (socket says 172.21.15.28:47446) 2024-04-23T18:22:50.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd920a00640 1 -- 172.21.15.28:0/736976760 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 msgr2=0x7fd91c157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:50.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd920a00640 1 --2- 172.21.15.28:0/736976760 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 0x7fd91c157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd920a00640 1 -- 172.21.15.28:0/736976760 >> v1:172.21.15.137:6789/0 conn(0x7fd91c0c91a0 legacy=0x7fd91c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd920a00640 1 -- 172.21.15.28:0/736976760 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91c0c25e0 con 0x7fd91c158300 2024-04-23T18:22:50.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.053+0000 7fd921400640 1 --2- 172.21.15.28:0/736976760 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 0x7fd91c157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:22:50.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.057+0000 7fd920a00640 1 --2- 172.21.15.28:0/736976760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd91c158300 0x7fd91c0c9920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd908009870 tx=0x7fd90801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d89682d3a077bbf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:50.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.057+0000 7fd91be00640 1 -- 172.21.15.28:0/736976760 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9080b5070 con 0x7fd91c158300 2024-04-23T18:22:50.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.057+0000 7fd91be00640 1 -- 172.21.15.28:0/736976760 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9080a8a50 con 0x7fd91c158300 2024-04-23T18:22:50.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.057+0000 7fd91be00640 1 -- 172.21.15.28:0/736976760 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9080a8e20 con 0x7fd91c158300 2024-04-23T18:22:50.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.057+0000 7fd922800640 1 -- 172.21.15.28:0/736976760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd91c158300 msgr2=0x7fd91c0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.057+0000 7fd922800640 1 --2- 172.21.15.28:0/736976760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd91c158300 0x7fd91c0c9920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd908009870 tx=0x7fd90801ed50 comp rx=0 tx=0).stop 2024-04-23T18:22:50.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 -- 172.21.15.28:0/736976760 shutdown_connections 2024-04-23T18:22:50.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 --2- 172.21.15.28:0/736976760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd91c158300 0x7fd91c0c9920 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 --2- 172.21.15.28:0/736976760 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 0x7fd91c157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 -- 172.21.15.28:0/736976760 >> 172.21.15.28:0/736976760 conn(0x7fd91c067ae0 msgr2=0x7fd91c06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:50.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 -- 172.21.15.28:0/736976760 shutdown_connections 2024-04-23T18:22:50.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 -- 172.21.15.28:0/736976760 wait complete. 2024-04-23T18:22:50.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 Processor -- start 2024-04-23T18:22:50.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 -- start start 2024-04-23T18:22:50.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91c0c91a0 0x7fd91c1ddff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 0x7fd91c1de530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd91c158300 0x7fd91c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c072e20 con 0x7fd91c0c91a0 2024-04-23T18:22:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c0c2ba0 con 0x7fd91c158300 2024-04-23T18:22:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd922800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd91c072b20 con 0x7fd91c152280 2024-04-23T18:22:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd921400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91c0c91a0 0x7fd91c1ddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd921400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91c0c91a0 0x7fd91c1ddff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45568/0 (socket says 172.21.15.28:45568) 2024-04-23T18:22:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd921400640 1 -- 172.21.15.28:0/1361501318 learned_addr learned my addr 172.21.15.28:0/1361501318 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd921e00640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd91c158300 0x7fd91c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd920a00640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 0x7fd91c1de530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd921400640 1 -- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 msgr2=0x7fd91c1de530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd921400640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 0x7fd91c1de530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd921400640 1 -- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd91c158300 msgr2=0x7fd91c14b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd921400640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd91c158300 0x7fd91c14b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd921400640 1 -- 172.21.15.28:0/1361501318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91c0c7f40 con 0x7fd91c0c91a0 2024-04-23T18:22:50.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd921e00640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd91c158300 0x7fd91c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:50.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.061+0000 7fd921400640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91c0c91a0 0x7fd91c1ddff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd91000ec10 tx=0x7fd91000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:50.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.065+0000 7fd919600640 1 -- 172.21.15.28:0/1361501318 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910017070 con 0x7fd91c0c91a0 2024-04-23T18:22:50.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.065+0000 7fd919600640 1 -- 172.21.15.28:0/1361501318 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd91000cbd0 con 0x7fd91c0c91a0 2024-04-23T18:22:50.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.065+0000 7fd922800640 1 -- 172.21.15.28:0/1361501318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91c1e0950 con 0x7fd91c0c91a0 2024-04-23T18:22:50.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.065+0000 7fd919600640 1 -- 172.21.15.28:0/1361501318 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910013470 con 0x7fd91c0c91a0 2024-04-23T18:22:50.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.065+0000 7fd922800640 1 -- 172.21.15.28:0/1361501318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd91c1e25d0 con 0x7fd91c0c91a0 2024-04-23T18:22:50.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.065+0000 7fd922800640 1 -- 172.21.15.28:0/1361501318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd91c074290 con 0x7fd91c0c91a0 2024-04-23T18:22:50.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.065+0000 7fd919600640 1 -- 172.21.15.28:0/1361501318 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd91001a070 con 0x7fd91c0c91a0 2024-04-23T18:22:50.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.065+0000 7fd919600640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8fc068380 0x7fd8fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.065+0000 7fd919600640 1 -- 172.21.15.28:0/1361501318 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd910086bc0 con 0x7fd91c0c91a0 2024-04-23T18:22:50.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.065+0000 7fd920a00640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8fc068380 0x7fd8fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.069+0000 7fd920a00640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8fc068380 0x7fd8fc06a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd9080b2000 tx=0x7fd908008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:50.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.069+0000 7fd919600640 1 -- 172.21.15.28:0/1361501318 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd910056ed0 con 0x7fd91c0c91a0 2024-04-23T18:22:50.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 -- 172.21.15.28:0/1361501318 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd91c1e3110 con 0x7fd91c0c91a0 2024-04-23T18:22:50.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd919600640 1 -- 172.21.15.28:0/1361501318 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fd9100567d0 con 0x7fd91c0c91a0 2024-04-23T18:22:50.244 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 -- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8fc068380 msgr2=0x7fd8fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8fc068380 0x7fd8fc06a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd9080b2000 tx=0x7fd908008040 comp rx=0 tx=0).stop 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 -- 172.21.15.28:0/1361501318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91c0c91a0 msgr2=0x7fd91c1ddff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91c0c91a0 0x7fd91c1ddff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd91000ec10 tx=0x7fd91000c520 comp rx=0 tx=0).stop 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 -- 172.21.15.28:0/1361501318 shutdown_connections 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8fc068380 0x7fd8fc06a840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd91c152280 0x7fd91c1de530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd91c158300 0x7fd91c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 --2- 172.21.15.28:0/1361501318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd91c0c91a0 0x7fd91c1ddff0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 -- 172.21.15.28:0/1361501318 >> 172.21.15.28:0/1361501318 conn(0x7fd91c067ae0 msgr2=0x7fd91c1e3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 -- 172.21.15.28:0/1361501318 shutdown_connections 2024-04-23T18:22:50.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.249+0000 7fd922800640 1 -- 172.21.15.28:0/1361501318 wait complete. 2024-04-23T18:22:50.266 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:22:50.266 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T18:22:50.276 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:50.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fefe00640 1 Processor -- start 2024-04-23T18:22:50.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fefe00640 1 -- start start 2024-04-23T18:22:50.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe80b2310 0x7f2fe80c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fefe00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe8075970 con 0x7f2fe80738c0 2024-04-23T18:22:50.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fefe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe8075c10 con 0x7f2fe80c79e0 2024-04-23T18:22:50.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fefe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe806cbd0 con 0x7f2fe80b2310 2024-04-23T18:22:50.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fed400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2fe80738c0 0x7f2fe80c2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36422/0 (socket says 172.21.15.28:36422) 2024-04-23T18:22:50.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fed400640 1 -- 172.21.15.28:0/1233390545 learned_addr learned my addr 172.21.15.28:0/1233390545 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:50.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2feca00640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe80b2310 0x7f2fe80c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2872827403 0 0) 0x7f2fe8075970 con 0x7f2fe80738c0 2024-04-23T18:22:50.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd0003530 con 0x7f2fe80738c0 2024-04-23T18:22:50.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1573859015 0 0) 0x7f2fe8075c10 con 0x7f2fe80c79e0 2024-04-23T18:22:50.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fe8075970 con 0x7f2fe80c79e0 2024-04-23T18:22:50.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4043572011 0 0) 0x7f2fd0003530 con 0x7f2fe80738c0 2024-04-23T18:22:50.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe80b2310 msgr2=0x7f2fe80c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:50.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe80b2310 0x7f2fe80c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 >> v1:172.21.15.137:6789/0 conn(0x7f2fe80c79e0 legacy=0x7f2fe8165b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe80c8d30 con 0x7f2fe80738c0 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f2fdc001680 con 0x7f2fe80738c0 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 >> v1:172.21.15.28:6789/0 conn(0x7f2fe80738c0 legacy=0x7f2fe80c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fd0003b80 0x7f2fd0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fd0004810 0x7f2fd0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe80b2310 0x7f2fd00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe806cbd0 con 0x7f2fd0004810 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd000bad0 con 0x7f2fd0003b80 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd000bcd0 con 0x7f2fe80b2310 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fed400640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fd0003b80 0x7f2fd0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2feca00640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fd0004810 0x7f2fd0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2fede00640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe80b2310 0x7f2fd00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2feca00640 1 -- 172.21.15.28:0/1233390545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe80b2310 msgr2=0x7f2fd00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:50.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2feca00640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fe80b2310 0x7f2fd00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2feca00640 1 -- 172.21.15.28:0/1233390545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fd0003b80 msgr2=0x7f2fd0003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:50.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2feca00640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fd0003b80 0x7f2fd0003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.465+0000 7f2feca00640 1 -- 172.21.15.28:0/1233390545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd0003530 con 0x7f2fd0004810 2024-04-23T18:22:50.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.469+0000 7f2feca00640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fd0004810 0x7f2fd0004c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009ae0 tx=0x7f2fd401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16931dadceb6f71b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:50.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.469+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40096b0 con 0x7f2fd0004810 2024-04-23T18:22:50.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.469+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd40a8410 con 0x7f2fd0004810 2024-04-23T18:22:50.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.469+0000 7f2fe7e00640 1 -- 172.21.15.28:0/1233390545 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40a8800 con 0x7f2fd0004810 2024-04-23T18:22:50.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.469+0000 7f2fefe00640 1 -- 172.21.15.28:0/1233390545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fd0004810 msgr2=0x7f2fd0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.469+0000 7f2fefe00640 1 --2- 172.21.15.28:0/1233390545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fd0004810 0x7f2fd0004c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009ae0 tx=0x7f2fd401c890 comp rx=0 tx=0).stop 2024-04-23T18:22:50.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.469+0000 7f2fede00640 1 -- 172.21.15.28:0/1233390545 reap_dead start 2024-04-23T18:22:50.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.469+0000 7f2fefe00640 1 -- 172.21.15.28:0/1233390545 shutdown_connections 2024-04-23T18:22:50.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.469+0000 7f2fefe00640 1 -- 172.21.15.28:0/1233390545 >> 172.21.15.28:0/1233390545 conn(0x7f2fe80ccfe0 msgr2=0x7f2fe80cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:50.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.469+0000 7f2fefe00640 1 -- 172.21.15.28:0/1233390545 shutdown_connections 2024-04-23T18:22:50.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.469+0000 7f2fefe00640 1 -- 172.21.15.28:0/1233390545 wait complete. 2024-04-23T18:22:50.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fefe00640 1 Processor -- start 2024-04-23T18:22:50.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fefe00640 1 -- start start 2024-04-23T18:22:50.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fd0004810 0x7f2fe80c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80c59b0 0x7f2fe80cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe80c5e30 0x7f2fe80cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fefe00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe80c4240 con 0x7f2fe80c59b0 2024-04-23T18:22:50.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fefe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe8155a70 con 0x7f2fe80c5e30 2024-04-23T18:22:50.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fefe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe80c90a0 con 0x7f2fd0004810 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2feca00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80c59b0 0x7f2fe80cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2feca00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80c59b0 0x7f2fe80cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45590/0 (socket says 172.21.15.28:45590) 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2feca00640 1 -- 172.21.15.28:0/3893286489 learned_addr learned my addr 172.21.15.28:0/3893286489 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fede00640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe80c5e30 0x7f2fe80cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fed400640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fd0004810 0x7f2fe80c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2feca00640 1 -- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fd0004810 msgr2=0x7f2fe80c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2feca00640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fd0004810 0x7f2fe80c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2feca00640 1 -- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe80c5e30 msgr2=0x7f2fe80cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2feca00640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe80c5e30 0x7f2fe80cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2feca00640 1 -- 172.21.15.28:0/3893286489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe814a9c0 con 0x7f2fe80c59b0 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fede00640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe80c5e30 0x7f2fe80cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2feca00640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80c59b0 0x7f2fe80cbe30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2fd401cd70 tx=0x7f2fd4019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fe5600640 1 -- 172.21.15.28:0/3893286489 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40a8dc0 con 0x7f2fe80c59b0 2024-04-23T18:22:50.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fe5600640 1 -- 172.21.15.28:0/3893286489 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd4004020 con 0x7f2fe80c59b0 2024-04-23T18:22:50.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fe5600640 1 -- 172.21.15.28:0/3893286489 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4004410 con 0x7f2fe80c59b0 2024-04-23T18:22:50.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fefe00640 1 -- 172.21.15.28:0/3893286489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe80b1450 con 0x7f2fe80c59b0 2024-04-23T18:22:50.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.473+0000 7f2fefe00640 1 -- 172.21.15.28:0/3893286489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe80b16f0 con 0x7f2fe80c59b0 2024-04-23T18:22:50.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.477+0000 7f2fefe00640 1 -- 172.21.15.28:0/3893286489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe8068cd0 con 0x7f2fe80c59b0 2024-04-23T18:22:50.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.477+0000 7f2fe5600640 1 -- 172.21.15.28:0/3893286489 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2fd4003620 con 0x7f2fe80c59b0 2024-04-23T18:22:50.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.477+0000 7f2fe5600640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2fc8068380 0x7f2fc806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.477+0000 7f2fe5600640 1 -- 172.21.15.28:0/3893286489 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2fd4120eb0 con 0x7f2fe80c59b0 2024-04-23T18:22:50.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.477+0000 7f2fed400640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2fc8068380 0x7f2fc806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.477+0000 7f2fed400640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2fc8068380 0x7f2fc806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc005180 tx=0x7f2fdc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:50.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.481+0000 7f2fe5600640 1 -- 172.21.15.28:0/3893286489 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2fe814a9c0 con 0x7f2fe80c59b0 2024-04-23T18:22:50.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.645+0000 7f2fefe00640 1 -- 172.21.15.28:0/3893286489 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fe80ca960 con 0x7f2fe80c59b0 2024-04-23T18:22:50.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fe5600640 1 -- 172.21.15.28:0/3893286489 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f2fd40ac030 con 0x7f2fe80c59b0 2024-04-23T18:22:50.644 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:50.644 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:50.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 -- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2fc8068380 msgr2=0x7f2fc806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2fc8068380 0x7f2fc806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc005180 tx=0x7f2fdc009040 comp rx=0 tx=0).stop 2024-04-23T18:22:50.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 -- 172.21.15.28:0/3893286489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80c59b0 msgr2=0x7f2fe80cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80c59b0 0x7f2fe80cbe30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2fd401cd70 tx=0x7f2fd4019630 comp rx=0 tx=0).stop 2024-04-23T18:22:50.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 -- 172.21.15.28:0/3893286489 shutdown_connections 2024-04-23T18:22:50.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2fc8068380 0x7f2fc806a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fe80c5e30 0x7f2fe80cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2fe80c59b0 0x7f2fe80cbe30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 --2- 172.21.15.28:0/3893286489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2fd0004810 0x7f2fe80c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 -- 172.21.15.28:0/3893286489 >> 172.21.15.28:0/3893286489 conn(0x7f2fe80ccfe0 msgr2=0x7f2fe80c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:50.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 -- 172.21.15.28:0/3893286489 shutdown_connections 2024-04-23T18:22:50.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.649+0000 7f2fefe00640 1 -- 172.21.15.28:0/3893286489 wait complete. 2024-04-23T18:22:50.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T18:22:19.363864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T18:22:31.040656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T18:22:31.703845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T18:22:35.387908+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T18:22:50.665 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T18:22:50.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2c2000640 1 Processor -- start 2024-04-23T18:22:50.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2c2000640 1 -- start start 2024-04-23T18:22:50.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2c2000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc06bc40 0x7fd2bc06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2c2000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd2bc06c560 0x7fd2bc1592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2c2000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2bc15f9d0 con 0x7fd2bc15f520 2024-04-23T18:22:50.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2c2000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fd2bc15fcb0 con 0x7fd2bc06c560 2024-04-23T18:22:50.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2c2000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd2bc15ff90 con 0x7fd2bc06bc40 2024-04-23T18:22:50.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2b2a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd2bc06c560 0x7fd2bc1592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2bbe00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd2bc15f520 0x7fd2bc070e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36436/0 (socket says 172.21.15.28:36436) 2024-04-23T18:22:50.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2bbe00640 1 -- 172.21.15.28:0/1681410693 learned_addr learned my addr 172.21.15.28:0/1681410693 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:50.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2bb400640 1 --2- 172.21.15.28:0/1681410693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc06bc40 0x7fd2bc06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2b2a00640 1 -- 172.21.15.28:0/1681410693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc06bc40 msgr2=0x7fd2bc06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:50.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2b2a00640 1 --2- 172.21.15.28:0/1681410693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc06bc40 0x7fd2bc06c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2b2a00640 1 -- 172.21.15.28:0/1681410693 >> v1:172.21.15.28:6789/0 conn(0x7fd2bc15f520 legacy=0x7fd2bc070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.813+0000 7fd2b2a00640 1 -- 172.21.15.28:0/1681410693 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc160270 con 0x7fd2bc06c560 2024-04-23T18:22:50.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2b2a00640 1 --2- 172.21.15.28:0/1681410693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2bc06c560 0x7fd2bc1592e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097f0 tx=0x7fd2a401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fbdbbcf2419fff server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:50.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2baa00640 1 -- 172.21.15.28:0/1681410693 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40b5070 con 0x7fd2bc06c560 2024-04-23T18:22:50.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2baa00640 1 -- 172.21.15.28:0/1681410693 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a40a8990 con 0x7fd2bc06c560 2024-04-23T18:22:50.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2baa00640 1 -- 172.21.15.28:0/1681410693 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40a8d60 con 0x7fd2bc06c560 2024-04-23T18:22:50.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2c2000640 1 -- 172.21.15.28:0/1681410693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2bc06c560 msgr2=0x7fd2bc1592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2c2000640 1 --2- 172.21.15.28:0/1681410693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2bc06c560 0x7fd2bc1592e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097f0 tx=0x7fd2a401ec90 comp rx=0 tx=0).stop 2024-04-23T18:22:50.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2c2000640 1 -- 172.21.15.28:0/1681410693 shutdown_connections 2024-04-23T18:22:50.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2c2000640 1 --2- 172.21.15.28:0/1681410693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2bc06c560 0x7fd2bc1592e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2c2000640 1 --2- 172.21.15.28:0/1681410693 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc06bc40 0x7fd2bc06c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2c2000640 1 -- 172.21.15.28:0/1681410693 >> 172.21.15.28:0/1681410693 conn(0x7fd2bc0ce7e0 msgr2=0x7fd2bc0cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:50.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2c2000640 1 -- 172.21.15.28:0/1681410693 shutdown_connections 2024-04-23T18:22:50.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.817+0000 7fd2c2000640 1 -- 172.21.15.28:0/1681410693 wait complete. 2024-04-23T18:22:50.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2c2000640 1 Processor -- start 2024-04-23T18:22:50.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2c2000640 1 -- start start 2024-04-23T18:22:50.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2c2000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc06bc40 0x7fd2bc1f9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2c2000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2bc06c560 0x7fd2bc15e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2c2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2bc15f520 0x7fd2bc1f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2c2000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc071590 con 0x7fd2bc06c560 2024-04-23T18:22:50.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2c2000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc06fc10 con 0x7fd2bc15f520 2024-04-23T18:22:50.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2c2000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd2bc071710 con 0x7fd2bc06bc40 2024-04-23T18:22:50.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b2a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2bc06c560 0x7fd2bc15e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b2a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2bc06c560 0x7fd2bc15e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45596/0 (socket says 172.21.15.28:45596) 2024-04-23T18:22:50.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b2a00640 1 -- 172.21.15.28:0/4016623096 learned_addr learned my addr 172.21.15.28:0/4016623096 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:50.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2bb400640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc06bc40 0x7fd2bc1f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2bbe00640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2bc15f520 0x7fd2bc1f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b2a00640 1 -- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc06bc40 msgr2=0x7fd2bc1f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b2a00640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc06bc40 0x7fd2bc1f9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b2a00640 1 -- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2bc15f520 msgr2=0x7fd2bc1f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b2a00640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2bc15f520 0x7fd2bc1f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b2a00640 1 -- 172.21.15.28:0/4016623096 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc1606e0 con 0x7fd2bc06c560 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b2a00640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2bc06c560 0x7fd2bc15e4a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40b3040 tx=0x7fd2a401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b3e00640 1 -- 172.21.15.28:0/4016623096 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40bf070 con 0x7fd2bc06c560 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b3e00640 1 -- 172.21.15.28:0/4016623096 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a40b0820 con 0x7fd2bc06c560 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2c2000640 1 -- 172.21.15.28:0/4016623096 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2bc15ec30 con 0x7fd2bc06c560 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2b3e00640 1 -- 172.21.15.28:0/4016623096 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40b5040 con 0x7fd2bc06c560 2024-04-23T18:22:50.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.821+0000 7fd2c2000640 1 -- 172.21.15.28:0/4016623096 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2bc1f8580 con 0x7fd2bc06c560 2024-04-23T18:22:50.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.825+0000 7fd2c2000640 1 -- 172.21.15.28:0/4016623096 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2bc158d70 con 0x7fd2bc06c560 2024-04-23T18:22:50.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.825+0000 7fd2b3e00640 1 -- 172.21.15.28:0/4016623096 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2a40c2070 con 0x7fd2bc06c560 2024-04-23T18:22:50.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.825+0000 7fd2b3e00640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd2980683b0 0x7fd29806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:50.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.825+0000 7fd2b3e00640 1 -- 172.21.15.28:0/4016623096 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd2a4123540 con 0x7fd2bc06c560 2024-04-23T18:22:50.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.825+0000 7fd2bb400640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd2980683b0 0x7fd29806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:50.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.825+0000 7fd2bb400640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd2980683b0 0x7fd29806a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00b9d0 tx=0x7fd2ac008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:50.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.829+0000 7fd2b3e00640 1 -- 172.21.15.28:0/4016623096 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd2a40187f0 con 0x7fd2bc06c560 2024-04-23T18:22:50.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.993+0000 7fd2c2000640 1 -- 172.21.15.28:0/4016623096 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd2bc068d90 con 0x7fd2bc06c560 2024-04-23T18:22:50.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.993+0000 7fd2b3e00640 1 -- 172.21.15.28:0/4016623096 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fd2a40f3730 con 0x7fd2bc06c560 2024-04-23T18:22:50.990 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-04-23T18:22:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 -- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd2980683b0 msgr2=0x7fd29806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd2980683b0 0x7fd29806a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00b9d0 tx=0x7fd2ac008040 comp rx=0 tx=0).stop 2024-04-23T18:22:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 -- 172.21.15.28:0/4016623096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2bc06c560 msgr2=0x7fd2bc15e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2bc06c560 0x7fd2bc15e4a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40b3040 tx=0x7fd2a401ba30 comp rx=0 tx=0).stop 2024-04-23T18:22:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 -- 172.21.15.28:0/4016623096 shutdown_connections 2024-04-23T18:22:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd2980683b0 0x7fd29806a870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2bc15f520 0x7fd2bc1f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd2bc06c560 0x7fd2bc15e4a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 --2- 172.21.15.28:0/4016623096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd2bc06bc40 0x7fd2bc1f9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:50.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 -- 172.21.15.28:0/4016623096 >> 172.21.15.28:0/4016623096 conn(0x7fd2bc0ce7e0 msgr2=0x7fd2bc0c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:50.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 -- 172.21.15.28:0/4016623096 shutdown_connections 2024-04-23T18:22:50.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:50.997+0000 7fd2c2000640 1 -- 172.21.15.28:0/4016623096 wait complete. 2024-04-23T18:22:51.011 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T18:22:51.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4f800640 1 Processor -- start 2024-04-23T18:22:51.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4f800640 1 -- start start 2024-04-23T18:22:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a4815f1a0 0x7f2a48073710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4f800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2a48073c50 0x7f2a4806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4f800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a4815aff0 con 0x7f2a481551b0 2024-04-23T18:22:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4f800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f2a4815bbe0 con 0x7f2a48073c50 2024-04-23T18:22:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4806c530 con 0x7f2a4815f1a0 2024-04-23T18:22:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4d800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2a48073c50 0x7f2a4806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4ce00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2a481551b0 0x7f2a480c9fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36452/0 (socket says 172.21.15.28:36452) 2024-04-23T18:22:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4ce00640 1 -- 172.21.15.28:0/3418772918 learned_addr learned my addr 172.21.15.28:0/3418772918 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:51.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a47e00640 1 --2- 172.21.15.28:0/3418772918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a4815f1a0 0x7f2a48073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4d800640 1 -- 172.21.15.28:0/3418772918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a4815f1a0 msgr2=0x7f2a48073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:51.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4d800640 1 --2- 172.21.15.28:0/3418772918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a4815f1a0 0x7f2a48073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4d800640 1 -- 172.21.15.28:0/3418772918 >> v1:172.21.15.28:6789/0 conn(0x7f2a481551b0 legacy=0x7f2a480c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a4d800640 1 -- 172.21.15.28:0/3418772918 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4815b2b0 con 0x7f2a48073c50 2024-04-23T18:22:51.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.161+0000 7f2a47400640 1 -- 172.21.15.28:0/3418772918 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2613581500 0 0) 0x7f2a4815aff0 con 0x7f2a481551b0 2024-04-23T18:22:51.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a4d800640 1 --2- 172.21.15.28:0/3418772918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a48073c50 0x7f2a4806b9e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009d90 tx=0x7f2a4001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a89c1c02a12083 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:51.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a47400640 1 -- 172.21.15.28:0/3418772918 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a400b2070 con 0x7f2a48073c50 2024-04-23T18:22:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a47400640 1 -- 172.21.15.28:0/3418772918 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a400a5830 con 0x7f2a48073c50 2024-04-23T18:22:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a47400640 1 -- 172.21.15.28:0/3418772918 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a400a5c00 con 0x7f2a48073c50 2024-04-23T18:22:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a4f800640 1 -- 172.21.15.28:0/3418772918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a48073c50 msgr2=0x7f2a4806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a4f800640 1 --2- 172.21.15.28:0/3418772918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a48073c50 0x7f2a4806b9e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009d90 tx=0x7f2a4001c970 comp rx=0 tx=0).stop 2024-04-23T18:22:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a4f800640 1 -- 172.21.15.28:0/3418772918 shutdown_connections 2024-04-23T18:22:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a4f800640 1 --2- 172.21.15.28:0/3418772918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a48073c50 0x7f2a4806b9e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a4f800640 1 --2- 172.21.15.28:0/3418772918 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a4815f1a0 0x7f2a48073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a4f800640 1 -- 172.21.15.28:0/3418772918 >> 172.21.15.28:0/3418772918 conn(0x7f2a480676e0 msgr2=0x7f2a48067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a4f800640 1 -- 172.21.15.28:0/3418772918 shutdown_connections 2024-04-23T18:22:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a4f800640 1 -- 172.21.15.28:0/3418772918 wait complete. 2024-04-23T18:22:51.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a4f800640 1 Processor -- start 2024-04-23T18:22:51.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.165+0000 7f2a4f800640 1 -- start start 2024-04-23T18:22:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4f800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a48073c50 0x7f2a48156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a481551b0 0x7f2a481481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a4815f1a0 0x7f2a48148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4f800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2a480ca6d0 con 0x7f2a48073c50 2024-04-23T18:22:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4815f580 con 0x7f2a4815f1a0 2024-04-23T18:22:51.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2a480ca850 con 0x7f2a481551b0 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4ce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a48073c50 0x7f2a48156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4ce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a48073c50 0x7f2a48156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45614/0 (socket says 172.21.15.28:45614) 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4ce00640 1 -- 172.21.15.28:0/4188082630 learned_addr learned my addr 172.21.15.28:0/4188082630 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a47e00640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a481551b0 0x7f2a481481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4d800640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a4815f1a0 0x7f2a48148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4ce00640 1 -- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a481551b0 msgr2=0x7f2a481481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4ce00640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a481551b0 0x7f2a481481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4ce00640 1 -- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a4815f1a0 msgr2=0x7f2a48148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4ce00640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a4815f1a0 0x7f2a48148730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4ce00640 1 -- 172.21.15.28:0/4188082630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a481f7a30 con 0x7f2a48073c50 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4ce00640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a48073c50 0x7f2a48156960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800c520 tx=0x7f2a3800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a44c00640 1 -- 172.21.15.28:0/4188082630 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a38018070 con 0x7f2a48073c50 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a44c00640 1 -- 172.21.15.28:0/4188082630 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a380074e0 con 0x7f2a48073c50 2024-04-23T18:22:51.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4f800640 1 -- 172.21.15.28:0/4188082630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a481ed040 con 0x7f2a48073c50 2024-04-23T18:22:51.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a44c00640 1 -- 172.21.15.28:0/4188082630 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a380049f0 con 0x7f2a48073c50 2024-04-23T18:22:51.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4f800640 1 -- 172.21.15.28:0/4188082630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a481ed600 con 0x7f2a48073c50 2024-04-23T18:22:51.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.169+0000 7f2a4f800640 1 -- 172.21.15.28:0/4188082630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a48068db0 con 0x7f2a48073c50 2024-04-23T18:22:51.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.173+0000 7f2a44c00640 1 -- 172.21.15.28:0/4188082630 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2a3801b070 con 0x7f2a48073c50 2024-04-23T18:22:51.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.173+0000 7f2a44c00640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a28068380 0x7f2a2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.173+0000 7f2a44c00640 1 -- 172.21.15.28:0/4188082630 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2a380862a0 con 0x7f2a48073c50 2024-04-23T18:22:51.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.173+0000 7f2a47e00640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a28068380 0x7f2a2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.173+0000 7f2a47e00640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a28068380 0x7f2a2806a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a48156480 tx=0x7f2a34008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:51.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.177+0000 7f2a44c00640 1 -- 172.21.15.28:0/4188082630 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2a380563f0 con 0x7f2a48073c50 2024-04-23T18:22:51.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a4f800640 1 -- 172.21.15.28:0/4188082630 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2a48067c60 con 0x7f2a48073c50 2024-04-23T18:22:51.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a44c00640 1 -- 172.21.15.28:0/4188082630 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f2a38055cf0 con 0x7f2a48073c50 2024-04-23T18:22:51.337 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:22:51.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a4f800640 1 -- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a28068380 msgr2=0x7f2a2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a4f800640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a28068380 0x7f2a2806a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a48156480 tx=0x7f2a34008040 comp rx=0 tx=0).stop 2024-04-23T18:22:51.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a4f800640 1 -- 172.21.15.28:0/4188082630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a48073c50 msgr2=0x7f2a48156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a4f800640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a48073c50 0x7f2a48156960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800c520 tx=0x7f2a3800c9e0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a4f800640 1 -- 172.21.15.28:0/4188082630 shutdown_connections 2024-04-23T18:22:51.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a4f800640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a28068380 0x7f2a2806a840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a4f800640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a481551b0 0x7f2a481481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a4f800640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a4815f1a0 0x7f2a48148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a4f800640 1 --2- 172.21.15.28:0/4188082630 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a48073c50 0x7f2a48156960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.341+0000 7f2a4f800640 1 -- 172.21.15.28:0/4188082630 >> 172.21.15.28:0/4188082630 conn(0x7f2a480676e0 msgr2=0x7f2a48073380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:51.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.345+0000 7f2a4f800640 1 -- 172.21.15.28:0/4188082630 shutdown_connections 2024-04-23T18:22:51.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.345+0000 7f2a4f800640 1 -- 172.21.15.28:0/4188082630 wait complete. 2024-04-23T18:22:51.359 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T18:22:51.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51d0e00640 1 Processor -- start 2024-04-23T18:22:51.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51d0e00640 1 -- start start 2024-04-23T18:22:51.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51d0e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f51cc14f8d0 0x7f51cc158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51d0e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f51cc073050 0x7f51cc0c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51d0e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51cc0c9e50 0x7f51cc0c7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51d0e00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f51cc073da0 con 0x7f51cc073050 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51d0e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f51cc073520 con 0x7f51cc14f8d0 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51d0e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f51cc0737e0 con 0x7f51cc0c9e50 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51c9400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f51cc073050 0x7f51cc0c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51c9400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f51cc073050 0x7f51cc0c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45616/0 (socket says 172.21.15.28:45616) 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51c9400640 1 -- 172.21.15.28:0/3286227845 learned_addr learned my addr 172.21.15.28:0/3286227845 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51c9e00640 1 --2- 172.21.15.28:0/3286227845 >> v2:172.21.15.137:3300/0 conn(0x7f51cc14f8d0 0x7f51cc158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51ca800640 1 --2- 172.21.15.28:0/3286227845 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51cc0c9e50 0x7f51cc0c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51c9400640 1 -- 172.21.15.28:0/3286227845 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51cc0c9e50 msgr2=0x7f51cc0c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51c9400640 1 --2- 172.21.15.28:0/3286227845 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51cc0c9e50 0x7f51cc0c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51c9400640 1 -- 172.21.15.28:0/3286227845 >> v2:172.21.15.137:3300/0 conn(0x7f51cc14f8d0 msgr2=0x7f51cc158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:51.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51c9400640 1 --2- 172.21.15.28:0/3286227845 >> v2:172.21.15.137:3300/0 conn(0x7f51cc14f8d0 0x7f51cc158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.509+0000 7f51c9400640 1 -- 172.21.15.28:0/3286227845 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc073ac0 con 0x7f51cc073050 2024-04-23T18:22:51.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51c9400640 1 --2- 172.21.15.28:0/3286227845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51cc073050 0x7f51cc0c6900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0ca3f0 tx=0x7f51b801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d776e7ae20fa2e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51c8a00640 1 -- 172.21.15.28:0/3286227845 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b80ab640 con 0x7f51cc073050 2024-04-23T18:22:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51c8a00640 1 -- 172.21.15.28:0/3286227845 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b80b0070 con 0x7f51cc073050 2024-04-23T18:22:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51c8a00640 1 -- 172.21.15.28:0/3286227845 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b80aba00 con 0x7f51cc073050 2024-04-23T18:22:51.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51d0e00640 1 -- 172.21.15.28:0/3286227845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51cc073050 msgr2=0x7f51cc0c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51d0e00640 1 --2- 172.21.15.28:0/3286227845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51cc073050 0x7f51cc0c6900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0ca3f0 tx=0x7f51b801c460 comp rx=0 tx=0).stop 2024-04-23T18:22:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51d0e00640 1 -- 172.21.15.28:0/3286227845 shutdown_connections 2024-04-23T18:22:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51d0e00640 1 --2- 172.21.15.28:0/3286227845 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51cc0c9e50 0x7f51cc0c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51d0e00640 1 --2- 172.21.15.28:0/3286227845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51cc073050 0x7f51cc0c6900 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51d0e00640 1 --2- 172.21.15.28:0/3286227845 >> v2:172.21.15.137:3300/0 conn(0x7f51cc14f8d0 0x7f51cc158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51d0e00640 1 -- 172.21.15.28:0/3286227845 >> 172.21.15.28:0/3286227845 conn(0x7f51cc0c9330 msgr2=0x7f51cc0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51d0e00640 1 -- 172.21.15.28:0/3286227845 shutdown_connections 2024-04-23T18:22:51.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51d0e00640 1 -- 172.21.15.28:0/3286227845 wait complete. 2024-04-23T18:22:51.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.513+0000 7f51d0e00640 1 Processor -- start 2024-04-23T18:22:51.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51d0e00640 1 -- start start 2024-04-23T18:22:51.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51d0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51cc073050 0x7f51cc071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51d0e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51cc0c9e50 0x7f51cc161680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51d0e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51cc14f8d0 0x7f51cc0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51d0e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc15cce0 con 0x7f51cc0c9e50 2024-04-23T18:22:51.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51d0e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc14fcb0 con 0x7f51cc073050 2024-04-23T18:22:51.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51d0e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f51cc15ce60 con 0x7f51cc14f8d0 2024-04-23T18:22:51.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c9400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51cc0c9e50 0x7f51cc161680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c9400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51cc0c9e50 0x7f51cc161680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45624/0 (socket says 172.21.15.28:45624) 2024-04-23T18:22:51.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c9400640 1 -- 172.21.15.28:0/2922078310 learned_addr learned my addr 172.21.15.28:0/2922078310 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:51.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c9e00640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51cc073050 0x7f51cc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51ca800640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51cc14f8d0 0x7f51cc0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c9400640 1 -- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51cc14f8d0 msgr2=0x7f51cc0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c9400640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51cc14f8d0 0x7f51cc0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c9400640 1 -- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51cc073050 msgr2=0x7f51cc071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c9400640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51cc073050 0x7f51cc071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c9400640 1 -- 172.21.15.28:0/2922078310 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc072e40 con 0x7f51cc0c9e50 2024-04-23T18:22:51.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c9400640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51cc0c9e50 0x7f51cc161680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f51b801cd00 tx=0x7f51b801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:51.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c2000640 1 -- 172.21.15.28:0/2922078310 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b80be3f0 con 0x7f51cc0c9e50 2024-04-23T18:22:51.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c2000640 1 -- 172.21.15.28:0/2922078310 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b80be590 con 0x7f51cc0c9e50 2024-04-23T18:22:51.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51d0e00640 1 -- 172.21.15.28:0/2922078310 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51cc071da0 con 0x7f51cc0c9e50 2024-04-23T18:22:51.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51c2000640 1 -- 172.21.15.28:0/2922078310 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b80be960 con 0x7f51cc0c9e50 2024-04-23T18:22:51.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51d0e00640 1 -- 172.21.15.28:0/2922078310 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51cc072360 con 0x7f51cc0c9e50 2024-04-23T18:22:51.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.517+0000 7f51d0e00640 1 -- 172.21.15.28:0/2922078310 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51cc068db0 con 0x7f51cc0c9e50 2024-04-23T18:22:51.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.521+0000 7f51c2000640 1 -- 172.21.15.28:0/2922078310 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f51b80b43f0 con 0x7f51cc0c9e50 2024-04-23T18:22:51.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.521+0000 7f51c2000640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f51ac068380 0x7f51ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.521+0000 7f51c2000640 1 -- 172.21.15.28:0/2922078310 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f51b8121380 con 0x7f51cc0c9e50 2024-04-23T18:22:51.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.521+0000 7f51c9e00640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f51ac068380 0x7f51ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.521+0000 7f51c9e00640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f51ac068380 0x7f51ac06a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0079c0 tx=0x7f51bc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:51.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.525+0000 7f51c2000640 1 -- 172.21.15.28:0/2922078310 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f51b80c4060 con 0x7f51cc0c9e50 2024-04-23T18:22:51.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 -- 172.21.15.28:0/2922078310 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f51cc0c70a0 con 0x7f51cc0c9e50 2024-04-23T18:22:51.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51c2000640 1 -- 172.21.15.28:0/2922078310 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f51b8016110 con 0x7f51cc0c9e50 2024-04-23T18:22:51.685 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2024-04-23T18:22:51.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 -- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f51ac068380 msgr2=0x7f51ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f51ac068380 0x7f51ac06a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0079c0 tx=0x7f51bc008040 comp rx=0 tx=0).stop 2024-04-23T18:22:51.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 -- 172.21.15.28:0/2922078310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51cc0c9e50 msgr2=0x7f51cc161680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51cc0c9e50 0x7f51cc161680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f51b801cd00 tx=0x7f51b801aca0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 -- 172.21.15.28:0/2922078310 shutdown_connections 2024-04-23T18:22:51.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f51ac068380 0x7f51ac06a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f51cc14f8d0 0x7f51cc0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51cc0c9e50 0x7f51cc161680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 --2- 172.21.15.28:0/2922078310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51cc073050 0x7f51cc071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 -- 172.21.15.28:0/2922078310 >> 172.21.15.28:0/2922078310 conn(0x7f51cc0c9330 msgr2=0x7f51cc0c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:51.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 -- 172.21.15.28:0/2922078310 shutdown_connections 2024-04-23T18:22:51.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.689+0000 7f51d0e00640 1 -- 172.21.15.28:0/2922078310 wait complete. 2024-04-23T18:22:51.707 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T18:22:51.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.853+0000 7f4a2e800640 1 Processor -- start 2024-04-23T18:22:51.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.853+0000 7f4a2e800640 1 -- start start 2024-04-23T18:22:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a2e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4a28152f80 0x7f4a280736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a2e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a280c92f0 0x7f4a280c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a2e800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a280c5df0 con 0x7f4a280c8b70 2024-04-23T18:22:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a2e800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4a2815c3f0 con 0x7f4a28152f80 2024-04-23T18:22:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a2e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4a281590a0 con 0x7f4a280c92f0 2024-04-23T18:22:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a1ea00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4a280c8b70 0x7f4a28159530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36462/0 (socket says 172.21.15.28:36462) 2024-04-23T18:22:51.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a1ea00640 1 -- 172.21.15.28:0/2031259581 learned_addr learned my addr 172.21.15.28:0/2031259581 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:51.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a27e00640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a280c92f0 0x7f4a280c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a27400640 1 --2- 172.21.15.28:0/2031259581 >> v2:172.21.15.137:3300/0 conn(0x7f4a28152f80 0x7f4a280736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616128117 0 0) 0x7f4a280c5df0 con 0x7f4a280c8b70 2024-04-23T18:22:51.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a0c003530 con 0x7f4a280c8b70 2024-04-23T18:22:51.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3199911123 0 0) 0x7f4a0c003530 con 0x7f4a280c8b70 2024-04-23T18:22:51.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a280c92f0 msgr2=0x7f4a280c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a280c92f0 0x7f4a280c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 >> v2:172.21.15.137:3300/0 conn(0x7f4a28152f80 msgr2=0x7f4a280736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 --2- 172.21.15.28:0/2031259581 >> v2:172.21.15.137:3300/0 conn(0x7f4a28152f80 0x7f4a280736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a280c6090 con 0x7f4a280c8b70 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f4a18001680 con 0x7f4a280c8b70 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 >> v1:172.21.15.28:6789/0 conn(0x7f4a280c8b70 legacy=0x7f4a28159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 0x7f4a0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a0c004810 0x7f4a0c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a280c92f0 0x7f4a0c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4a281590a0 con 0x7f4a0c0039c0 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c00b9d0 con 0x7f4a0c004810 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0c00bb80 con 0x7f4a280c92f0 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a27400640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 0x7f4a0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a1ea00640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a0c004810 0x7f4a0c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a27e00640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a280c92f0 0x7f4a0c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a27400640 1 -- 172.21.15.28:0/2031259581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a280c92f0 msgr2=0x7f4a0c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a27400640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a280c92f0 0x7f4a0c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a27400640 1 -- 172.21.15.28:0/2031259581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a0c004810 msgr2=0x7f4a0c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a27400640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a0c004810 0x7f4a0c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.857+0000 7f4a27400640 1 -- 172.21.15.28:0/2031259581 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c003530 con 0x7f4a0c0039c0 2024-04-23T18:22:51.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.861+0000 7f4a27400640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 0x7f4a0c003de0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009ae0 tx=0x7f4a1001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718eaf8657124d1b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:51.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.861+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a100096b0 con 0x7f4a0c0039c0 2024-04-23T18:22:51.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.861+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a100a64c0 con 0x7f4a0c0039c0 2024-04-23T18:22:51.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.861+0000 7f4a26a00640 1 -- 172.21.15.28:0/2031259581 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a100a68b0 con 0x7f4a0c0039c0 2024-04-23T18:22:51.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.861+0000 7f4a2e800640 1 -- 172.21.15.28:0/2031259581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 msgr2=0x7f4a0c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.861+0000 7f4a2e800640 1 --2- 172.21.15.28:0/2031259581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 0x7f4a0c003de0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009ae0 tx=0x7f4a1001cab0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.861+0000 7f4a27e00640 1 -- 172.21.15.28:0/2031259581 reap_dead start 2024-04-23T18:22:51.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.861+0000 7f4a2e800640 1 -- 172.21.15.28:0/2031259581 shutdown_connections 2024-04-23T18:22:51.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.861+0000 7f4a2e800640 1 -- 172.21.15.28:0/2031259581 >> 172.21.15.28:0/2031259581 conn(0x7f4a280676e0 msgr2=0x7f4a28067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:51.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.861+0000 7f4a2e800640 1 -- 172.21.15.28:0/2031259581 shutdown_connections 2024-04-23T18:22:51.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.861+0000 7f4a2e800640 1 -- 172.21.15.28:0/2031259581 wait complete. 2024-04-23T18:22:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a2e800640 1 Processor -- start 2024-04-23T18:22:51.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a2e800640 1 -- start start 2024-04-23T18:22:51.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a2e800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 0x7f4a281e2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a2e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a281514b0 0x7f4a2814c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a2e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a2814cdc0 0x7f4a2815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a2e800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4a280c6930 con 0x7f4a0c0039c0 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a2e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a280c6650 con 0x7f4a2814cdc0 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a2e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4a28159c40 con 0x7f4a281514b0 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a27400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 0x7f4a281e2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a27400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 0x7f4a281e2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45650/0 (socket says 172.21.15.28:45650) 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a27400640 1 -- 172.21.15.28:0/1400250721 learned_addr learned my addr 172.21.15.28:0/1400250721 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a1ea00640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a281514b0 0x7f4a2814c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a27e00640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a2814cdc0 0x7f4a2815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a27400640 1 -- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a281514b0 msgr2=0x7f4a2814c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a27400640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a281514b0 0x7f4a2814c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a27400640 1 -- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a2814cdc0 msgr2=0x7f4a2815a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:51.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a27400640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a2814cdc0 0x7f4a2815a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:51.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a27400640 1 -- 172.21.15.28:0/1400250721 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a281e70a0 con 0x7f4a0c0039c0 2024-04-23T18:22:51.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a27400640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 0x7f4a281e2af0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4a100b0040 tx=0x7f4a0c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:51.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a1fe00640 1 -- 172.21.15.28:0/1400250721 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a100a6880 con 0x7f4a0c0039c0 2024-04-23T18:22:51.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a1fe00640 1 -- 172.21.15.28:0/1400250721 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a100bf070 con 0x7f4a0c0039c0 2024-04-23T18:22:51.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a1fe00640 1 -- 172.21.15.28:0/1400250721 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a100a6ca0 con 0x7f4a0c0039c0 2024-04-23T18:22:51.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a2e800640 1 -- 172.21.15.28:0/1400250721 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a281e7380 con 0x7f4a0c0039c0 2024-04-23T18:22:51.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a2e800640 1 -- 172.21.15.28:0/1400250721 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2815a0a0 con 0x7f4a0c0039c0 2024-04-23T18:22:51.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.865+0000 7f4a2e800640 1 -- 172.21.15.28:0/1400250721 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a28068db0 con 0x7f4a0c0039c0 2024-04-23T18:22:51.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.869+0000 7f4a1fe00640 1 -- 172.21.15.28:0/1400250721 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a10006040 con 0x7f4a0c0039c0 2024-04-23T18:22:51.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.869+0000 7f4a1fe00640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4a04068380 0x7f4a0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:51.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.869+0000 7f4a1fe00640 1 -- 172.21.15.28:0/1400250721 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4a10121a50 con 0x7f4a0c0039c0 2024-04-23T18:22:51.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.869+0000 7f4a1ea00640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4a04068380 0x7f4a0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:51.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.869+0000 7f4a1ea00640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4a04068380 0x7f4a0406a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a18000c10 tx=0x7f4a18009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:51.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:51.873+0000 7f4a1fe00640 1 -- 172.21.15.28:0/1400250721 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4a100167c0 con 0x7f4a0c0039c0 2024-04-23T18:22:52.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.037+0000 7f4a2e800640 1 -- 172.21.15.28:0/1400250721 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4a280c5450 con 0x7f4a0c0039c0 2024-04-23T18:22:52.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.037+0000 7f4a1fe00640 1 -- 172.21.15.28:0/1400250721 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f4a100f1cc0 con 0x7f4a0c0039c0 2024-04-23T18:22:52.035 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:22:52.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 -- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4a04068380 msgr2=0x7f4a0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4a04068380 0x7f4a0406a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a18000c10 tx=0x7f4a18009040 comp rx=0 tx=0).stop 2024-04-23T18:22:52.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 -- 172.21.15.28:0/1400250721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 msgr2=0x7f4a281e2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 0x7f4a281e2af0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4a100b0040 tx=0x7f4a0c005840 comp rx=0 tx=0).stop 2024-04-23T18:22:52.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 -- 172.21.15.28:0/1400250721 shutdown_connections 2024-04-23T18:22:52.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4a04068380 0x7f4a0406a840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a281514b0 0x7f4a2814c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a2814cdc0 0x7f4a2815a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 --2- 172.21.15.28:0/1400250721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4a0c0039c0 0x7f4a281e2af0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 -- 172.21.15.28:0/1400250721 >> 172.21.15.28:0/1400250721 conn(0x7f4a280676e0 msgr2=0x7f4a280c8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:52.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 -- 172.21.15.28:0/1400250721 shutdown_connections 2024-04-23T18:22:52.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.041+0000 7f4a2e800640 1 -- 172.21.15.28:0/1400250721 wait complete. 2024-04-23T18:22:52.057 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T18:22:52.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.201+0000 7f3894c00640 1 Processor -- start 2024-04-23T18:22:52.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.201+0000 7f3894c00640 1 -- start start 2024-04-23T18:22:52.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f3894c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3890144360 0x7f389015bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f3894c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f389006b9e0 0x7f389006be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f3894c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f389015c210 con 0x7f38900c9050 2024-04-23T18:22:52.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f3894c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f38900ca530 con 0x7f3890144360 2024-04-23T18:22:52.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f3894c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f389006c720 con 0x7f389006b9e0 2024-04-23T18:22:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f388de00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3890144360 0x7f389015bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f3885400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f38900c9050 0x7f38900c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:55340/0 (socket says 172.21.15.28:55340) 2024-04-23T18:22:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f3885400640 1 -- 172.21.15.28:0/1446251088 learned_addr learned my addr 172.21.15.28:0/1446251088 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:52.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f388e800640 1 --2- 172.21.15.28:0/1446251088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f389006b9e0 0x7f389006be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f388de00640 1 -- 172.21.15.28:0/1446251088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f389006b9e0 msgr2=0x7f389006be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:52.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f388de00640 1 --2- 172.21.15.28:0/1446251088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f389006b9e0 0x7f389006be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f388de00640 1 -- 172.21.15.28:0/1446251088 >> v1:172.21.15.137:6789/0 conn(0x7f38900c9050 legacy=0x7f38900c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.205+0000 7f388de00640 1 -- 172.21.15.28:0/1446251088 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3890071570 con 0x7f3890144360 2024-04-23T18:22:52.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f388de00640 1 --2- 172.21.15.28:0/1446251088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3890144360 0x7f389015bcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3880009d90 tx=0x7f388001f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22566fcb2831d833 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:52.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f388d400640 1 -- 172.21.15.28:0/1446251088 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38800b4070 con 0x7f3890144360 2024-04-23T18:22:52.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f388d400640 1 -- 172.21.15.28:0/1446251088 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38800af600 con 0x7f3890144360 2024-04-23T18:22:52.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f388d400640 1 -- 172.21.15.28:0/1446251088 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38800af9d0 con 0x7f3890144360 2024-04-23T18:22:52.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f3894c00640 1 -- 172.21.15.28:0/1446251088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3890144360 msgr2=0x7f389015bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f3894c00640 1 --2- 172.21.15.28:0/1446251088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3890144360 0x7f389015bcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3880009d90 tx=0x7f388001f150 comp rx=0 tx=0).stop 2024-04-23T18:22:52.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f3894c00640 1 -- 172.21.15.28:0/1446251088 shutdown_connections 2024-04-23T18:22:52.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f3894c00640 1 --2- 172.21.15.28:0/1446251088 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f389006b9e0 0x7f389006be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f3894c00640 1 --2- 172.21.15.28:0/1446251088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3890144360 0x7f389015bcd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f3894c00640 1 -- 172.21.15.28:0/1446251088 >> 172.21.15.28:0/1446251088 conn(0x7f38900676e0 msgr2=0x7f3890067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:52.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f3894c00640 1 -- 172.21.15.28:0/1446251088 shutdown_connections 2024-04-23T18:22:52.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f3894c00640 1 -- 172.21.15.28:0/1446251088 wait complete. 2024-04-23T18:22:52.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.209+0000 7f3894c00640 1 Processor -- start 2024-04-23T18:22:52.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3894c00640 1 -- start start 2024-04-23T18:22:52.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3894c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f389006b9e0 0x7f389013b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3894c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38900c9050 0x7f389015df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3894c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3890144360 0x7f389013bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3894c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f389015eb00 con 0x7f3890144360 2024-04-23T18:22:52.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3894c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f389015e820 con 0x7f38900c9050 2024-04-23T18:22:52.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3894c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f389015ede0 con 0x7f389006b9e0 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f388e800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3890144360 0x7f389013bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3885400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38900c9050 0x7f389015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f388e800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3890144360 0x7f389013bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45666/0 (socket says 172.21.15.28:45666) 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f388e800640 1 -- 172.21.15.28:0/2490656543 learned_addr learned my addr 172.21.15.28:0/2490656543 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f388de00640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f389006b9e0 0x7f389013b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f388e800640 1 -- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f389006b9e0 msgr2=0x7f389013b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f388e800640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f389006b9e0 0x7f389013b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f388e800640 1 -- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38900c9050 msgr2=0x7f389015df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f388e800640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38900c9050 0x7f389015df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f388e800640 1 -- 172.21.15.28:0/2490656543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38901e6d30 con 0x7f3890144360 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f388de00640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f389006b9e0 0x7f389013b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:52.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f388e800640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3890144360 0x7f389013bc30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f388800e820 tx=0x7f388800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:52.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3886a00640 1 -- 172.21.15.28:0/2490656543 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888017070 con 0x7f3890144360 2024-04-23T18:22:52.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3886a00640 1 -- 172.21.15.28:0/2490656543 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388800c940 con 0x7f3890144360 2024-04-23T18:22:52.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3886a00640 1 -- 172.21.15.28:0/2490656543 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388800cd10 con 0x7f3890144360 2024-04-23T18:22:52.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3894c00640 1 -- 172.21.15.28:0/2490656543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38900cdd80 con 0x7f3890144360 2024-04-23T18:22:52.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3894c00640 1 -- 172.21.15.28:0/2490656543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38900ce340 con 0x7f3890144360 2024-04-23T18:22:52.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.213+0000 7f3894c00640 1 -- 172.21.15.28:0/2490656543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3890068db0 con 0x7f3890144360 2024-04-23T18:22:52.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.217+0000 7f3886a00640 1 -- 172.21.15.28:0/2490656543 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f388801a070 con 0x7f3890144360 2024-04-23T18:22:52.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.217+0000 7f3886a00640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f386c068380 0x7f386c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.217+0000 7f3886a00640 1 -- 172.21.15.28:0/2490656543 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3888086e50 con 0x7f3890144360 2024-04-23T18:22:52.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.217+0000 7f388de00640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f386c068380 0x7f386c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.217+0000 7f388de00640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f386c068380 0x7f386c06a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38800b1000 tx=0x7f38800aa000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:52.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.221+0000 7f3886a00640 1 -- 172.21.15.28:0/2490656543 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3888056a70 con 0x7f3890144360 2024-04-23T18:22:52.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 -- 172.21.15.28:0/2490656543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3890154d10 con 0x7f3890144360 2024-04-23T18:22:52.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3886a00640 1 -- 172.21.15.28:0/2490656543 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f388805ad70 con 0x7f3890144360 2024-04-23T18:22:52.392 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-04-23T18:22:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 -- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f386c068380 msgr2=0x7f386c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f386c068380 0x7f386c06a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38800b1000 tx=0x7f38800aa000 comp rx=0 tx=0).stop 2024-04-23T18:22:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 -- 172.21.15.28:0/2490656543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3890144360 msgr2=0x7f389013bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3890144360 0x7f389013bc30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f388800e820 tx=0x7f388800ece0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 -- 172.21.15.28:0/2490656543 shutdown_connections 2024-04-23T18:22:52.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f386c068380 0x7f386c06a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3890144360 0x7f389013bc30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f38900c9050 0x7f389015df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 --2- 172.21.15.28:0/2490656543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f389006b9e0 0x7f389013b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 -- 172.21.15.28:0/2490656543 >> 172.21.15.28:0/2490656543 conn(0x7f38900676e0 msgr2=0x7f3890067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:52.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 -- 172.21.15.28:0/2490656543 shutdown_connections 2024-04-23T18:22:52.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.397+0000 7f3894c00640 1 -- 172.21.15.28:0/2490656543 wait complete. 2024-04-23T18:22:52.414 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi028.front.sepia.ceph.com... 2024-04-23T18:22:52.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:52.415 DEBUG:teuthology.orchestra.run.smithi028:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-23T18:22:52.447 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi028.stderr:ceph-fuse[32454]: fuse finished with error 0 and tester_r 0 2024-04-23T18:22:52.451 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:22:52.481 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:22:52.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:22:52.481 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-23T18:22:52.537 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:52.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.721+0000 7f6e98800640 1 Processor -- start 2024-04-23T18:22:52.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.721+0000 7f6e98800640 1 -- start start 2024-04-23T18:22:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.721+0000 7f6e98800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e90072080 0x7f6e900718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e98800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e900c9de0 con 0x7f6e90151f90 2024-04-23T18:22:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e98800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e90158cf0 con 0x7f6e90152370 2024-04-23T18:22:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e98800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e900ca080 con 0x7f6e90072080 2024-04-23T18:22:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e95e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6e90151f90 0x7f6e9015b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36474/0 (socket says 172.21.15.28:36474) 2024-04-23T18:22:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e95e00640 1 -- 172.21.15.28:0/2994046625 learned_addr learned my addr 172.21.15.28:0/2994046625 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:52.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e95400640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e90072080 0x7f6e900718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2351252058 0 0) 0x7f6e900c9de0 con 0x7f6e90151f90 2024-04-23T18:22:52.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e78003530 con 0x7f6e90151f90 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3524884107 0 0) 0x7f6e78003530 con 0x7f6e90151f90 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e90072080 msgr2=0x7f6e900718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e90072080 0x7f6e900718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 >> v1:172.21.15.137:6789/0 conn(0x7f6e90152370 legacy=0x7f6e900c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e90157f30 con 0x7f6e90151f90 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f6e840016a0 con 0x7f6e90151f90 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 >> v1:172.21.15.28:6789/0 conn(0x7f6e90151f90 legacy=0x7f6e9015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e90072080 0x7f6e780039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e78003f70 0x7f6e78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e78004d50 0x7f6e780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900ca080 con 0x7f6e78004d50 2024-04-23T18:22:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7800bb40 con 0x7f6e78003f70 2024-04-23T18:22:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e7800bd40 con 0x7f6e90072080 2024-04-23T18:22:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e96800640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e78004d50 0x7f6e780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e95e00640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e90072080 0x7f6e780039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e95400640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e78003f70 0x7f6e78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e96800640 1 -- 172.21.15.28:0/2994046625 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e90072080 msgr2=0x7f6e780039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e96800640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e90072080 0x7f6e780039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e96800640 1 -- 172.21.15.28:0/2994046625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e78003f70 msgr2=0x7f6e78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e96800640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e78003f70 0x7f6e78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.725+0000 7f6e96800640 1 -- 172.21.15.28:0/2994046625 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e78003530 con 0x7f6e78004d50 2024-04-23T18:22:52.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e96800640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e78004d50 0x7f6e780051d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c001e70 tx=0x7f6e8c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a68a03f2c7691b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:52.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c001a90 con 0x7f6e78004d50 2024-04-23T18:22:52.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8c003b80 con 0x7f6e78004d50 2024-04-23T18:22:52.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e94a00640 1 -- 172.21.15.28:0/2994046625 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c005080 con 0x7f6e78004d50 2024-04-23T18:22:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e98800640 1 -- 172.21.15.28:0/2994046625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e78004d50 msgr2=0x7f6e780051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e98800640 1 --2- 172.21.15.28:0/2994046625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e78004d50 0x7f6e780051d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c001e70 tx=0x7f6e8c01c780 comp rx=0 tx=0).stop 2024-04-23T18:22:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e96800640 1 -- 172.21.15.28:0/2994046625 reap_dead start 2024-04-23T18:22:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e98800640 1 -- 172.21.15.28:0/2994046625 shutdown_connections 2024-04-23T18:22:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e98800640 1 -- 172.21.15.28:0/2994046625 >> 172.21.15.28:0/2994046625 conn(0x7f6e9006d0a0 msgr2=0x7f6e900676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e98800640 1 -- 172.21.15.28:0/2994046625 shutdown_connections 2024-04-23T18:22:52.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e98800640 1 -- 172.21.15.28:0/2994046625 wait complete. 2024-04-23T18:22:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e98800640 1 Processor -- start 2024-04-23T18:22:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.729+0000 7f6e98800640 1 -- start start 2024-04-23T18:22:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e98800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e78004d50 0x7f6e901ef330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e98800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e901472b0 0x7f6e901f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e98800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e901f2ba0 0x7f6e9013c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e98800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e901587d0 con 0x7f6e901472b0 2024-04-23T18:22:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e98800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e901584f0 con 0x7f6e78004d50 2024-04-23T18:22:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e98800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9015baa0 con 0x7f6e901f2ba0 2024-04-23T18:22:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e95400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e901472b0 0x7f6e901f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e95400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e901472b0 0x7f6e901f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45684/0 (socket says 172.21.15.28:45684) 2024-04-23T18:22:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e95400640 1 -- 172.21.15.28:0/2660444871 learned_addr learned my addr 172.21.15.28:0/2660444871 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e96800640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e901f2ba0 0x7f6e9013c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e95e00640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e78004d50 0x7f6e901ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e95400640 1 -- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e901f2ba0 msgr2=0x7f6e9013c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e95400640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e901f2ba0 0x7f6e9013c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e95400640 1 -- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e78004d50 msgr2=0x7f6e901ef330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e95400640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e78004d50 0x7f6e901ef330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e95400640 1 -- 172.21.15.28:0/2660444871 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e90150e90 con 0x7f6e901472b0 2024-04-23T18:22:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e96800640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e901f2ba0 0x7f6e9013c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e95e00640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e78004d50 0x7f6e901ef330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e95400640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e901472b0 0x7f6e901f2660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e80011a00 tx=0x7f6e80011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e8a000640 1 -- 172.21.15.28:0/2660444871 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8000fb50 con 0x7f6e901472b0 2024-04-23T18:22:52.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e8a000640 1 -- 172.21.15.28:0/2660444871 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8000fcf0 con 0x7f6e901472b0 2024-04-23T18:22:52.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e8a000640 1 -- 172.21.15.28:0/2660444871 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8000fea0 con 0x7f6e901472b0 2024-04-23T18:22:52.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e98800640 1 -- 172.21.15.28:0/2660444871 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e90151130 con 0x7f6e901472b0 2024-04-23T18:22:52.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e98800640 1 -- 172.21.15.28:0/2660444871 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e901f1e60 con 0x7f6e901472b0 2024-04-23T18:22:52.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e98800640 1 -- 172.21.15.28:0/2660444871 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e90068cd0 con 0x7f6e901472b0 2024-04-23T18:22:52.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.733+0000 7f6e8a000640 1 -- 172.21.15.28:0/2660444871 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6e80012040 con 0x7f6e901472b0 2024-04-23T18:22:52.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.737+0000 7f6e8a000640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e74068380 0x7f6e7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:52.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.737+0000 7f6e8a000640 1 -- 172.21.15.28:0/2660444871 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6e800874f0 con 0x7f6e901472b0 2024-04-23T18:22:52.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.737+0000 7f6e95e00640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e74068380 0x7f6e7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:52.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.737+0000 7f6e95e00640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e74068380 0x7f6e7406a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e900c9fb0 tx=0x7f6e84009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.741+0000 7f6e8a000640 1 -- 172.21.15.28:0/2660444871 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6e80019030 con 0x7f6e901472b0 2024-04-23T18:22:52.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.905+0000 7f6e98800640 1 -- 172.21.15.28:0/2660444871 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e900c7d20 con 0x7f6e901472b0 2024-04-23T18:22:52.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e8a000640 1 -- 172.21.15.28:0/2660444871 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f6e80057700 con 0x7f6e901472b0 2024-04-23T18:22:52.904 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:52.904 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 -- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e74068380 msgr2=0x7f6e7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e74068380 0x7f6e7406a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e900c9fb0 tx=0x7f6e84009040 comp rx=0 tx=0).stop 2024-04-23T18:22:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 -- 172.21.15.28:0/2660444871 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e901472b0 msgr2=0x7f6e901f2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e901472b0 0x7f6e901f2660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e80011a00 tx=0x7f6e80011ec0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 -- 172.21.15.28:0/2660444871 shutdown_connections 2024-04-23T18:22:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e74068380 0x7f6e7406a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e901f2ba0 0x7f6e9013c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e901472b0 0x7f6e901f2660 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 --2- 172.21.15.28:0/2660444871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e78004d50 0x7f6e901ef330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 -- 172.21.15.28:0/2660444871 >> 172.21.15.28:0/2660444871 conn(0x7f6e9006d0a0 msgr2=0x7f6e9014b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 -- 172.21.15.28:0/2660444871 shutdown_connections 2024-04-23T18:22:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:52.909+0000 7f6e98800640 1 -- 172.21.15.28:0/2660444871 wait complete. 2024-04-23T18:22:52.925 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:53.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.069+0000 7fc66f800640 1 Processor -- start 2024-04-23T18:22:53.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.069+0000 7fc66f800640 1 -- start start 2024-04-23T18:22:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.069+0000 7fc66f800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc6680738c0 0x7fc6680c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.069+0000 7fc66f800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc6680b2310 0x7fc66815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.069+0000 7fc66f800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc668075970 con 0x7fc6680c79e0 2024-04-23T18:22:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.069+0000 7fc66f800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fc66806cbd0 con 0x7fc6680738c0 2024-04-23T18:22:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.069+0000 7fc66f800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc668155a70 con 0x7fc6680b2310 2024-04-23T18:22:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc66ce00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc6680738c0 0x7fc6680c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc66d800640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc6680c79e0 0x7fc6680c2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36480/0 (socket says 172.21.15.28:36480) 2024-04-23T18:22:53.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc66d800640 1 -- 172.21.15.28:0/643961543 learned_addr learned my addr 172.21.15.28:0/643961543 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:53.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc667e00640 1 --2- 172.21.15.28:0/643961543 >> v2:172.21.15.137:3300/0 conn(0x7fc6680b2310 0x7fc66815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc66ce00640 1 -- 172.21.15.28:0/643961543 >> v2:172.21.15.137:3300/0 conn(0x7fc6680b2310 msgr2=0x7fc66815b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:53.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc66ce00640 1 --2- 172.21.15.28:0/643961543 >> v2:172.21.15.137:3300/0 conn(0x7fc6680b2310 0x7fc66815b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc66ce00640 1 -- 172.21.15.28:0/643961543 >> v1:172.21.15.28:6789/0 conn(0x7fc6680c79e0 legacy=0x7fc6680c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:53.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc66ce00640 1 -- 172.21.15.28:0/643961543 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc668075c10 con 0x7fc6680738c0 2024-04-23T18:22:53.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc667400640 1 -- 172.21.15.28:0/643961543 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106103491 0 0) 0x7fc668075970 con 0x7fc6680c79e0 2024-04-23T18:22:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc66ce00640 1 --2- 172.21.15.28:0/643961543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6680738c0 0x7fc6680c9530 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc668069790 tx=0x7fc65c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74a9030235948b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc667400640 1 -- 172.21.15.28:0/643961543 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0b5070 con 0x7fc6680738c0 2024-04-23T18:22:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc667400640 1 -- 172.21.15.28:0/643961543 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65c0a8970 con 0x7fc6680738c0 2024-04-23T18:22:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.073+0000 7fc667400640 1 -- 172.21.15.28:0/643961543 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0a8d40 con 0x7fc6680738c0 2024-04-23T18:22:53.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 -- 172.21.15.28:0/643961543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6680738c0 msgr2=0x7fc6680c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:53.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 --2- 172.21.15.28:0/643961543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6680738c0 0x7fc6680c9530 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc668069790 tx=0x7fc65c01ec70 comp rx=0 tx=0).stop 2024-04-23T18:22:53.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 -- 172.21.15.28:0/643961543 shutdown_connections 2024-04-23T18:22:53.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 --2- 172.21.15.28:0/643961543 >> v2:172.21.15.137:3300/0 conn(0x7fc6680b2310 0x7fc66815b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 --2- 172.21.15.28:0/643961543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6680738c0 0x7fc6680c9530 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 -- 172.21.15.28:0/643961543 >> 172.21.15.28:0/643961543 conn(0x7fc6680ccfe0 msgr2=0x7fc6680cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:53.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 -- 172.21.15.28:0/643961543 shutdown_connections 2024-04-23T18:22:53.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 -- 172.21.15.28:0/643961543 wait complete. 2024-04-23T18:22:53.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 Processor -- start 2024-04-23T18:22:53.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 -- start start 2024-04-23T18:22:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6680738c0 0x7fc66814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6680b2310 0x7fc6681f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6680c79e0 0x7fc66815eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc6680c90a0 con 0x7fc6680738c0 2024-04-23T18:22:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6680c4240 con 0x7fc6680c79e0 2024-04-23T18:22:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc6680c2710 con 0x7fc6680b2310 2024-04-23T18:22:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66ce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6680738c0 0x7fc66814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66ce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6680738c0 0x7fc66814fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45692/0 (socket says 172.21.15.28:45692) 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66ce00640 1 -- 172.21.15.28:0/1291177193 learned_addr learned my addr 172.21.15.28:0/1291177193 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66d800640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6680c79e0 0x7fc66815eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc667e00640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6680b2310 0x7fc6681f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66ce00640 1 -- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6680b2310 msgr2=0x7fc6681f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66ce00640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6680b2310 0x7fc6681f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66ce00640 1 -- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6680c79e0 msgr2=0x7fc66815eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66ce00640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6680c79e0 0x7fc66815eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66ce00640 1 -- 172.21.15.28:0/1291177193 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6680b1db0 con 0x7fc6680738c0 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.077+0000 7fc66d800640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6680c79e0 0x7fc66815eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.081+0000 7fc66ce00640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6680738c0 0x7fc66814fe10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0b3040 tx=0x7fc65c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.081+0000 7fc664c00640 1 -- 172.21.15.28:0/1291177193 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0bf070 con 0x7fc6680738c0 2024-04-23T18:22:53.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.081+0000 7fc664c00640 1 -- 172.21.15.28:0/1291177193 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65c0b0740 con 0x7fc6680738c0 2024-04-23T18:22:53.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.081+0000 7fc664c00640 1 -- 172.21.15.28:0/1291177193 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0b5040 con 0x7fc6680738c0 2024-04-23T18:22:53.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.081+0000 7fc66f800640 1 -- 172.21.15.28:0/1291177193 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6681f1260 con 0x7fc6680738c0 2024-04-23T18:22:53.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.081+0000 7fc66f800640 1 -- 172.21.15.28:0/1291177193 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6681f3d30 con 0x7fc6680738c0 2024-04-23T18:22:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.081+0000 7fc66f800640 1 -- 172.21.15.28:0/1291177193 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc668068cd0 con 0x7fc6680738c0 2024-04-23T18:22:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.081+0000 7fc664c00640 1 -- 172.21.15.28:0/1291177193 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc65c0c2070 con 0x7fc6680738c0 2024-04-23T18:22:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.081+0000 7fc664c00640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc6480683b0 0x7fc64806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.081+0000 7fc664c00640 1 -- 172.21.15.28:0/1291177193 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc65c123520 con 0x7fc6680738c0 2024-04-23T18:22:53.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.081+0000 7fc667e00640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc6480683b0 0x7fc64806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.085+0000 7fc667e00640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc6480683b0 0x7fc64806a870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc6680746c0 tx=0x7fc654008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:53.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.085+0000 7fc664c00640 1 -- 172.21.15.28:0/1291177193 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc65c0187d0 con 0x7fc6680738c0 2024-04-23T18:22:53.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.253+0000 7fc66f800640 1 -- 172.21.15.28:0/1291177193 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc66806e980 con 0x7fc6680738c0 2024-04-23T18:22:53.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc664c00640 1 -- 172.21.15.28:0/1291177193 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fc65c0f3710 con 0x7fc6680738c0 2024-04-23T18:22:53.252 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:53.252 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:53.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 -- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc6480683b0 msgr2=0x7fc64806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:53.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc6480683b0 0x7fc64806a870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc6680746c0 tx=0x7fc654008040 comp rx=0 tx=0).stop 2024-04-23T18:22:53.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 -- 172.21.15.28:0/1291177193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6680738c0 msgr2=0x7fc66814fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:53.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6680738c0 0x7fc66814fe10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0b3040 tx=0x7fc65c01ba10 comp rx=0 tx=0).stop 2024-04-23T18:22:53.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 -- 172.21.15.28:0/1291177193 shutdown_connections 2024-04-23T18:22:53.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc6480683b0 0x7fc64806a870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6680b2310 0x7fc6681f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6680c79e0 0x7fc66815eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 --2- 172.21.15.28:0/1291177193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6680738c0 0x7fc66814fe10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 -- 172.21.15.28:0/1291177193 >> 172.21.15.28:0/1291177193 conn(0x7fc6680ccfe0 msgr2=0x7fc668072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:53.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 -- 172.21.15.28:0/1291177193 shutdown_connections 2024-04-23T18:22:53.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.257+0000 7fc66f800640 1 -- 172.21.15.28:0/1291177193 wait complete. 2024-04-23T18:22:53.273 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-23T18:22:53.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.421+0000 7ff0bd600640 1 Processor -- start 2024-04-23T18:22:53.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.421+0000 7ff0bd600640 1 -- start start 2024-04-23T18:22:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0bd600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff0b8073ad0 0x7ff0b80cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0bd600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff0b80cb8c0 0x7ff0b815ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0bd600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b806bb80 con 0x7ff0b81556b0 2024-04-23T18:22:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0bd600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b806c700 con 0x7ff0b8073ad0 2024-04-23T18:22:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0bd600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b806be60 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0afe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff0b8073ad0 0x7ff0b80cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0b6a00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff0b81556b0 0x7ff0b815bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36484/0 (socket says 172.21.15.28:36484) 2024-04-23T18:22:53.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0b6a00640 1 -- 172.21.15.28:0/2839444992 learned_addr learned my addr 172.21.15.28:0/2839444992 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:53.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0b7400640 1 --2- 172.21.15.28:0/2839444992 >> v2:172.21.15.137:3300/0 conn(0x7ff0b80cb8c0 0x7ff0b815ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0b6000640 1 -- 172.21.15.28:0/2839444992 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422795563 0 0) 0x7ff0b806bb80 con 0x7ff0b81556b0 2024-04-23T18:22:53.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0afe00640 1 -- 172.21.15.28:0/2839444992 >> v2:172.21.15.137:3300/0 conn(0x7ff0b80cb8c0 msgr2=0x7ff0b815ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:53.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0afe00640 1 --2- 172.21.15.28:0/2839444992 >> v2:172.21.15.137:3300/0 conn(0x7ff0b80cb8c0 0x7ff0b815ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0afe00640 1 -- 172.21.15.28:0/2839444992 >> v1:172.21.15.28:6789/0 conn(0x7ff0b81556b0 legacy=0x7ff0b815bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:53.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0afe00640 1 -- 172.21.15.28:0/2839444992 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b806c140 con 0x7ff0b8073ad0 2024-04-23T18:22:53.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0b7400640 1 --2- 172.21.15.28:0/2839444992 >> v2:172.21.15.137:3300/0 conn(0x7ff0b80cb8c0 0x7ff0b815ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:53.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.425+0000 7ff0afe00640 1 --2- 172.21.15.28:0/2839444992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0b8073ad0 0x7ff0b80cb380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8070150 tx=0x7ff0a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9133bd92f2f965fa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:53.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0b6000640 1 -- 172.21.15.28:0/2839444992 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00b0070 con 0x7ff0b8073ad0 2024-04-23T18:22:53.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0b6000640 1 -- 172.21.15.28:0/2839444992 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a00ab600 con 0x7ff0b8073ad0 2024-04-23T18:22:53.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0b6000640 1 -- 172.21.15.28:0/2839444992 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00ab9d0 con 0x7ff0b8073ad0 2024-04-23T18:22:53.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 -- 172.21.15.28:0/2839444992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0b8073ad0 msgr2=0x7ff0b80cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:53.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 --2- 172.21.15.28:0/2839444992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0b8073ad0 0x7ff0b80cb380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8070150 tx=0x7ff0a001c480 comp rx=0 tx=0).stop 2024-04-23T18:22:53.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 -- 172.21.15.28:0/2839444992 shutdown_connections 2024-04-23T18:22:53.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 --2- 172.21.15.28:0/2839444992 >> v2:172.21.15.137:3300/0 conn(0x7ff0b80cb8c0 0x7ff0b815ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 --2- 172.21.15.28:0/2839444992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0b8073ad0 0x7ff0b80cb380 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 -- 172.21.15.28:0/2839444992 >> 172.21.15.28:0/2839444992 conn(0x7ff0b80676e0 msgr2=0x7ff0b8067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:53.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 -- 172.21.15.28:0/2839444992 shutdown_connections 2024-04-23T18:22:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 -- 172.21.15.28:0/2839444992 wait complete. 2024-04-23T18:22:53.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 Processor -- start 2024-04-23T18:22:53.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 -- start start 2024-04-23T18:22:53.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0b8073ad0 0x7ff0b8155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0b80cb8c0 0x7ff0b815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0b81556b0 0x7ff0b814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b8168440 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b81682c0 con 0x7ff0b81556b0 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.429+0000 7ff0bd600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b81685c0 con 0x7ff0b8073ad0 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0afe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0b80cb8c0 0x7ff0b815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0afe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0b80cb8c0 0x7ff0b815dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45714/0 (socket says 172.21.15.28:45714) 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0afe00640 1 -- 172.21.15.28:0/3378758910 learned_addr learned my addr 172.21.15.28:0/3378758910 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0b6a00640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0b8073ad0 0x7ff0b8155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0b7400640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0b81556b0 0x7ff0b814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0afe00640 1 -- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0b8073ad0 msgr2=0x7ff0b8155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0afe00640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0b8073ad0 0x7ff0b8155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0afe00640 1 -- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0b81556b0 msgr2=0x7ff0b814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0afe00640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0b81556b0 0x7ff0b814ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0afe00640 1 -- 172.21.15.28:0/3378758910 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b8156400 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0b7400640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0b81556b0 0x7ff0b814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:53.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0afe00640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0b80cb8c0 0x7ff0b815dd40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff0a001a0b0 tx=0x7ff0a001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:53.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0aea00640 1 -- 172.21.15.28:0/3378758910 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00b0050 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0aea00640 1 -- 172.21.15.28:0/3378758910 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a00b1040 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0aea00640 1 -- 172.21.15.28:0/3378758910 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0004220 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0bd600640 1 -- 172.21.15.28:0/3378758910 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b81ed6a0 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0bd600640 1 -- 172.21.15.28:0/3378758910 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b81edc60 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0bd600640 1 -- 172.21.15.28:0/3378758910 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b8068db0 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.433+0000 7ff0aea00640 1 -- 172.21.15.28:0/3378758910 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff0a00be060 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.437+0000 7ff0aea00640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff094068380 0x7ff09406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.437+0000 7ff0aea00640 1 -- 172.21.15.28:0/3378758910 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff0a01206a0 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.437+0000 7ff0b6a00640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff094068380 0x7ff09406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.437+0000 7ff0b6a00640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff094068380 0x7ff09406a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8007fd0 tx=0x7ff0a8007d60 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:53.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.441+0000 7ff0aea00640 1 -- 172.21.15.28:0/3378758910 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff0a0016070 con 0x7ff0b80cb8c0 2024-04-23T18:22:53.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:53.641+0000 7ff0bd600640 1 -- 172.21.15.28:0/3378758910 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff0b80c8dc0 con 0x7ff0b80cb8c0 2024-04-23T18:22:54.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0aea00640 1 -- 172.21.15.28:0/3378758910 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7ff0a00f0880 con 0x7ff0b80cb8c0 2024-04-23T18:22:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 -- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff094068380 msgr2=0x7ff09406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff094068380 0x7ff09406a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8007fd0 tx=0x7ff0a8007d60 comp rx=0 tx=0).stop 2024-04-23T18:22:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 -- 172.21.15.28:0/3378758910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0b80cb8c0 msgr2=0x7ff0b815dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0b80cb8c0 0x7ff0b815dd40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff0a001a0b0 tx=0x7ff0a001acc0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 -- 172.21.15.28:0/3378758910 shutdown_connections 2024-04-23T18:22:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff094068380 0x7ff09406a840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0b81556b0 0x7ff0b814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0b80cb8c0 0x7ff0b815dd40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 --2- 172.21.15.28:0/3378758910 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0b8073ad0 0x7ff0b8155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 -- 172.21.15.28:0/3378758910 >> 172.21.15.28:0/3378758910 conn(0x7ff0b80676e0 msgr2=0x7ff0b81527a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 -- 172.21.15.28:0/3378758910 shutdown_connections 2024-04-23T18:22:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.457+0000 7ff0bd600640 1 -- 172.21.15.28:0/3378758910 wait complete. 2024-04-23T18:22:54.477 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-04-23T18:22:54.477 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-23T18:22:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.628+0000 7f091da00640 1 Processor -- start 2024-04-23T18:22:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.628+0000 7f091da00640 1 -- start start 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.628+0000 7f091da00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0918154ee0 0x7f09180713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.628+0000 7f091da00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0918070ec0 0x7f091806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.628+0000 7f091da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f091806bf20 0x7f09180ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.628+0000 7f091da00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f091815b320 con 0x7f0918070ec0 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.628+0000 7f091da00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f091815b600 con 0x7f0918154ee0 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.628+0000 7f091da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f091815b8e0 con 0x7f091806bf20 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f090f400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0918070ec0 0x7f091806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f090f400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0918070ec0 0x7f091806b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45724/0 (socket says 172.21.15.28:45724) 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f090f400640 1 -- 172.21.15.28:0/720793433 learned_addr learned my addr 172.21.15.28:0/720793433 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f0917e00640 1 --2- 172.21.15.28:0/720793433 >> v2:172.21.15.137:3300/0 conn(0x7f0918154ee0 0x7f09180713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f091d000640 1 --2- 172.21.15.28:0/720793433 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f091806bf20 0x7f09180ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f090f400640 1 -- 172.21.15.28:0/720793433 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f091806bf20 msgr2=0x7f09180ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f090f400640 1 --2- 172.21.15.28:0/720793433 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f091806bf20 0x7f09180ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f090f400640 1 -- 172.21.15.28:0/720793433 >> v2:172.21.15.137:3300/0 conn(0x7f0918154ee0 msgr2=0x7f09180713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f090f400640 1 --2- 172.21.15.28:0/720793433 >> v2:172.21.15.137:3300/0 conn(0x7f0918154ee0 0x7f09180713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f090f400640 1 -- 172.21.15.28:0/720793433 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091815bbc0 con 0x7f0918070ec0 2024-04-23T18:22:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f090f400640 1 --2- 172.21.15.28:0/720793433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0918070ec0 0x7f091806b9e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f09180728d0 tx=0x7f090001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7528c2f7b98f041c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f0917400640 1 -- 172.21.15.28:0/720793433 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09000b5070 con 0x7f0918070ec0 2024-04-23T18:22:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f0917400640 1 -- 172.21.15.28:0/720793433 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09000a89d0 con 0x7f0918070ec0 2024-04-23T18:22:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.632+0000 7f0917400640 1 -- 172.21.15.28:0/720793433 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09000a8da0 con 0x7f0918070ec0 2024-04-23T18:22:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 -- 172.21.15.28:0/720793433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0918070ec0 msgr2=0x7f091806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 --2- 172.21.15.28:0/720793433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0918070ec0 0x7f091806b9e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f09180728d0 tx=0x7f090001ed10 comp rx=0 tx=0).stop 2024-04-23T18:22:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 -- 172.21.15.28:0/720793433 shutdown_connections 2024-04-23T18:22:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 --2- 172.21.15.28:0/720793433 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f091806bf20 0x7f09180ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 --2- 172.21.15.28:0/720793433 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0918070ec0 0x7f091806b9e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 --2- 172.21.15.28:0/720793433 >> v2:172.21.15.137:3300/0 conn(0x7f0918154ee0 0x7f09180713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 -- 172.21.15.28:0/720793433 >> 172.21.15.28:0/720793433 conn(0x7f09180ce5e0 msgr2=0x7f09180ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 -- 172.21.15.28:0/720793433 shutdown_connections 2024-04-23T18:22:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 -- 172.21.15.28:0/720793433 wait complete. 2024-04-23T18:22:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 Processor -- start 2024-04-23T18:22:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 -- start start 2024-04-23T18:22:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f091806bf20 0x7f09180cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0918070ec0 0x7f09180cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0918154ee0 0x7f091814a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0918155440 con 0x7f091806bf20 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09181552c0 con 0x7f0918070ec0 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091da00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f091815af00 con 0x7f0918154ee0 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f0917e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f091806bf20 0x7f09180cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f0917e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f091806bf20 0x7f09180cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45734/0 (socket says 172.21.15.28:45734) 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f0917e00640 1 -- 172.21.15.28:0/1287533677 learned_addr learned my addr 172.21.15.28:0/1287533677 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f091d000640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0918154ee0 0x7f091814a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f090f400640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0918070ec0 0x7f09180cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f0917e00640 1 -- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0918154ee0 msgr2=0x7f091814a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f0917e00640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0918154ee0 0x7f091814a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f0917e00640 1 -- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0918070ec0 msgr2=0x7f09180cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f0917e00640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0918070ec0 0x7f09180cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f0917e00640 1 -- 172.21.15.28:0/1287533677 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0918154290 con 0x7f091806bf20 2024-04-23T18:22:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.636+0000 7f0917e00640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f091806bf20 0x7f09180cd2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f090800d5f0 tx=0x7f090800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:54.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.640+0000 7f0914c00640 1 -- 172.21.15.28:0/1287533677 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09080125f0 con 0x7f091806bf20 2024-04-23T18:22:54.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.640+0000 7f0914c00640 1 -- 172.21.15.28:0/1287533677 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0908019070 con 0x7f091806bf20 2024-04-23T18:22:54.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.640+0000 7f091da00640 1 -- 172.21.15.28:0/1287533677 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09180ce040 con 0x7f091806bf20 2024-04-23T18:22:54.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.640+0000 7f0914c00640 1 -- 172.21.15.28:0/1287533677 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09080129b0 con 0x7f091806bf20 2024-04-23T18:22:54.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.640+0000 7f091da00640 1 -- 172.21.15.28:0/1287533677 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0918149a20 con 0x7f091806bf20 2024-04-23T18:22:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.640+0000 7f091da00640 1 -- 172.21.15.28:0/1287533677 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0918068cd0 con 0x7f091806bf20 2024-04-23T18:22:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.640+0000 7f0914c00640 1 -- 172.21.15.28:0/1287533677 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0908012b50 con 0x7f091806bf20 2024-04-23T18:22:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.640+0000 7f0914c00640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08f40683b0 0x7f08f406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.640+0000 7f0914c00640 1 -- 172.21.15.28:0/1287533677 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0908087100 con 0x7f091806bf20 2024-04-23T18:22:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.640+0000 7f090f400640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08f40683b0 0x7f08f406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.644+0000 7f090f400640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08f40683b0 0x7f08f406a870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09000b2000 tx=0x7f0900008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:54.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.644+0000 7f0914c00640 1 -- 172.21.15.28:0/1287533677 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0908057370 con 0x7f091806bf20 2024-04-23T18:22:54.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:54.844+0000 7f091da00640 1 -- 172.21.15.28:0/1287533677 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f09181528b0 con 0x7f091806bf20 2024-04-23T18:22:55.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.472+0000 7f0914c00640 1 -- 172.21.15.28:0/1287533677 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) ==== 105+0+0 (secure 0 0 0) 0x7f090805d030 con 0x7f091806bf20 2024-04-23T18:22:55.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 -- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08f40683b0 msgr2=0x7f08f406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:55.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08f40683b0 0x7f08f406a870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09000b2000 tx=0x7f0900008040 comp rx=0 tx=0).stop 2024-04-23T18:22:55.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 -- 172.21.15.28:0/1287533677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f091806bf20 msgr2=0x7f09180cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:55.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f091806bf20 0x7f09180cd2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f090800d5f0 tx=0x7f090800dab0 comp rx=0 tx=0).stop 2024-04-23T18:22:55.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 -- 172.21.15.28:0/1287533677 shutdown_connections 2024-04-23T18:22:55.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08f40683b0 0x7f08f406a870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:55.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0918154ee0 0x7f091814a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:55.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0918070ec0 0x7f09180cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:55.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 --2- 172.21.15.28:0/1287533677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f091806bf20 0x7f09180cd2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:55.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 -- 172.21.15.28:0/1287533677 >> 172.21.15.28:0/1287533677 conn(0x7f09180ce5e0 msgr2=0x7f0918073520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:55.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 -- 172.21.15.28:0/1287533677 shutdown_connections 2024-04-23T18:22:55.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.476+0000 7f091da00640 1 -- 172.21.15.28:0/1287533677 wait complete. 2024-04-23T18:22:55.495 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-23T18:22:55.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f4400640 1 Processor -- start 2024-04-23T18:22:55.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f4400640 1 -- start start 2024-04-23T18:22:55.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f4400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f90ec0c9e50 0x7f90ec158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:55.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f4400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ec073520 con 0x7f90ec073050 2024-04-23T18:22:55.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f4400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ec0737e0 con 0x7f90ec14f8d0 2024-04-23T18:22:55.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f4400640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f90ec073da0 con 0x7f90ec0c9e50 2024-04-23T18:22:55.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f2400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f90ec0c9e50 0x7f90ec158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:55.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f1000640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f90ec073050 0x7f90ec161850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36488/0 (socket says 172.21.15.28:36488) 2024-04-23T18:22:55.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f2400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f90ec0c9e50 0x7f90ec158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45736/0 (socket says 172.21.15.28:45736) 2024-04-23T18:22:55.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f1000640 1 -- 172.21.15.28:0/3941416864 learned_addr learned my addr 172.21.15.28:0/3941416864 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:55.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f2400640 1 -- 172.21.15.28:0/3941416864 >> v1:172.21.15.137:6789/0 conn(0x7f90ec14f8d0 legacy=0x7f90ec0c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:55.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f2400640 1 -- 172.21.15.28:0/3941416864 >> v1:172.21.15.28:6789/0 conn(0x7f90ec073050 legacy=0x7f90ec161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:55.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90f2400640 1 -- 172.21.15.28:0/3941416864 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec073ac0 con 0x7f90ec0c9e50 2024-04-23T18:22:55.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.644+0000 7f90ebe00640 1 -- 172.21.15.28:0/3941416864 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3430570843 0 0) 0x7f90ec073520 con 0x7f90ec073050 2024-04-23T18:22:55.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.648+0000 7f90f2400640 1 --2- 172.21.15.28:0/3941416864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90ec0c9e50 0x7f90ec158ee0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009d90 tx=0x7f90e401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a9e81514e12320 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.648+0000 7f90ebe00640 1 -- 172.21.15.28:0/3941416864 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e40b2070 con 0x7f90ec0c9e50 2024-04-23T18:22:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.648+0000 7f90ebe00640 1 -- 172.21.15.28:0/3941416864 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e40a5900 con 0x7f90ec0c9e50 2024-04-23T18:22:55.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.648+0000 7f90ebe00640 1 -- 172.21.15.28:0/3941416864 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e40a5cd0 con 0x7f90ec0c9e50 2024-04-23T18:22:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.648+0000 7f90f4400640 1 -- 172.21.15.28:0/3941416864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90ec0c9e50 msgr2=0x7f90ec158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.648+0000 7f90f4400640 1 --2- 172.21.15.28:0/3941416864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90ec0c9e50 0x7f90ec158ee0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009d90 tx=0x7f90e401c820 comp rx=0 tx=0).stop 2024-04-23T18:22:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.648+0000 7f90f4400640 1 -- 172.21.15.28:0/3941416864 shutdown_connections 2024-04-23T18:22:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.648+0000 7f90f4400640 1 --2- 172.21.15.28:0/3941416864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90ec0c9e50 0x7f90ec158ee0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.648+0000 7f90f4400640 1 -- 172.21.15.28:0/3941416864 >> 172.21.15.28:0/3941416864 conn(0x7f90ec0c9330 msgr2=0x7f90ec0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.648+0000 7f90f4400640 1 -- 172.21.15.28:0/3941416864 shutdown_connections 2024-04-23T18:22:55.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.648+0000 7f90f4400640 1 -- 172.21.15.28:0/3941416864 wait complete. 2024-04-23T18:22:55.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f4400640 1 Processor -- start 2024-04-23T18:22:55.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f4400640 1 -- start start 2024-04-23T18:22:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f4400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90ec073050 0x7f90ec1f7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f4400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ec0c9e50 0x7f90ec158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f4400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90ec14f8d0 0x7f90ec06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f4400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec14fcb0 con 0x7f90ec14f8d0 2024-04-23T18:22:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f4400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec153580 con 0x7f90ec0c9e50 2024-04-23T18:22:55.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f4400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f90ec0c7940 con 0x7f90ec073050 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f2400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90ec14f8d0 0x7f90ec06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f2400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90ec14f8d0 0x7f90ec06ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45752/0 (socket says 172.21.15.28:45752) 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f2400640 1 -- 172.21.15.28:0/3017721710 learned_addr learned my addr 172.21.15.28:0/3017721710 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f1a00640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90ec073050 0x7f90ec1f7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f1000640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ec0c9e50 0x7f90ec158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f2400640 1 -- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90ec073050 msgr2=0x7f90ec1f7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f2400640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90ec073050 0x7f90ec1f7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f2400640 1 -- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ec0c9e50 msgr2=0x7f90ec158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f2400640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ec0c9e50 0x7f90ec158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f2400640 1 -- 172.21.15.28:0/3017721710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec153300 con 0x7f90ec14f8d0 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f1000640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ec0c9e50 0x7f90ec158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f2400640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90ec14f8d0 0x7f90ec06ee00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f90e401a450 tx=0x7f90e40195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90e9600640 1 -- 172.21.15.28:0/3017721710 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e40b2050 con 0x7f90ec14f8d0 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90e9600640 1 -- 172.21.15.28:0/3017721710 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e40be070 con 0x7f90ec14f8d0 2024-04-23T18:22:55.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f4400640 1 -- 172.21.15.28:0/3017721710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ec1f8170 con 0x7f90ec14f8d0 2024-04-23T18:22:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90e9600640 1 -- 172.21.15.28:0/3017721710 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e40ada50 con 0x7f90ec14f8d0 2024-04-23T18:22:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.652+0000 7f90f4400640 1 -- 172.21.15.28:0/3017721710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ec1f8730 con 0x7f90ec14f8d0 2024-04-23T18:22:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.656+0000 7f90f4400640 1 -- 172.21.15.28:0/3017721710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ec068db0 con 0x7f90ec14f8d0 2024-04-23T18:22:55.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.656+0000 7f90e9600640 1 -- 172.21.15.28:0/3017721710 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f90e40adbf0 con 0x7f90ec14f8d0 2024-04-23T18:22:55.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.656+0000 7f90e9600640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90cc0683b0 0x7f90cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:55.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.656+0000 7f90e9600640 1 -- 172.21.15.28:0/3017721710 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f90e4121870 con 0x7f90ec14f8d0 2024-04-23T18:22:55.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.656+0000 7f90f1a00640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90cc0683b0 0x7f90cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:55.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.656+0000 7f90f1a00640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90cc0683b0 0x7f90cc06a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f90e0007fd0 tx=0x7f90e0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:55.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.660+0000 7f90e9600640 1 -- 172.21.15.28:0/3017721710 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f90e40c7020 con 0x7f90ec14f8d0 2024-04-23T18:22:55.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:55.860+0000 7f90f4400640 1 -- 172.21.15.28:0/3017721710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f90ec164d60 con 0x7f90ec14f8d0 2024-04-23T18:22:56.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.484+0000 7f90e9600640 1 -- 172.21.15.28:0/3017721710 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f90e4016560 con 0x7f90ec14f8d0 2024-04-23T18:22:56.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 -- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90cc0683b0 msgr2=0x7f90cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:56.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90cc0683b0 0x7f90cc06a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f90e0007fd0 tx=0x7f90e0009040 comp rx=0 tx=0).stop 2024-04-23T18:22:56.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 -- 172.21.15.28:0/3017721710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90ec14f8d0 msgr2=0x7f90ec06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:56.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90ec14f8d0 0x7f90ec06ee00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f90e401a450 tx=0x7f90e40195c0 comp rx=0 tx=0).stop 2024-04-23T18:22:56.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 -- 172.21.15.28:0/3017721710 shutdown_connections 2024-04-23T18:22:56.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90cc0683b0 0x7f90cc06a870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:56.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90ec14f8d0 0x7f90ec06ee00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:56.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90ec0c9e50 0x7f90ec158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:56.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 --2- 172.21.15.28:0/3017721710 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90ec073050 0x7f90ec1f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:56.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 -- 172.21.15.28:0/3017721710 >> 172.21.15.28:0/3017721710 conn(0x7f90ec0c9330 msgr2=0x7f90ec0c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:56.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 -- 172.21.15.28:0/3017721710 shutdown_connections 2024-04-23T18:22:56.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.488+0000 7f90f4400640 1 -- 172.21.15.28:0/3017721710 wait complete. 2024-04-23T18:22:56.508 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-23T18:22:56.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.656+0000 7fb4eda00640 1 Processor -- start 2024-04-23T18:22:56.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.656+0000 7fb4eda00640 1 -- start start 2024-04-23T18:22:56.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4eda00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e80c8b70 0x7fb4e8159530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:56.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4eda00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e8073db0 con 0x7fb4e8159a70 2024-04-23T18:22:56.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4eda00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e80c5df0 con 0x7fb4e8152f80 2024-04-23T18:22:56.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4eda00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e815c3f0 con 0x7fb4e80c8b70 2024-04-23T18:22:56.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e7400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb4e8159a70 0x7fb4e80c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36496/0 (socket says 172.21.15.28:36496) 2024-04-23T18:22:56.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e7400640 1 -- 172.21.15.28:0/1497352265 learned_addr learned my addr 172.21.15.28:0/1497352265 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:56.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4de000640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e80c8b70 0x7fb4e8159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:56.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192919056 0 0) 0x7fb4e00014a0 con 0x7fb4e8159a70 2024-04-23T18:22:56.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4cc003530 con 0x7fb4e8159a70 2024-04-23T18:22:56.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4153274367 0 0) 0x7fb4cc003530 con 0x7fb4e8159a70 2024-04-23T18:22:56.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e80c8b70 msgr2=0x7fb4e8159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:56.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e80c8b70 0x7fb4e8159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:56.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 >> v1:172.21.15.137:6789/0 conn(0x7fb4e8152f80 legacy=0x7fb4e80736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:56.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e80c6090 con 0x7fb4e8159a70 2024-04-23T18:22:56.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7fb4e0001bd0 con 0x7fb4e8159a70 2024-04-23T18:22:56.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 >> v1:172.21.15.28:6789/0 conn(0x7fb4e8159a70 legacy=0x7fb4e80c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:56.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 0x7fb4cc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:56.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e80c8b70 0x7fb4cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:56.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4cc004d50 0x7fb4cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:56.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc00ba80 con 0x7fb4cc0039f0 2024-04-23T18:22:56.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc00bc00 con 0x7fb4cc004d50 2024-04-23T18:22:56.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb4cc00bd80 con 0x7fb4e80c8b70 2024-04-23T18:22:56.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6a00640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 0x7fb4cc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e7400640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4cc004d50 0x7fb4cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4de000640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e80c8b70 0x7fb4cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6a00640 1 -- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e80c8b70 msgr2=0x7fb4cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6a00640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e80c8b70 0x7fb4cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6a00640 1 -- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4cc004d50 msgr2=0x7fb4cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6a00640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4cc004d50 0x7fb4cc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e6a00640 1 -- 172.21.15.28:0/1497352265 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc003530 con 0x7fb4cc0039f0 2024-04-23T18:22:56.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.660+0000 7fb4e7400640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4cc004d50 0x7fb4cc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:56.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.664+0000 7fb4e6a00640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 0x7fb4cc003df0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8001860 tx=0x7fb4d801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77651325bc05bdb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:56.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.664+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80b5070 con 0x7fb4cc0039f0 2024-04-23T18:22:56.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.664+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d80a88b0 con 0x7fb4cc0039f0 2024-04-23T18:22:56.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.664+0000 7fb4e6000640 1 -- 172.21.15.28:0/1497352265 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8001460 con 0x7fb4cc0039f0 2024-04-23T18:22:56.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.664+0000 7fb4eda00640 1 -- 172.21.15.28:0/1497352265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 msgr2=0x7fb4cc003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:56.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.664+0000 7fb4eda00640 1 --2- 172.21.15.28:0/1497352265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 0x7fb4cc003df0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8001860 tx=0x7fb4d801ec90 comp rx=0 tx=0).stop 2024-04-23T18:22:56.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.664+0000 7fb4e7400640 1 -- 172.21.15.28:0/1497352265 reap_dead start 2024-04-23T18:22:56.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.664+0000 7fb4eda00640 1 -- 172.21.15.28:0/1497352265 shutdown_connections 2024-04-23T18:22:56.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.664+0000 7fb4eda00640 1 -- 172.21.15.28:0/1497352265 >> 172.21.15.28:0/1497352265 conn(0x7fb4e80676e0 msgr2=0x7fb4e8067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:56.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.664+0000 7fb4eda00640 1 -- 172.21.15.28:0/1497352265 shutdown_connections 2024-04-23T18:22:56.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.664+0000 7fb4eda00640 1 -- 172.21.15.28:0/1497352265 wait complete. 2024-04-23T18:22:56.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4eda00640 1 Processor -- start 2024-04-23T18:22:56.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4eda00640 1 -- start start 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4eda00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 0x7fb4e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4eda00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4e806cd70 0x7fb4e81518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4eda00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e814d940 0x7fb4e814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4eda00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e80c6650 con 0x7fb4cc0039f0 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4eda00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e81590a0 con 0x7fb4e806cd70 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4eda00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e80c6930 con 0x7fb4e814d940 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4e6a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 0x7fb4e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4e6a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 0x7fb4e806c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45772/0 (socket says 172.21.15.28:45772) 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4e6a00640 1 -- 172.21.15.28:0/120931826 learned_addr learned my addr 172.21.15.28:0/120931826 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4de000640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4e806cd70 0x7fb4e81518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4e7400640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e814d940 0x7fb4e814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4e6a00640 1 -- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e814d940 msgr2=0x7fb4e814ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4e6a00640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e814d940 0x7fb4e814ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4e6a00640 1 -- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4e806cd70 msgr2=0x7fb4e81518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:56.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4e6a00640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4e806cd70 0x7fb4e81518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:56.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4e6a00640 1 -- 172.21.15.28:0/120931826 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e814e300 con 0x7fb4cc0039f0 2024-04-23T18:22:56.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4e6a00640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 0x7fb4e806c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8001860 tx=0x7fb4cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:56.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4df400640 1 -- 172.21.15.28:0/120931826 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80c1070 con 0x7fb4cc0039f0 2024-04-23T18:22:56.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4df400640 1 -- 172.21.15.28:0/120931826 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d8005270 con 0x7fb4cc0039f0 2024-04-23T18:22:56.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4df400640 1 -- 172.21.15.28:0/120931826 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80b5040 con 0x7fb4cc0039f0 2024-04-23T18:22:56.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4eda00640 1 -- 172.21.15.28:0/120931826 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e814d3b0 con 0x7fb4cc0039f0 2024-04-23T18:22:56.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4eda00640 1 -- 172.21.15.28:0/120931826 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e814ca80 con 0x7fb4cc0039f0 2024-04-23T18:22:56.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.668+0000 7fb4eda00640 1 -- 172.21.15.28:0/120931826 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e8068db0 con 0x7fb4cc0039f0 2024-04-23T18:22:56.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.672+0000 7fb4df400640 1 -- 172.21.15.28:0/120931826 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb4d80c4070 con 0x7fb4cc0039f0 2024-04-23T18:22:56.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.672+0000 7fb4df400640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb4c4068380 0x7fb4c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:56.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.672+0000 7fb4df400640 1 -- 172.21.15.28:0/120931826 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb4d8123730 con 0x7fb4cc0039f0 2024-04-23T18:22:56.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.672+0000 7fb4de000640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb4c4068380 0x7fb4c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:56.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.672+0000 7fb4de000640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb4c4068380 0x7fb4c406a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4e81ee850 tx=0x7fb4d0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:56.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.676+0000 7fb4df400640 1 -- 172.21.15.28:0/120931826 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb4e814e300 con 0x7fb4cc0039f0 2024-04-23T18:22:56.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:56.876+0000 7fb4eda00640 1 -- 172.21.15.28:0/120931826 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fb4e8156a50 con 0x7fb4cc0039f0 2024-04-23T18:22:57.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.496+0000 7fb4df400640 1 -- 172.21.15.28:0/120931826 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7fb4d80189a0 con 0x7fb4cc0039f0 2024-04-23T18:22:57.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.496+0000 7fb4eda00640 1 -- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb4c4068380 msgr2=0x7fb4c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:57.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.496+0000 7fb4eda00640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb4c4068380 0x7fb4c406a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4e81ee850 tx=0x7fb4d0008040 comp rx=0 tx=0).stop 2024-04-23T18:22:57.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.496+0000 7fb4eda00640 1 -- 172.21.15.28:0/120931826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 msgr2=0x7fb4e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:57.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.496+0000 7fb4eda00640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 0x7fb4e806c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8001860 tx=0x7fb4cc005840 comp rx=0 tx=0).stop 2024-04-23T18:22:57.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.500+0000 7fb4eda00640 1 -- 172.21.15.28:0/120931826 shutdown_connections 2024-04-23T18:22:57.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.500+0000 7fb4eda00640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb4c4068380 0x7fb4c406a840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.500+0000 7fb4eda00640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb4e814d940 0x7fb4e814ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.500+0000 7fb4eda00640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb4e806cd70 0x7fb4e81518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.500+0000 7fb4eda00640 1 --2- 172.21.15.28:0/120931826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb4cc0039f0 0x7fb4e806c5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.500+0000 7fb4eda00640 1 -- 172.21.15.28:0/120931826 >> 172.21.15.28:0/120931826 conn(0x7fb4e80676e0 msgr2=0x7fb4e80c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:57.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.500+0000 7fb4eda00640 1 -- 172.21.15.28:0/120931826 shutdown_connections 2024-04-23T18:22:57.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.500+0000 7fb4eda00640 1 -- 172.21.15.28:0/120931826 wait complete. 2024-04-23T18:22:57.519 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-23T18:22:57.519 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:22:57.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f2396200640 1 Processor -- start 2024-04-23T18:22:57.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f2396200640 1 -- start start 2024-04-23T18:22:57.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f2396200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2390155290 0x7f23900cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:57.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f2396200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239015e810 con 0x7f23900b5950 2024-04-23T18:22:57.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f2396200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239015eab0 con 0x7f23900cc000 2024-04-23T18:22:57.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f2396200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f23900b4db0 con 0x7f2390155290 2024-04-23T18:22:57.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238fe00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f23900b5950 0x7f23900cd230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36512/0 (socket says 172.21.15.28:36512) 2024-04-23T18:22:57.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238fe00640 1 -- 172.21.15.28:0/1101027772 learned_addr learned my addr 172.21.15.28:0/1101027772 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238f400640 1 --2- 172.21.15.28:0/1101027772 >> v2:172.21.15.137:3300/0 conn(0x7f2390155290 0x7f23900cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3952666611 0 0) 0x7f239015e810 con 0x7f23900b5950 2024-04-23T18:22:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2374003530 con 0x7f23900b5950 2024-04-23T18:22:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1496359731 0 0) 0x7f2374003530 con 0x7f23900b5950 2024-04-23T18:22:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 >> v2:172.21.15.137:3300/0 conn(0x7f2390155290 msgr2=0x7f23900cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:57.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 --2- 172.21.15.28:0/1101027772 >> v2:172.21.15.137:3300/0 conn(0x7f2390155290 0x7f23900cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 >> v1:172.21.15.137:6789/0 conn(0x7f23900cc000 legacy=0x7f23900b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:57.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239015ed90 con 0x7f23900b5950 2024-04-23T18:22:57.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f2388001a00 con 0x7f23900b5950 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 >> v1:172.21.15.28:6789/0 conn(0x7f23900b5950 legacy=0x7f23900cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23740039c0 0x7f2374003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2374004810 0x7f2374004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23740051d0 0x7f237400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f23900b4db0 con 0x7f2374004810 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f237400c070 con 0x7f23740051d0 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f237400c270 con 0x7f23740039c0 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238ea00640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2374004810 0x7f2374004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238fe00640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23740051d0 0x7f237400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238f400640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23740039c0 0x7f2374003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238ea00640 1 -- 172.21.15.28:0/1101027772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23740039c0 msgr2=0x7f2374003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238ea00640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f23740039c0 0x7f2374003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238ea00640 1 -- 172.21.15.28:0/1101027772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23740051d0 msgr2=0x7f237400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238ea00640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23740051d0 0x7f237400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238ea00640 1 -- 172.21.15.28:0/1101027772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2374003530 con 0x7f2374004810 2024-04-23T18:22:57.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238fe00640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23740051d0 0x7f237400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:57.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.668+0000 7f238fe00640 1 -- 172.21.15.28:0/1101027772 reap_dead start 2024-04-23T18:22:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.672+0000 7f238ea00640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2374004810 0x7f2374004c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f237c001780 tx=0x7f237c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c288cdeebcefea79 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.672+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c0013a0 con 0x7f2374004810 2024-04-23T18:22:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.672+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237c0052f0 con 0x7f2374004810 2024-04-23T18:22:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.672+0000 7f238e000640 1 -- 172.21.15.28:0/1101027772 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c003840 con 0x7f2374004810 2024-04-23T18:22:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.672+0000 7f2396200640 1 -- 172.21.15.28:0/1101027772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2374004810 msgr2=0x7f2374004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.672+0000 7f2396200640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2374004810 0x7f2374004c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f237c001780 tx=0x7f237c01c400 comp rx=0 tx=0).stop 2024-04-23T18:22:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.672+0000 7f2396200640 1 -- 172.21.15.28:0/1101027772 shutdown_connections 2024-04-23T18:22:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.672+0000 7f2396200640 1 --2- 172.21.15.28:0/1101027772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2374004810 0x7f2374004c90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.672+0000 7f2396200640 1 -- 172.21.15.28:0/1101027772 >> 172.21.15.28:0/1101027772 conn(0x7f2390075dd0 msgr2=0x7f23900676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.672+0000 7f2396200640 1 -- 172.21.15.28:0/1101027772 shutdown_connections 2024-04-23T18:22:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.672+0000 7f2396200640 1 -- 172.21.15.28:0/1101027772 wait complete. 2024-04-23T18:22:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2396200640 1 Processor -- start 2024-04-23T18:22:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2396200640 1 -- start start 2024-04-23T18:22:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2396200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2374004810 0x7f23900c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2396200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2390150620 0x7f239014fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2396200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f239015d770 0x7f239015dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2396200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f239015f630 con 0x7f239015d770 2024-04-23T18:22:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2396200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f239015f350 con 0x7f2390150620 2024-04-23T18:22:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2396200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2390155670 con 0x7f2374004810 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238fe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f239015d770 0x7f239015dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238fe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f239015d770 0x7f239015dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45782/0 (socket says 172.21.15.28:45782) 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238fe00640 1 -- 172.21.15.28:0/254481822 learned_addr learned my addr 172.21.15.28:0/254481822 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238ea00640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2390150620 0x7f239014fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238f400640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2374004810 0x7f23900c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238fe00640 1 -- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2374004810 msgr2=0x7f23900c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238fe00640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2374004810 0x7f23900c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238fe00640 1 -- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2390150620 msgr2=0x7f239014fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238fe00640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2390150620 0x7f239014fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238fe00640 1 -- 172.21.15.28:0/254481822 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23901f4f50 con 0x7f239015d770 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238ea00640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2390150620 0x7f239014fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f238fe00640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f239015d770 0x7f239015dbf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23900c7d00 tx=0x7f23880119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2387400640 1 -- 172.21.15.28:0/254481822 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388010040 con 0x7f239015d770 2024-04-23T18:22:57.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2387400640 1 -- 172.21.15.28:0/254481822 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238801a070 con 0x7f239015d770 2024-04-23T18:22:57.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2396200640 1 -- 172.21.15.28:0/254481822 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2390158f60 con 0x7f239015d770 2024-04-23T18:22:57.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2387400640 1 -- 172.21.15.28:0/254481822 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23880139c0 con 0x7f239015d770 2024-04-23T18:22:57.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2396200640 1 -- 172.21.15.28:0/254481822 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23900c98c0 con 0x7f239015d770 2024-04-23T18:22:57.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.676+0000 7f2396200640 1 -- 172.21.15.28:0/254481822 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2390068cd0 con 0x7f239015d770 2024-04-23T18:22:57.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.680+0000 7f2387400640 1 -- 172.21.15.28:0/254481822 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2388013b60 con 0x7f239015d770 2024-04-23T18:22:57.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.680+0000 7f2387400640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2370068380 0x7f237006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:57.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.680+0000 7f2387400640 1 -- 172.21.15.28:0/254481822 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2388089b90 con 0x7f239015d770 2024-04-23T18:22:57.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.680+0000 7f238f400640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2370068380 0x7f237006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:57.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.680+0000 7f238f400640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2370068380 0x7f237006a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2390068350 tx=0x7f2380008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:57.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.684+0000 7f2387400640 1 -- 172.21.15.28:0/254481822 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2388059cf0 con 0x7f239015d770 2024-04-23T18:22:57.799 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:22:57.802 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:22:57.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 -- 172.21.15.28:0/254481822 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23900cc600 con 0x7f239015d770 2024-04-23T18:22:57.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2387400640 1 -- 172.21.15.28:0/254481822 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6851 (secure 0 0 0) 0x7f23880595f0 con 0x7f239015d770 2024-04-23T18:22:57.880 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:57.880 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:22:56.882232+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4297,"mds_1":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-23T18:22:57.881 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 12 2024-04-23T18:22:57.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 -- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2370068380 msgr2=0x7f237006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2370068380 0x7f237006a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2390068350 tx=0x7f2380008040 comp rx=0 tx=0).stop 2024-04-23T18:22:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 -- 172.21.15.28:0/254481822 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f239015d770 msgr2=0x7f239015dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f239015d770 0x7f239015dbf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23900c7d00 tx=0x7f23880119f0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 -- 172.21.15.28:0/254481822 shutdown_connections 2024-04-23T18:22:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2370068380 0x7f237006a840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f239015d770 0x7f239015dbf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2390150620 0x7f239014fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 --2- 172.21.15.28:0/254481822 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2374004810 0x7f23900c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 -- 172.21.15.28:0/254481822 >> 172.21.15.28:0/254481822 conn(0x7f2390075dd0 msgr2=0x7f23900c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 -- 172.21.15.28:0/254481822 shutdown_connections 2024-04-23T18:22:57.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:57.884+0000 7f2396200640 1 -- 172.21.15.28:0/254481822 wait complete. 2024-04-23T18:22:57.903 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:58.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.088+0000 7f7a3e000640 1 Processor -- start 2024-04-23T18:22:58.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.088+0000 7f7a3e000640 1 -- start start 2024-04-23T18:22:58.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a3e000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7a381531a0 0x7f7a380c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a3e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a380c9e70 0x7f7a38072f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a3e000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a380c3bc0 con 0x7f7a380c9a00 2024-04-23T18:22:58.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a3e000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f7a380c4940 con 0x7f7a381531a0 2024-04-23T18:22:58.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a3e000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7a380c6790 con 0x7f7a380c9e70 2024-04-23T18:22:58.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a37400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7a381531a0 0x7f7a380c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a37400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7a381531a0 0x7f7a380c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45792/0 (socket says 172.21.15.28:45792) 2024-04-23T18:22:58.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a37400640 1 -- 172.21.15.28:0/4156536570 learned_addr learned my addr 172.21.15.28:0/4156536570 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:58.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a37e00640 1 --2- 172.21.15.28:0/4156536570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a380c9e70 0x7f7a38072f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a37400640 1 -- 172.21.15.28:0/4156536570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a380c9e70 msgr2=0x7f7a38072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:58.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a37400640 1 --2- 172.21.15.28:0/4156536570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a380c9e70 0x7f7a38072f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a37400640 1 -- 172.21.15.28:0/4156536570 >> v1:172.21.15.137:6789/0 conn(0x7f7a380c9a00 legacy=0x7f7a38158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:58.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.092+0000 7f7a37400640 1 -- 172.21.15.28:0/4156536570 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a380c6a70 con 0x7f7a381531a0 2024-04-23T18:22:58.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a37400640 1 --2- 172.21.15.28:0/4156536570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a381531a0 0x7f7a380c5ec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009870 tx=0x7f7a2801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bea17d0dbde893 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:58.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a36a00640 1 -- 172.21.15.28:0/4156536570 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a280b5070 con 0x7f7a381531a0 2024-04-23T18:22:58.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a36a00640 1 -- 172.21.15.28:0/4156536570 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280a8a50 con 0x7f7a381531a0 2024-04-23T18:22:58.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a36a00640 1 -- 172.21.15.28:0/4156536570 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a280a8e20 con 0x7f7a381531a0 2024-04-23T18:22:58.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 -- 172.21.15.28:0/4156536570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a381531a0 msgr2=0x7f7a380c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 --2- 172.21.15.28:0/4156536570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a381531a0 0x7f7a380c5ec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009870 tx=0x7f7a2801ed50 comp rx=0 tx=0).stop 2024-04-23T18:22:58.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 -- 172.21.15.28:0/4156536570 shutdown_connections 2024-04-23T18:22:58.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 --2- 172.21.15.28:0/4156536570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a380c9e70 0x7f7a38072f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 --2- 172.21.15.28:0/4156536570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a381531a0 0x7f7a380c5ec0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 -- 172.21.15.28:0/4156536570 >> 172.21.15.28:0/4156536570 conn(0x7f7a3806d0a0 msgr2=0x7f7a380676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:58.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 -- 172.21.15.28:0/4156536570 shutdown_connections 2024-04-23T18:22:58.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 -- 172.21.15.28:0/4156536570 wait complete. 2024-04-23T18:22:58.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 Processor -- start 2024-04-23T18:22:58.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 -- start start 2024-04-23T18:22:58.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a380c9a00 0x7f7a380ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a381531a0 0x7f7a38071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a380ca4c0 0x7f7a380ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7a380c4420 con 0x7f7a381531a0 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7a380c4140 con 0x7f7a380c9a00 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a3e000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7a38153580 con 0x7f7a380ca4c0 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.096+0000 7f7a2ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a381531a0 0x7f7a38071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a381531a0 0x7f7a38071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45804/0 (socket says 172.21.15.28:45804) 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2ea00640 1 -- 172.21.15.28:0/2411676576 learned_addr learned my addr 172.21.15.28:0/2411676576 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a37e00640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a380ca4c0 0x7f7a380ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a37400640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a380c9a00 0x7f7a380ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2ea00640 1 -- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a380ca4c0 msgr2=0x7f7a380ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2ea00640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a380ca4c0 0x7f7a380ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2ea00640 1 -- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a380c9a00 msgr2=0x7f7a380ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2ea00640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a380c9a00 0x7f7a380ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2ea00640 1 -- 172.21.15.28:0/2411676576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a381f4ef0 con 0x7f7a381531a0 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2ea00640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a381531a0 0x7f7a38071700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000c420 tx=0x7f7a2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2fe00640 1 -- 172.21.15.28:0/2411676576 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a200052d0 con 0x7f7a381531a0 2024-04-23T18:22:58.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2fe00640 1 -- 172.21.15.28:0/2411676576 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a20005470 con 0x7f7a381531a0 2024-04-23T18:22:58.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a3e000640 1 -- 172.21.15.28:0/2411676576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a381f51b0 con 0x7f7a381531a0 2024-04-23T18:22:58.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2fe00640 1 -- 172.21.15.28:0/2411676576 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20007260 con 0x7f7a381531a0 2024-04-23T18:22:58.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a3e000640 1 -- 172.21.15.28:0/2411676576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a38147020 con 0x7f7a381531a0 2024-04-23T18:22:58.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a3e000640 1 -- 172.21.15.28:0/2411676576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a380729e0 con 0x7f7a381531a0 2024-04-23T18:22:58.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2fe00640 1 -- 172.21.15.28:0/2411676576 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a20007400 con 0x7f7a381531a0 2024-04-23T18:22:58.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.100+0000 7f7a2fe00640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7a14068380 0x7f7a1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.104+0000 7f7a2fe00640 1 -- 172.21.15.28:0/2411676576 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7a200862f0 con 0x7f7a381531a0 2024-04-23T18:22:58.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.104+0000 7f7a37400640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7a14068380 0x7f7a1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.104+0000 7f7a37400640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7a14068380 0x7f7a1406a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7a280b2000 tx=0x7f7a280aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:58.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.108+0000 7f7a2fe00640 1 -- 172.21.15.28:0/2411676576 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7a200564d0 con 0x7f7a381531a0 2024-04-23T18:22:58.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.276+0000 7f7a3e000640 1 -- 172.21.15.28:0/2411676576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a38068cd0 con 0x7f7a381531a0 2024-04-23T18:22:58.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.276+0000 7f7a2fe00640 1 -- 172.21.15.28:0/2411676576 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f7a20055dd0 con 0x7f7a381531a0 2024-04-23T18:22:58.274 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:58.274 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:58.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 -- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7a14068380 msgr2=0x7f7a1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7a14068380 0x7f7a1406a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7a280b2000 tx=0x7f7a280aa070 comp rx=0 tx=0).stop 2024-04-23T18:22:58.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 -- 172.21.15.28:0/2411676576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a381531a0 msgr2=0x7f7a38071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a381531a0 0x7f7a38071700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000c420 tx=0x7f7a2000c8e0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 -- 172.21.15.28:0/2411676576 shutdown_connections 2024-04-23T18:22:58.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7a14068380 0x7f7a1406a840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a380ca4c0 0x7f7a380ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7a381531a0 0x7f7a38071700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 --2- 172.21.15.28:0/2411676576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a380c9a00 0x7f7a380ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 -- 172.21.15.28:0/2411676576 >> 172.21.15.28:0/2411676576 conn(0x7f7a3806d0a0 msgr2=0x7f7a38149240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:58.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 -- 172.21.15.28:0/2411676576 shutdown_connections 2024-04-23T18:22:58.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.280+0000 7f7a3e000640 1 -- 172.21.15.28:0/2411676576 wait complete. 2024-04-23T18:22:58.296 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-23T18:22:58.296 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:22:58.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f3200400640 1 Processor -- start 2024-04-23T18:22:58.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f3200400640 1 -- start start 2024-04-23T18:22:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f3200400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f31f80c9d00 0x7f31f80ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f3200400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31f80ca330 0x7f31f815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f3200400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f806bb10 con 0x7f31f8155180 2024-04-23T18:22:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f3200400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f31f80caf10 con 0x7f31f80c9d00 2024-04-23T18:22:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f3200400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f31f806c690 con 0x7f31f80ca330 2024-04-23T18:22:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f31fda00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f31f8155180 0x7f31f80ce650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36528/0 (socket says 172.21.15.28:36528) 2024-04-23T18:22:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f31fda00640 1 -- 172.21.15.28:0/1598105661 learned_addr learned my addr 172.21.15.28:0/1598105661 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f31fe400640 1 --2- 172.21.15.28:0/1598105661 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31f80ca330 0x7f31f815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f31fd000640 1 --2- 172.21.15.28:0/1598105661 >> v2:172.21.15.137:3300/0 conn(0x7f31f80c9d00 0x7f31f80ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f31f7e00640 1 -- 172.21.15.28:0/1598105661 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479498346 0 0) 0x7f31f806bb10 con 0x7f31f8155180 2024-04-23T18:22:58.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.440+0000 7f31f7e00640 1 -- 172.21.15.28:0/1598105661 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31e0003530 con 0x7f31f8155180 2024-04-23T18:22:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.444+0000 7f31fd000640 1 -- 172.21.15.28:0/1598105661 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31f80ca330 msgr2=0x7f31f815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.444+0000 7f31fd000640 1 --2- 172.21.15.28:0/1598105661 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31f80ca330 0x7f31f815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.444+0000 7f31f7e00640 1 -- 172.21.15.28:0/1598105661 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3203991729 0 0) 0x7f31e0003530 con 0x7f31f8155180 2024-04-23T18:22:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.444+0000 7f31fd000640 1 -- 172.21.15.28:0/1598105661 >> v1:172.21.15.28:6789/0 conn(0x7f31f8155180 legacy=0x7f31f80ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.444+0000 7f31fd000640 1 -- 172.21.15.28:0/1598105661 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f806bdf0 con 0x7f31f80c9d00 2024-04-23T18:22:58.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.444+0000 7f31fd000640 1 --2- 172.21.15.28:0/1598105661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31f80c9d00 0x7f31f80ca880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f31e40097c0 tx=0x7f31e401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=401298310942597c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.444+0000 7f31f7e00640 1 -- 172.21.15.28:0/1598105661 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e40b0070 con 0x7f31f80c9d00 2024-04-23T18:22:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.444+0000 7f31f7e00640 1 -- 172.21.15.28:0/1598105661 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e40ab400 con 0x7f31f80c9d00 2024-04-23T18:22:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.444+0000 7f31f7e00640 1 -- 172.21.15.28:0/1598105661 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec001680 con 0x7f31f80c9d00 2024-04-23T18:22:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 -- 172.21.15.28:0/1598105661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31f80c9d00 msgr2=0x7f31f80ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 --2- 172.21.15.28:0/1598105661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31f80c9d00 0x7f31f80ca880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f31e40097c0 tx=0x7f31e401c3c0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 -- 172.21.15.28:0/1598105661 shutdown_connections 2024-04-23T18:22:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 --2- 172.21.15.28:0/1598105661 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31f80ca330 0x7f31f815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 --2- 172.21.15.28:0/1598105661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31f80c9d00 0x7f31f80ca880 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 -- 172.21.15.28:0/1598105661 >> 172.21.15.28:0/1598105661 conn(0x7f31f80676e0 msgr2=0x7f31f8067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 -- 172.21.15.28:0/1598105661 shutdown_connections 2024-04-23T18:22:58.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 -- 172.21.15.28:0/1598105661 wait complete. 2024-04-23T18:22:58.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 Processor -- start 2024-04-23T18:22:58.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 -- start start 2024-04-23T18:22:58.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31f80c9d00 0x7f31f8143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31f80ca330 0x7f31f80cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31f8155180 0x7f31f8152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f31f80ceee0 con 0x7f31f8155180 2024-04-23T18:22:58.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f31f80ced60 con 0x7f31f80ca330 2024-04-23T18:22:58.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f3200400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f31f8155560 con 0x7f31f80c9d00 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fe400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31f8155180 0x7f31f8152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fe400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31f8155180 0x7f31f8152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45820/0 (socket says 172.21.15.28:45820) 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fe400640 1 -- 172.21.15.28:0/3371448414 learned_addr learned my addr 172.21.15.28:0/3371448414 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fda00640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31f80c9d00 0x7f31f8143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fd000640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31f80ca330 0x7f31f80cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fe400640 1 -- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31f80c9d00 msgr2=0x7f31f8143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fe400640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31f80c9d00 0x7f31f8143e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fe400640 1 -- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31f80ca330 msgr2=0x7f31f80cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fe400640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31f80ca330 0x7f31f80cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fe400640 1 -- 172.21.15.28:0/3371448414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f80cc5e0 con 0x7f31f8155180 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fda00640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31f80c9d00 0x7f31f8143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:58.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fd000640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31f80ca330 0x7f31f80cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:58.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31fe400640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31f8155180 0x7f31f8152bc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f31f000efc0 tx=0x7f31f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:58.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31f5600640 1 -- 172.21.15.28:0/3371448414 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0018020 con 0x7f31f8155180 2024-04-23T18:22:58.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.448+0000 7f31f5600640 1 -- 172.21.15.28:0/3371448414 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f0014480 con 0x7f31f8155180 2024-04-23T18:22:58.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.452+0000 7f31f5600640 1 -- 172.21.15.28:0/3371448414 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0014870 con 0x7f31f8155180 2024-04-23T18:22:58.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.452+0000 7f3200400640 1 -- 172.21.15.28:0/3371448414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f81f4cd0 con 0x7f31f8155180 2024-04-23T18:22:58.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.452+0000 7f3200400640 1 -- 172.21.15.28:0/3371448414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f80ccb60 con 0x7f31f8155180 2024-04-23T18:22:58.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.452+0000 7f3200400640 1 -- 172.21.15.28:0/3371448414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f8068cd0 con 0x7f31f8155180 2024-04-23T18:22:58.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.452+0000 7f31f5600640 1 -- 172.21.15.28:0/3371448414 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31f001b020 con 0x7f31f8155180 2024-04-23T18:22:58.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.452+0000 7f31f5600640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f31d8068380 0x7f31d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.452+0000 7f31f5600640 1 -- 172.21.15.28:0/3371448414 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f31f0087760 con 0x7f31f8155180 2024-04-23T18:22:58.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.452+0000 7f31fda00640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f31d8068380 0x7f31d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.456+0000 7f31fda00640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f31d8068380 0x7f31d806a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31ec007a10 tx=0x7f31ec009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:58.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.456+0000 7f31f5600640 1 -- 172.21.15.28:0/3371448414 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31f0022070 con 0x7f31f8155180 2024-04-23T18:22:58.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.624+0000 7f3200400640 1 -- 172.21.15.28:0/3371448414 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31f80c97a0 con 0x7f31d8068380 2024-04-23T18:22:58.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f31f5600640 1 -- 172.21.15.28:0/3371448414 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7f31f80c97a0 con 0x7f31d8068380 2024-04-23T18:22:58.649 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:58.651 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:22:58.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 -- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f31d8068380 msgr2=0x7f31d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f31d8068380 0x7f31d806a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31ec007a10 tx=0x7f31ec009040 comp rx=0 tx=0).stop 2024-04-23T18:22:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 -- 172.21.15.28:0/3371448414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31f8155180 msgr2=0x7f31f8152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31f8155180 0x7f31f8152bc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f31f000efc0 tx=0x7f31f000c490 comp rx=0 tx=0).stop 2024-04-23T18:22:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 -- 172.21.15.28:0/3371448414 shutdown_connections 2024-04-23T18:22:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f31d8068380 0x7f31d806a840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31f8155180 0x7f31f8152bc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31f80ca330 0x7f31f80cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 --2- 172.21.15.28:0/3371448414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31f80c9d00 0x7f31f8143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 -- 172.21.15.28:0/3371448414 >> 172.21.15.28:0/3371448414 conn(0x7f31f80676e0 msgr2=0x7f31f815dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 -- 172.21.15.28:0/3371448414 shutdown_connections 2024-04-23T18:22:58.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.652+0000 7f3200400640 1 -- 172.21.15.28:0/3371448414 wait complete. 2024-04-23T18:22:58.670 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-23T18:22:57.328571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227696,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747024,"statfs":{"total":773094113280,"available":772860952576,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005400"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876377+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:22:38.876377+0000","last_peered":"2024-04-23T18:22:38.876377+0000","last_clean":"2024-04-23T18:22:38.876377+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:22:38.876377+0000","last_undegraded":"2024-04-23T18:22:38.876377+0000","last_fullsized":"2024-04-23T18:22:38.876377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512435+0000","last_change":"2024-04-23T18:22:33.374920+0000","last_active":"2024-04-23T18:22:38.512435+0000","last_peered":"2024-04-23T18:22:38.512435+0000","last_clean":"2024-04-23T18:22:38.512435+0000","last_became_active":"2024-04-23T18:22:33.374636+0000","last_became_peered":"2024-04-23T18:22:33.374636+0000","last_unstale":"2024-04-23T18:22:38.512435+0000","last_undegraded":"2024-04-23T18:22:38.512435+0000","last_fullsized":"2024-04-23T18:22:38.512435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:15.638456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511738+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:22:38.511738+0000","last_peered":"2024-04-23T18:22:38.511738+0000","last_clean":"2024-04-23T18:22:38.511738+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:22:38.511738+0000","last_undegraded":"2024-04-23T18:22:38.511738+0000","last_fullsized":"2024-04-23T18:22:38.511738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512559+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:22:38.512559+0000","last_peered":"2024-04-23T18:22:38.512559+0000","last_clean":"2024-04-23T18:22:38.512559+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:22:38.512559+0000","last_undegraded":"2024-04-23T18:22:38.512559+0000","last_fullsized":"2024-04-23T18:22:38.512559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876263+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:22:38.876263+0000","last_peered":"2024-04-23T18:22:38.876263+0000","last_clean":"2024-04-23T18:22:38.876263+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:22:38.876263+0000","last_undegraded":"2024-04-23T18:22:38.876263+0000","last_fullsized":"2024-04-23T18:22:38.876263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398723+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:22:38.398723+0000","last_peered":"2024-04-23T18:22:38.398723+0000","last_clean":"2024-04-23T18:22:38.398723+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:22:38.398723+0000","last_undegraded":"2024-04-23T18:22:38.398723+0000","last_fullsized":"2024-04-23T18:22:38.398723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877548+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:22:38.877548+0000","last_peered":"2024-04-23T18:22:38.877548+0000","last_clean":"2024-04-23T18:22:38.877548+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:22:38.877548+0000","last_undegraded":"2024-04-23T18:22:38.877548+0000","last_fullsized":"2024-04-23T18:22:38.877548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520160+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:22:38.520160+0000","last_peered":"2024-04-23T18:22:38.520160+0000","last_clean":"2024-04-23T18:22:38.520160+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:22:38.520160+0000","last_undegraded":"2024-04-23T18:22:38.520160+0000","last_fullsized":"2024-04-23T18:22:38.520160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399105+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:22:38.399105+0000","last_peered":"2024-04-23T18:22:38.399105+0000","last_clean":"2024-04-23T18:22:38.399105+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:22:38.399105+0000","last_undegraded":"2024-04-23T18:22:38.399105+0000","last_fullsized":"2024-04-23T18:22:38.399105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876812+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:22:38.876812+0000","last_peered":"2024-04-23T18:22:38.876812+0000","last_clean":"2024-04-23T18:22:38.876812+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:22:38.876812+0000","last_undegraded":"2024-04-23T18:22:38.876812+0000","last_fullsized":"2024-04-23T18:22:38.876812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520391+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:22:38.520391+0000","last_peered":"2024-04-23T18:22:38.520391+0000","last_clean":"2024-04-23T18:22:38.520391+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:22:38.520391+0000","last_undegraded":"2024-04-23T18:22:38.520391+0000","last_fullsized":"2024-04-23T18:22:38.520391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399129+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:22:38.399129+0000","last_peered":"2024-04-23T18:22:38.399129+0000","last_clean":"2024-04-23T18:22:38.399129+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:22:38.399129+0000","last_undegraded":"2024-04-23T18:22:38.399129+0000","last_fullsized":"2024-04-23T18:22:38.399129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395366+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:22:38.395366+0000","last_peered":"2024-04-23T18:22:38.395366+0000","last_clean":"2024-04-23T18:22:38.395366+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:22:38.395366+0000","last_undegraded":"2024-04-23T18:22:38.395366+0000","last_fullsized":"2024-04-23T18:22:38.395366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877292+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:22:38.877292+0000","last_peered":"2024-04-23T18:22:38.877292+0000","last_clean":"2024-04-23T18:22:38.877292+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:22:38.877292+0000","last_undegraded":"2024-04-23T18:22:38.877292+0000","last_fullsized":"2024-04-23T18:22:38.877292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400086+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:22:38.400086+0000","last_peered":"2024-04-23T18:22:38.400086+0000","last_clean":"2024-04-23T18:22:38.400086+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:22:38.400086+0000","last_undegraded":"2024-04-23T18:22:38.400086+0000","last_fullsized":"2024-04-23T18:22:38.400086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511999+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:22:38.511999+0000","last_peered":"2024-04-23T18:22:38.511999+0000","last_clean":"2024-04-23T18:22:38.511999+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:22:38.511999+0000","last_undegraded":"2024-04-23T18:22:38.511999+0000","last_fullsized":"2024-04-23T18:22:38.511999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772083+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:22:38.772083+0000","last_peered":"2024-04-23T18:22:38.772083+0000","last_clean":"2024-04-23T18:22:38.772083+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:22:38.772083+0000","last_undegraded":"2024-04-23T18:22:38.772083+0000","last_fullsized":"2024-04-23T18:22:38.772083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399812+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:22:38.399812+0000","last_peered":"2024-04-23T18:22:38.399812+0000","last_clean":"2024-04-23T18:22:38.399812+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:22:38.399812+0000","last_undegraded":"2024-04-23T18:22:38.399812+0000","last_fullsized":"2024-04-23T18:22:38.399812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511898+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:22:38.511898+0000","last_peered":"2024-04-23T18:22:38.511898+0000","last_clean":"2024-04-23T18:22:38.511898+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:22:38.511898+0000","last_undegraded":"2024-04-23T18:22:38.511898+0000","last_fullsized":"2024-04-23T18:22:38.511898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771774+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:22:38.771774+0000","last_peered":"2024-04-23T18:22:38.771774+0000","last_clean":"2024-04-23T18:22:38.771774+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:22:38.771774+0000","last_undegraded":"2024-04-23T18:22:38.771774+0000","last_fullsized":"2024-04-23T18:22:38.771774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772456+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:22:38.772456+0000","last_peered":"2024-04-23T18:22:38.772456+0000","last_clean":"2024-04-23T18:22:38.772456+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:22:38.772456+0000","last_undegraded":"2024-04-23T18:22:38.772456+0000","last_fullsized":"2024-04-23T18:22:38.772456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399139+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:22:38.399139+0000","last_peered":"2024-04-23T18:22:38.399139+0000","last_clean":"2024-04-23T18:22:38.399139+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:22:38.399139+0000","last_undegraded":"2024-04-23T18:22:38.399139+0000","last_fullsized":"2024-04-23T18:22:38.399139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876234+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:22:38.876234+0000","last_peered":"2024-04-23T18:22:38.876234+0000","last_clean":"2024-04-23T18:22:38.876234+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:22:38.876234+0000","last_undegraded":"2024-04-23T18:22:38.876234+0000","last_fullsized":"2024-04-23T18:22:38.876234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400185+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:22:38.400185+0000","last_peered":"2024-04-23T18:22:38.400185+0000","last_clean":"2024-04-23T18:22:38.400185+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:22:38.400185+0000","last_undegraded":"2024-04-23T18:22:38.400185+0000","last_fullsized":"2024-04-23T18:22:38.400185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876309+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:22:38.876309+0000","last_peered":"2024-04-23T18:22:38.876309+0000","last_clean":"2024-04-23T18:22:38.876309+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:22:38.876309+0000","last_undegraded":"2024-04-23T18:22:38.876309+0000","last_fullsized":"2024-04-23T18:22:38.876309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396301+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:22:38.396301+0000","last_peered":"2024-04-23T18:22:38.396301+0000","last_clean":"2024-04-23T18:22:38.396301+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:22:38.396301+0000","last_undegraded":"2024-04-23T18:22:38.396301+0000","last_fullsized":"2024-04-23T18:22:38.396301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399544+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:22:38.399544+0000","last_peered":"2024-04-23T18:22:38.399544+0000","last_clean":"2024-04-23T18:22:38.399544+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:22:38.399544+0000","last_undegraded":"2024-04-23T18:22:38.399544+0000","last_fullsized":"2024-04-23T18:22:38.399544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512524+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:22:38.512524+0000","last_peered":"2024-04-23T18:22:38.512524+0000","last_clean":"2024-04-23T18:22:38.512524+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:22:38.512524+0000","last_undegraded":"2024-04-23T18:22:38.512524+0000","last_fullsized":"2024-04-23T18:22:38.512524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772582+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:22:38.772582+0000","last_peered":"2024-04-23T18:22:38.772582+0000","last_clean":"2024-04-23T18:22:38.772582+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:22:38.772582+0000","last_undegraded":"2024-04-23T18:22:38.772582+0000","last_fullsized":"2024-04-23T18:22:38.772582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511607+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:22:38.511607+0000","last_peered":"2024-04-23T18:22:38.511607+0000","last_clean":"2024-04-23T18:22:38.511607+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:22:38.511607+0000","last_undegraded":"2024-04-23T18:22:38.511607+0000","last_fullsized":"2024-04-23T18:22:38.511607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772268+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:22:38.772268+0000","last_peered":"2024-04-23T18:22:38.772268+0000","last_clean":"2024-04-23T18:22:38.772268+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:22:38.772268+0000","last_undegraded":"2024-04-23T18:22:38.772268+0000","last_fullsized":"2024-04-23T18:22:38.772268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877688+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:22:38.877688+0000","last_peered":"2024-04-23T18:22:38.877688+0000","last_clean":"2024-04-23T18:22:38.877688+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:22:38.877688+0000","last_undegraded":"2024-04-23T18:22:38.877688+0000","last_fullsized":"2024-04-23T18:22:38.877688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875996+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:22:38.875996+0000","last_peered":"2024-04-23T18:22:38.875996+0000","last_clean":"2024-04-23T18:22:38.875996+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:22:38.875996+0000","last_undegraded":"2024-04-23T18:22:38.875996+0000","last_fullsized":"2024-04-23T18:22:38.875996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520638+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:22:38.520638+0000","last_peered":"2024-04-23T18:22:38.520638+0000","last_clean":"2024-04-23T18:22:38.520638+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:22:38.520638+0000","last_undegraded":"2024-04-23T18:22:38.520638+0000","last_fullsized":"2024-04-23T18:22:38.520638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772367+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:22:38.772367+0000","last_peered":"2024-04-23T18:22:38.772367+0000","last_clean":"2024-04-23T18:22:38.772367+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:22:38.772367+0000","last_undegraded":"2024-04-23T18:22:38.772367+0000","last_fullsized":"2024-04-23T18:22:38.772367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771877+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:22:38.771877+0000","last_peered":"2024-04-23T18:22:38.771877+0000","last_clean":"2024-04-23T18:22:38.771877+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:22:38.771877+0000","last_undegraded":"2024-04-23T18:22:38.771877+0000","last_fullsized":"2024-04-23T18:22:38.771877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399411+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:22:38.399411+0000","last_peered":"2024-04-23T18:22:38.399411+0000","last_clean":"2024-04-23T18:22:38.399411+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:22:38.399411+0000","last_undegraded":"2024-04-23T18:22:38.399411+0000","last_fullsized":"2024-04-23T18:22:38.399411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520001+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:22:38.520001+0000","last_peered":"2024-04-23T18:22:38.520001+0000","last_clean":"2024-04-23T18:22:38.520001+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:22:38.520001+0000","last_undegraded":"2024-04-23T18:22:38.520001+0000","last_fullsized":"2024-04-23T18:22:38.520001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772519+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:22:38.772519+0000","last_peered":"2024-04-23T18:22:38.772519+0000","last_clean":"2024-04-23T18:22:38.772519+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:22:38.772519+0000","last_undegraded":"2024-04-23T18:22:38.772519+0000","last_fullsized":"2024-04-23T18:22:38.772519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771764+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:22:38.771764+0000","last_peered":"2024-04-23T18:22:38.771764+0000","last_clean":"2024-04-23T18:22:38.771764+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:22:38.771764+0000","last_undegraded":"2024-04-23T18:22:38.771764+0000","last_fullsized":"2024-04-23T18:22:38.771764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.393983+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:22:38.393983+0000","last_peered":"2024-04-23T18:22:38.393983+0000","last_clean":"2024-04-23T18:22:38.393983+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:22:38.393983+0000","last_undegraded":"2024-04-23T18:22:38.393983+0000","last_fullsized":"2024-04-23T18:22:38.393983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772489+0000","last_change":"2024-04-23T18:22:37.434423+0000","last_active":"2024-04-23T18:22:38.772489+0000","last_peered":"2024-04-23T18:22:38.772489+0000","last_clean":"2024-04-23T18:22:38.772489+0000","last_became_active":"2024-04-23T18:22:37.434030+0000","last_became_peered":"2024-04-23T18:22:37.434030+0000","last_unstale":"2024-04-23T18:22:38.772489+0000","last_undegraded":"2024-04-23T18:22:38.772489+0000","last_fullsized":"2024-04-23T18:22:38.772489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:38:05.642960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875593+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:22:38.875593+0000","last_peered":"2024-04-23T18:22:38.875593+0000","last_clean":"2024-04-23T18:22:38.875593+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:22:38.875593+0000","last_undegraded":"2024-04-23T18:22:38.875593+0000","last_fullsized":"2024-04-23T18:22:38.875593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876234+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:22:38.876234+0000","last_peered":"2024-04-23T18:22:38.876234+0000","last_clean":"2024-04-23T18:22:38.876234+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:22:38.876234+0000","last_undegraded":"2024-04-23T18:22:38.876234+0000","last_fullsized":"2024-04-23T18:22:38.876234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876336+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:22:38.876336+0000","last_peered":"2024-04-23T18:22:38.876336+0000","last_clean":"2024-04-23T18:22:38.876336+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:22:38.876336+0000","last_undegraded":"2024-04-23T18:22:38.876336+0000","last_fullsized":"2024-04-23T18:22:38.876336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511913+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:22:38.511913+0000","last_peered":"2024-04-23T18:22:38.511913+0000","last_clean":"2024-04-23T18:22:38.511913+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:22:38.511913+0000","last_undegraded":"2024-04-23T18:22:38.511913+0000","last_fullsized":"2024-04-23T18:22:38.511913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519892+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:22:38.519892+0000","last_peered":"2024-04-23T18:22:38.519892+0000","last_clean":"2024-04-23T18:22:38.519892+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:22:38.519892+0000","last_undegraded":"2024-04-23T18:22:38.519892+0000","last_fullsized":"2024-04-23T18:22:38.519892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876556+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:22:38.876556+0000","last_peered":"2024-04-23T18:22:38.876556+0000","last_clean":"2024-04-23T18:22:38.876556+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:22:38.876556+0000","last_undegraded":"2024-04-23T18:22:38.876556+0000","last_fullsized":"2024-04-23T18:22:38.876556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396052+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:22:38.396052+0000","last_peered":"2024-04-23T18:22:38.396052+0000","last_clean":"2024-04-23T18:22:38.396052+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:22:38.396052+0000","last_undegraded":"2024-04-23T18:22:38.396052+0000","last_fullsized":"2024-04-23T18:22:38.396052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877306+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:22:38.877306+0000","last_peered":"2024-04-23T18:22:38.877306+0000","last_clean":"2024-04-23T18:22:38.877306+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:22:38.877306+0000","last_undegraded":"2024-04-23T18:22:38.877306+0000","last_fullsized":"2024-04-23T18:22:38.877306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394450+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:22:38.394450+0000","last_peered":"2024-04-23T18:22:38.394450+0000","last_clean":"2024-04-23T18:22:38.394450+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:22:38.394450+0000","last_undegraded":"2024-04-23T18:22:38.394450+0000","last_fullsized":"2024-04-23T18:22:38.394450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395296+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:22:38.395296+0000","last_peered":"2024-04-23T18:22:38.395296+0000","last_clean":"2024-04-23T18:22:38.395296+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:22:38.395296+0000","last_undegraded":"2024-04-23T18:22:38.395296+0000","last_fullsized":"2024-04-23T18:22:38.395296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520463+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:22:38.520463+0000","last_peered":"2024-04-23T18:22:38.520463+0000","last_clean":"2024-04-23T18:22:38.520463+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:22:38.520463+0000","last_undegraded":"2024-04-23T18:22:38.520463+0000","last_fullsized":"2024-04-23T18:22:38.520463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772482+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:22:38.772482+0000","last_peered":"2024-04-23T18:22:38.772482+0000","last_clean":"2024-04-23T18:22:38.772482+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:22:38.772482+0000","last_undegraded":"2024-04-23T18:22:38.772482+0000","last_fullsized":"2024-04-23T18:22:38.772482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876108+0000","last_change":"2024-04-23T18:22:37.422351+0000","last_active":"2024-04-23T18:22:38.876108+0000","last_peered":"2024-04-23T18:22:38.876108+0000","last_clean":"2024-04-23T18:22:38.876108+0000","last_became_active":"2024-04-23T18:22:37.421745+0000","last_became_peered":"2024-04-23T18:22:37.421745+0000","last_unstale":"2024-04-23T18:22:38.876108+0000","last_undegraded":"2024-04-23T18:22:38.876108+0000","last_fullsized":"2024-04-23T18:22:38.876108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:43.074101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.878109+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:22:38.878109+0000","last_peered":"2024-04-23T18:22:38.878109+0000","last_clean":"2024-04-23T18:22:38.878109+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:22:38.878109+0000","last_undegraded":"2024-04-23T18:22:38.878109+0000","last_fullsized":"2024-04-23T18:22:38.878109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394651+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:22:38.394651+0000","last_peered":"2024-04-23T18:22:38.394651+0000","last_clean":"2024-04-23T18:22:38.394651+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:22:38.394651+0000","last_undegraded":"2024-04-23T18:22:38.394651+0000","last_fullsized":"2024-04-23T18:22:38.394651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519385+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:22:38.519385+0000","last_peered":"2024-04-23T18:22:38.519385+0000","last_clean":"2024-04-23T18:22:38.519385+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:22:38.519385+0000","last_undegraded":"2024-04-23T18:22:38.519385+0000","last_fullsized":"2024-04-23T18:22:38.519385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877267+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:22:38.877267+0000","last_peered":"2024-04-23T18:22:38.877267+0000","last_clean":"2024-04-23T18:22:38.877267+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:22:38.877267+0000","last_undegraded":"2024-04-23T18:22:38.877267+0000","last_fullsized":"2024-04-23T18:22:38.877267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400190+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:22:38.400190+0000","last_peered":"2024-04-23T18:22:38.400190+0000","last_clean":"2024-04-23T18:22:38.400190+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:22:38.400190+0000","last_undegraded":"2024-04-23T18:22:38.400190+0000","last_fullsized":"2024-04-23T18:22:38.400190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398668+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:22:38.398668+0000","last_peered":"2024-04-23T18:22:38.398668+0000","last_clean":"2024-04-23T18:22:38.398668+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:22:38.398668+0000","last_undegraded":"2024-04-23T18:22:38.398668+0000","last_fullsized":"2024-04-23T18:22:38.398668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876669+0000","last_change":"2024-04-23T18:22:33.407067+0000","last_active":"2024-04-23T18:22:38.876669+0000","last_peered":"2024-04-23T18:22:38.876669+0000","last_clean":"2024-04-23T18:22:38.876669+0000","last_became_active":"2024-04-23T18:22:33.406727+0000","last_became_peered":"2024-04-23T18:22:33.406727+0000","last_unstale":"2024-04-23T18:22:38.876669+0000","last_undegraded":"2024-04-23T18:22:38.876669+0000","last_fullsized":"2024-04-23T18:22:38.876669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:21:04.444047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.393876+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:22:38.393876+0000","last_peered":"2024-04-23T18:22:38.393876+0000","last_clean":"2024-04-23T18:22:38.393876+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:22:38.393876+0000","last_undegraded":"2024-04-23T18:22:38.393876+0000","last_fullsized":"2024-04-23T18:22:38.393876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876191+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:22:38.876191+0000","last_peered":"2024-04-23T18:22:38.876191+0000","last_clean":"2024-04-23T18:22:38.876191+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:22:38.876191+0000","last_undegraded":"2024-04-23T18:22:38.876191+0000","last_fullsized":"2024-04-23T18:22:38.876191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395264+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:22:38.395264+0000","last_peered":"2024-04-23T18:22:38.395264+0000","last_clean":"2024-04-23T18:22:38.395264+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:22:38.395264+0000","last_undegraded":"2024-04-23T18:22:38.395264+0000","last_fullsized":"2024-04-23T18:22:38.395264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395402+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:22:38.395402+0000","last_peered":"2024-04-23T18:22:38.395402+0000","last_clean":"2024-04-23T18:22:38.395402+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:22:38.395402+0000","last_undegraded":"2024-04-23T18:22:38.395402+0000","last_fullsized":"2024-04-23T18:22:38.395402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512523+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:22:38.512523+0000","last_peered":"2024-04-23T18:22:38.512523+0000","last_clean":"2024-04-23T18:22:38.512523+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:22:38.512523+0000","last_undegraded":"2024-04-23T18:22:38.512523+0000","last_fullsized":"2024-04-23T18:22:38.512523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877129+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:22:38.877129+0000","last_peered":"2024-04-23T18:22:38.877129+0000","last_clean":"2024-04-23T18:22:38.877129+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:22:38.877129+0000","last_undegraded":"2024-04-23T18:22:38.877129+0000","last_fullsized":"2024-04-23T18:22:38.877129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519934+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:22:38.519934+0000","last_peered":"2024-04-23T18:22:38.519934+0000","last_clean":"2024-04-23T18:22:38.519934+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:22:38.519934+0000","last_undegraded":"2024-04-23T18:22:38.519934+0000","last_fullsized":"2024-04-23T18:22:38.519934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512108+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:22:38.512108+0000","last_peered":"2024-04-23T18:22:38.512108+0000","last_clean":"2024-04-23T18:22:38.512108+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:22:38.512108+0000","last_undegraded":"2024-04-23T18:22:38.512108+0000","last_fullsized":"2024-04-23T18:22:38.512108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875754+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:22:38.875754+0000","last_peered":"2024-04-23T18:22:38.875754+0000","last_clean":"2024-04-23T18:22:38.875754+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:22:38.875754+0000","last_undegraded":"2024-04-23T18:22:38.875754+0000","last_fullsized":"2024-04-23T18:22:38.875754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876177+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:22:38.876177+0000","last_peered":"2024-04-23T18:22:38.876177+0000","last_clean":"2024-04-23T18:22:38.876177+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:22:38.876177+0000","last_undegraded":"2024-04-23T18:22:38.876177+0000","last_fullsized":"2024-04-23T18:22:38.876177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520575+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:22:38.520575+0000","last_peered":"2024-04-23T18:22:38.520575+0000","last_clean":"2024-04-23T18:22:38.520575+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:22:38.520575+0000","last_undegraded":"2024-04-23T18:22:38.520575+0000","last_fullsized":"2024-04-23T18:22:38.520575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877083+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:22:38.877083+0000","last_peered":"2024-04-23T18:22:38.877083+0000","last_clean":"2024-04-23T18:22:38.877083+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:22:38.877083+0000","last_undegraded":"2024-04-23T18:22:38.877083+0000","last_fullsized":"2024-04-23T18:22:38.877083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:48.087550+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:22:48.087550+0000","last_peered":"2024-04-23T18:22:48.087550+0000","last_clean":"2024-04-23T18:22:48.087550+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:22:48.087550+0000","last_undegraded":"2024-04-23T18:22:48.087550+0000","last_fullsized":"2024-04-23T18:22:48.087550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772018+0000","last_change":"2024-04-23T18:22:37.423270+0000","last_active":"2024-04-23T18:22:38.772018+0000","last_peered":"2024-04-23T18:22:38.772018+0000","last_clean":"2024-04-23T18:22:38.772018+0000","last_became_active":"2024-04-23T18:22:37.422847+0000","last_became_peered":"2024-04-23T18:22:37.422847+0000","last_unstale":"2024-04-23T18:22:38.772018+0000","last_undegraded":"2024-04-23T18:22:38.772018+0000","last_fullsized":"2024-04-23T18:22:38.772018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:42.248011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399891+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:22:38.399891+0000","last_peered":"2024-04-23T18:22:38.399891+0000","last_clean":"2024-04-23T18:22:38.399891+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:22:38.399891+0000","last_undegraded":"2024-04-23T18:22:38.399891+0000","last_fullsized":"2024-04-23T18:22:38.399891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772372+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:22:38.772372+0000","last_peered":"2024-04-23T18:22:38.772372+0000","last_clean":"2024-04-23T18:22:38.772372+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:22:38.772372+0000","last_undegraded":"2024-04-23T18:22:38.772372+0000","last_fullsized":"2024-04-23T18:22:38.772372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399340+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:22:38.399340+0000","last_peered":"2024-04-23T18:22:38.399340+0000","last_clean":"2024-04-23T18:22:38.399340+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:22:38.399340+0000","last_undegraded":"2024-04-23T18:22:38.399340+0000","last_fullsized":"2024-04-23T18:22:38.399340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876364+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:22:38.876364+0000","last_peered":"2024-04-23T18:22:38.876364+0000","last_clean":"2024-04-23T18:22:38.876364+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:22:38.876364+0000","last_undegraded":"2024-04-23T18:22:38.876364+0000","last_fullsized":"2024-04-23T18:22:38.876364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520722+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:22:38.520722+0000","last_peered":"2024-04-23T18:22:38.520722+0000","last_clean":"2024-04-23T18:22:38.520722+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:22:38.520722+0000","last_undegraded":"2024-04-23T18:22:38.520722+0000","last_fullsized":"2024-04-23T18:22:38.520722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511802+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:22:38.511802+0000","last_peered":"2024-04-23T18:22:38.511802+0000","last_clean":"2024-04-23T18:22:38.511802+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:22:38.511802+0000","last_undegraded":"2024-04-23T18:22:38.511802+0000","last_fullsized":"2024-04-23T18:22:38.511802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520447+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:22:38.520447+0000","last_peered":"2024-04-23T18:22:38.520447+0000","last_clean":"2024-04-23T18:22:38.520447+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:22:38.520447+0000","last_undegraded":"2024-04-23T18:22:38.520447+0000","last_fullsized":"2024-04-23T18:22:38.520447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396160+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:22:38.396160+0000","last_peered":"2024-04-23T18:22:38.396160+0000","last_clean":"2024-04-23T18:22:38.396160+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:22:38.396160+0000","last_undegraded":"2024-04-23T18:22:38.396160+0000","last_fullsized":"2024-04-23T18:22:38.396160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511805+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:22:38.511805+0000","last_peered":"2024-04-23T18:22:38.511805+0000","last_clean":"2024-04-23T18:22:38.511805+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:22:38.511805+0000","last_undegraded":"2024-04-23T18:22:38.511805+0000","last_fullsized":"2024-04-23T18:22:38.511805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876162+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:22:38.876162+0000","last_peered":"2024-04-23T18:22:38.876162+0000","last_clean":"2024-04-23T18:22:38.876162+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:22:38.876162+0000","last_undegraded":"2024-04-23T18:22:38.876162+0000","last_fullsized":"2024-04-23T18:22:38.876162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771668+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:22:38.771668+0000","last_peered":"2024-04-23T18:22:38.771668+0000","last_clean":"2024-04-23T18:22:38.771668+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:22:38.771668+0000","last_undegraded":"2024-04-23T18:22:38.771668+0000","last_fullsized":"2024-04-23T18:22:38.771668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519583+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:22:38.519583+0000","last_peered":"2024-04-23T18:22:38.519583+0000","last_clean":"2024-04-23T18:22:38.519583+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:22:38.519583+0000","last_undegraded":"2024-04-23T18:22:38.519583+0000","last_fullsized":"2024-04-23T18:22:38.519583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396141+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:22:38.396141+0000","last_peered":"2024-04-23T18:22:38.396141+0000","last_clean":"2024-04-23T18:22:38.396141+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:22:38.396141+0000","last_undegraded":"2024-04-23T18:22:38.396141+0000","last_fullsized":"2024-04-23T18:22:38.396141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511775+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:22:38.511775+0000","last_peered":"2024-04-23T18:22:38.511775+0000","last_clean":"2024-04-23T18:22:38.511775+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:22:38.511775+0000","last_undegraded":"2024-04-23T18:22:38.511775+0000","last_fullsized":"2024-04-23T18:22:38.511775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511945+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:22:38.511945+0000","last_peered":"2024-04-23T18:22:38.511945+0000","last_clean":"2024-04-23T18:22:38.511945+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:22:38.511945+0000","last_undegraded":"2024-04-23T18:22:38.511945+0000","last_fullsized":"2024-04-23T18:22:38.511945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395587+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:22:38.395587+0000","last_peered":"2024-04-23T18:22:38.395587+0000","last_clean":"2024-04-23T18:22:38.395587+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:22:38.395587+0000","last_undegraded":"2024-04-23T18:22:38.395587+0000","last_fullsized":"2024-04-23T18:22:38.395587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876159+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:22:38.876159+0000","last_peered":"2024-04-23T18:22:38.876159+0000","last_clean":"2024-04-23T18:22:38.876159+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:22:38.876159+0000","last_undegraded":"2024-04-23T18:22:38.876159+0000","last_fullsized":"2024-04-23T18:22:38.876159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394359+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:22:38.394359+0000","last_peered":"2024-04-23T18:22:38.394359+0000","last_clean":"2024-04-23T18:22:38.394359+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:22:38.394359+0000","last_undegraded":"2024-04-23T18:22:38.394359+0000","last_fullsized":"2024-04-23T18:22:38.394359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512130+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:22:38.512130+0000","last_peered":"2024-04-23T18:22:38.512130+0000","last_clean":"2024-04-23T18:22:38.512130+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:22:38.512130+0000","last_undegraded":"2024-04-23T18:22:38.512130+0000","last_fullsized":"2024-04-23T18:22:38.512130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398922+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:22:38.398922+0000","last_peered":"2024-04-23T18:22:38.398922+0000","last_clean":"2024-04-23T18:22:38.398922+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:22:38.398922+0000","last_undegraded":"2024-04-23T18:22:38.398922+0000","last_fullsized":"2024-04-23T18:22:38.398922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512357+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:22:38.512357+0000","last_peered":"2024-04-23T18:22:38.512357+0000","last_clean":"2024-04-23T18:22:38.512357+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:22:38.512357+0000","last_undegraded":"2024-04-23T18:22:38.512357+0000","last_fullsized":"2024-04-23T18:22:38.512357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395074+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:22:38.395074+0000","last_peered":"2024-04-23T18:22:38.395074+0000","last_clean":"2024-04-23T18:22:38.395074+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:22:38.395074+0000","last_undegraded":"2024-04-23T18:22:38.395074+0000","last_fullsized":"2024-04-23T18:22:38.395074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.393976+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:22:38.393976+0000","last_peered":"2024-04-23T18:22:38.393976+0000","last_clean":"2024-04-23T18:22:38.393976+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:22:38.393976+0000","last_undegraded":"2024-04-23T18:22:38.393976+0000","last_fullsized":"2024-04-23T18:22:38.393976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519749+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:22:38.519749+0000","last_peered":"2024-04-23T18:22:38.519749+0000","last_clean":"2024-04-23T18:22:38.519749+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:22:38.519749+0000","last_undegraded":"2024-04-23T18:22:38.519749+0000","last_fullsized":"2024-04-23T18:22:38.519749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876029+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:22:38.876029+0000","last_peered":"2024-04-23T18:22:38.876029+0000","last_clean":"2024-04-23T18:22:38.876029+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:22:38.876029+0000","last_undegraded":"2024-04-23T18:22:38.876029+0000","last_fullsized":"2024-04-23T18:22:38.876029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512257+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:22:38.512257+0000","last_peered":"2024-04-23T18:22:38.512257+0000","last_clean":"2024-04-23T18:22:38.512257+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:22:38.512257+0000","last_undegraded":"2024-04-23T18:22:38.512257+0000","last_fullsized":"2024-04-23T18:22:38.512257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772250+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:22:38.772250+0000","last_peered":"2024-04-23T18:22:38.772250+0000","last_clean":"2024-04-23T18:22:38.772250+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:22:38.772250+0000","last_undegraded":"2024-04-23T18:22:38.772250+0000","last_fullsized":"2024-04-23T18:22:38.772250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396520+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:22:38.396520+0000","last_peered":"2024-04-23T18:22:38.396520+0000","last_clean":"2024-04-23T18:22:38.396520+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:22:38.396520+0000","last_undegraded":"2024-04-23T18:22:38.396520+0000","last_fullsized":"2024-04-23T18:22:38.396520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512421+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:22:38.512421+0000","last_peered":"2024-04-23T18:22:38.512421+0000","last_clean":"2024-04-23T18:22:38.512421+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:22:38.512421+0000","last_undegraded":"2024-04-23T18:22:38.512421+0000","last_fullsized":"2024-04-23T18:22:38.512421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519528+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:22:38.519528+0000","last_peered":"2024-04-23T18:22:38.519528+0000","last_clean":"2024-04-23T18:22:38.519528+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:22:38.519528+0000","last_undegraded":"2024-04-23T18:22:38.519528+0000","last_fullsized":"2024-04-23T18:22:38.519528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512054+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:22:38.512054+0000","last_peered":"2024-04-23T18:22:38.512054+0000","last_clean":"2024-04-23T18:22:38.512054+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:22:38.512054+0000","last_undegraded":"2024-04-23T18:22:38.512054+0000","last_fullsized":"2024-04-23T18:22:38.512054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519675+0000","last_change":"2024-04-23T18:22:33.397675+0000","last_active":"2024-04-23T18:22:38.519675+0000","last_peered":"2024-04-23T18:22:38.519675+0000","last_clean":"2024-04-23T18:22:38.519675+0000","last_became_active":"2024-04-23T18:22:33.396752+0000","last_became_peered":"2024-04-23T18:22:33.396752+0000","last_unstale":"2024-04-23T18:22:38.519675+0000","last_undegraded":"2024-04-23T18:22:38.519675+0000","last_fullsized":"2024-04-23T18:22:38.519675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:26.022097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875901+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:22:38.875901+0000","last_peered":"2024-04-23T18:22:38.875901+0000","last_clean":"2024-04-23T18:22:38.875901+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:22:38.875901+0000","last_undegraded":"2024-04-23T18:22:38.875901+0000","last_fullsized":"2024-04-23T18:22:38.875901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395896+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:22:38.395896+0000","last_peered":"2024-04-23T18:22:38.395896+0000","last_clean":"2024-04-23T18:22:38.395896+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:22:38.395896+0000","last_undegraded":"2024-04-23T18:22:38.395896+0000","last_fullsized":"2024-04-23T18:22:38.395896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877641+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:22:38.877641+0000","last_peered":"2024-04-23T18:22:38.877641+0000","last_clean":"2024-04-23T18:22:38.877641+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:22:38.877641+0000","last_undegraded":"2024-04-23T18:22:38.877641+0000","last_fullsized":"2024-04-23T18:22:38.877641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394629+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:22:38.394629+0000","last_peered":"2024-04-23T18:22:38.394629+0000","last_clean":"2024-04-23T18:22:38.394629+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:22:38.394629+0000","last_undegraded":"2024-04-23T18:22:38.394629+0000","last_fullsized":"2024-04-23T18:22:38.394629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.521048+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:22:38.521048+0000","last_peered":"2024-04-23T18:22:38.521048+0000","last_clean":"2024-04-23T18:22:38.521048+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:22:38.521048+0000","last_undegraded":"2024-04-23T18:22:38.521048+0000","last_fullsized":"2024-04-23T18:22:38.521048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519224+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:22:38.519224+0000","last_peered":"2024-04-23T18:22:38.519224+0000","last_clean":"2024-04-23T18:22:38.519224+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:22:38.519224+0000","last_undegraded":"2024-04-23T18:22:38.519224+0000","last_fullsized":"2024-04-23T18:22:38.519224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771738+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:22:38.771738+0000","last_peered":"2024-04-23T18:22:38.771738+0000","last_clean":"2024-04-23T18:22:38.771738+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:22:38.771738+0000","last_undegraded":"2024-04-23T18:22:38.771738+0000","last_fullsized":"2024-04-23T18:22:38.771738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875743+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:22:38.875743+0000","last_peered":"2024-04-23T18:22:38.875743+0000","last_clean":"2024-04-23T18:22:38.875743+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:22:38.875743+0000","last_undegraded":"2024-04-23T18:22:38.875743+0000","last_fullsized":"2024-04-23T18:22:38.875743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511902+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:22:38.511902+0000","last_peered":"2024-04-23T18:22:38.511902+0000","last_clean":"2024-04-23T18:22:38.511902+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:22:38.511902+0000","last_undegraded":"2024-04-23T18:22:38.511902+0000","last_fullsized":"2024-04-23T18:22:38.511902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399785+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:22:38.399785+0000","last_peered":"2024-04-23T18:22:38.399785+0000","last_clean":"2024-04-23T18:22:38.399785+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:22:38.399785+0000","last_undegraded":"2024-04-23T18:22:38.399785+0000","last_fullsized":"2024-04-23T18:22:38.399785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396466+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:22:38.396466+0000","last_peered":"2024-04-23T18:22:38.396466+0000","last_clean":"2024-04-23T18:22:38.396466+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:22:38.396466+0000","last_undegraded":"2024-04-23T18:22:38.396466+0000","last_fullsized":"2024-04-23T18:22:38.396466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396387+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:22:38.396387+0000","last_peered":"2024-04-23T18:22:38.396387+0000","last_clean":"2024-04-23T18:22:38.396387+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:22:38.396387+0000","last_undegraded":"2024-04-23T18:22:38.396387+0000","last_fullsized":"2024-04-23T18:22:38.396387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.878029+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:22:38.878029+0000","last_peered":"2024-04-23T18:22:38.878029+0000","last_clean":"2024-04-23T18:22:38.878029+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:22:38.878029+0000","last_undegraded":"2024-04-23T18:22:38.878029+0000","last_fullsized":"2024-04-23T18:22:38.878029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511665+0000","last_change":"2024-04-23T18:22:33.397779+0000","last_active":"2024-04-23T18:22:38.511665+0000","last_peered":"2024-04-23T18:22:38.511665+0000","last_clean":"2024-04-23T18:22:38.511665+0000","last_became_active":"2024-04-23T18:22:33.397476+0000","last_became_peered":"2024-04-23T18:22:33.397476+0000","last_unstale":"2024-04-23T18:22:38.511665+0000","last_undegraded":"2024-04-23T18:22:38.511665+0000","last_fullsized":"2024-04-23T18:22:38.511665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:07.442252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876554+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:22:38.876554+0000","last_peered":"2024-04-23T18:22:38.876554+0000","last_clean":"2024-04-23T18:22:38.876554+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:22:38.876554+0000","last_undegraded":"2024-04-23T18:22:38.876554+0000","last_fullsized":"2024-04-23T18:22:38.876554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519455+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:22:38.519455+0000","last_peered":"2024-04-23T18:22:38.519455+0000","last_clean":"2024-04-23T18:22:38.519455+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:22:38.519455+0000","last_undegraded":"2024-04-23T18:22:38.519455+0000","last_fullsized":"2024-04-23T18:22:38.519455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876554+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:22:38.876554+0000","last_peered":"2024-04-23T18:22:38.876554+0000","last_clean":"2024-04-23T18:22:38.876554+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:22:38.876554+0000","last_undegraded":"2024-04-23T18:22:38.876554+0000","last_fullsized":"2024-04-23T18:22:38.876554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520171+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:22:38.520171+0000","last_peered":"2024-04-23T18:22:38.520171+0000","last_clean":"2024-04-23T18:22:38.520171+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:22:38.520171+0000","last_undegraded":"2024-04-23T18:22:38.520171+0000","last_fullsized":"2024-04-23T18:22:38.520171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876012+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:22:38.876012+0000","last_peered":"2024-04-23T18:22:38.876012+0000","last_clean":"2024-04-23T18:22:38.876012+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:22:38.876012+0000","last_undegraded":"2024-04-23T18:22:38.876012+0000","last_fullsized":"2024-04-23T18:22:38.876012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772513+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:22:38.772513+0000","last_peered":"2024-04-23T18:22:38.772513+0000","last_clean":"2024-04-23T18:22:38.772513+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:22:38.772513+0000","last_undegraded":"2024-04-23T18:22:38.772513+0000","last_fullsized":"2024-04-23T18:22:38.772513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877857+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:22:38.877857+0000","last_peered":"2024-04-23T18:22:38.877857+0000","last_clean":"2024-04-23T18:22:38.877857+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:22:38.877857+0000","last_undegraded":"2024-04-23T18:22:38.877857+0000","last_fullsized":"2024-04-23T18:22:38.877857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:22:58.677 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:22:58.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.856+0000 7f9851400640 1 Processor -- start 2024-04-23T18:22:58.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.856+0000 7f9851400640 1 -- start start 2024-04-23T18:22:58.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9851400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c1518a0 0x7f984c06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9851400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f984c0c8450 0x7f984c0c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9851400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c06cb80 con 0x7f984c15b5a0 2024-04-23T18:22:58.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9851400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f984c0c9320 con 0x7f984c0c8450 2024-04-23T18:22:58.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9851400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f984c06eb70 con 0x7f984c1518a0 2024-04-23T18:22:58.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f984b200640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f984c15b5a0 0x7f984c06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36530/0 (socket says 172.21.15.28:36530) 2024-04-23T18:22:58.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f984b200640 1 -- 172.21.15.28:0/2426053391 learned_addr learned my addr 172.21.15.28:0/2426053391 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:58.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f984a800640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c1518a0 0x7f984c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849e00640 1 --2- 172.21.15.28:0/2426053391 >> v2:172.21.15.137:3300/0 conn(0x7f984c0c8450 0x7f984c0c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129815107 0 0) 0x7f984c06cb80 con 0x7f984c15b5a0 2024-04-23T18:22:58.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9830005740 con 0x7f984c15b5a0 2024-04-23T18:22:58.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2238196719 0 0) 0x7f9830005740 con 0x7f984c15b5a0 2024-04-23T18:22:58.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c1518a0 msgr2=0x7f984c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:58.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c1518a0 0x7f984c06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 >> v2:172.21.15.137:3300/0 conn(0x7f984c0c8450 msgr2=0x7f984c0c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:58.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 --2- 172.21.15.28:0/2426053391 >> v2:172.21.15.137:3300/0 conn(0x7f984c0c8450 0x7f984c0c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984c06c600 con 0x7f984c15b5a0 2024-04-23T18:22:58.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f9844001680 con 0x7f984c15b5a0 2024-04-23T18:22:58.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 >> v1:172.21.15.28:6789/0 conn(0x7f984c15b5a0 legacy=0x7f984c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 0x7f9830006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9830006a20 0x7f9830006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c1518a0 0x7f98300073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f984c0c9320 con 0x7f9830005c00 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f984c06eb70 con 0x7f9830006a20 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f983000dc10 con 0x7f984c1518a0 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f984a800640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 0x7f9830006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f9849e00640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9830006a20 0x7f9830006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f984b200640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c1518a0 0x7f98300073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f984a800640 1 -- 172.21.15.28:0/2426053391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c1518a0 msgr2=0x7f98300073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f984a800640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c1518a0 0x7f98300073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f984a800640 1 -- 172.21.15.28:0/2426053391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9830006a20 msgr2=0x7f9830006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f984a800640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9830006a20 0x7f9830006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.860+0000 7f984a800640 1 -- 172.21.15.28:0/2426053391 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9830005740 con 0x7f9830005c00 2024-04-23T18:22:58.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.864+0000 7f984a800640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 0x7f9830006020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f983c00acb0 tx=0x7f983c01cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90643fd909d1a58 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:58.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.864+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c0ab070 con 0x7f9830005c00 2024-04-23T18:22:58.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.864+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c0a5a90 con 0x7f9830005c00 2024-04-23T18:22:58.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.864+0000 7f9849400640 1 -- 172.21.15.28:0/2426053391 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c00a2c0 con 0x7f9830005c00 2024-04-23T18:22:58.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.864+0000 7f9851400640 1 -- 172.21.15.28:0/2426053391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 msgr2=0x7f9830006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.864+0000 7f9851400640 1 --2- 172.21.15.28:0/2426053391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 0x7f9830006020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f983c00acb0 tx=0x7f983c01cc70 comp rx=0 tx=0).stop 2024-04-23T18:22:58.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.864+0000 7f984b200640 1 -- 172.21.15.28:0/2426053391 reap_dead start 2024-04-23T18:22:58.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.864+0000 7f9851400640 1 -- 172.21.15.28:0/2426053391 shutdown_connections 2024-04-23T18:22:58.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.864+0000 7f9851400640 1 -- 172.21.15.28:0/2426053391 >> 172.21.15.28:0/2426053391 conn(0x7f984c0ccfe0 msgr2=0x7f984c0cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:58.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.864+0000 7f9851400640 1 -- 172.21.15.28:0/2426053391 shutdown_connections 2024-04-23T18:22:58.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.864+0000 7f9851400640 1 -- 172.21.15.28:0/2426053391 wait complete. 2024-04-23T18:22:58.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9851400640 1 Processor -- start 2024-04-23T18:22:58.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9851400640 1 -- start start 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9851400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 0x7f984c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9851400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f984c072cd0 0x7f984c0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9851400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c0c5970 0x7f984c1f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9851400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f984c0c9040 con 0x7f9830005c00 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9851400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f984c0c8d60 con 0x7f984c072cd0 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9851400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f984c15ba10 con 0x7f984c0c5970 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f984a800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 0x7f984c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f984a800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 0x7f984c158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:45840/0 (socket says 172.21.15.28:45840) 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f984a800640 1 -- 172.21.15.28:0/2594427709 learned_addr learned my addr 172.21.15.28:0/2594427709 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f984b200640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c0c5970 0x7f984c1f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9849e00640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f984c072cd0 0x7f984c0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f984a800640 1 -- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c0c5970 msgr2=0x7f984c1f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f984a800640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c0c5970 0x7f984c1f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f984a800640 1 -- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f984c072cd0 msgr2=0x7f984c0c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:58.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f984a800640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f984c072cd0 0x7f984c0c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:58.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f984a800640 1 -- 172.21.15.28:0/2594427709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984c0b16c0 con 0x7f9830005c00 2024-04-23T18:22:58.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f984a800640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 0x7f984c158c40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f983c00acb0 tx=0x7f983c00a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:58.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9842a00640 1 -- 172.21.15.28:0/2594427709 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c0be070 con 0x7f9830005c00 2024-04-23T18:22:58.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9842a00640 1 -- 172.21.15.28:0/2594427709 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c004680 con 0x7f9830005c00 2024-04-23T18:22:58.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9842a00640 1 -- 172.21.15.28:0/2594427709 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c0ab050 con 0x7f9830005c00 2024-04-23T18:22:58.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9851400640 1 -- 172.21.15.28:0/2594427709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f984c0c64b0 con 0x7f9830005c00 2024-04-23T18:22:58.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9851400640 1 -- 172.21.15.28:0/2594427709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f984c0c6a70 con 0x7f9830005c00 2024-04-23T18:22:58.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.868+0000 7f9851400640 1 -- 172.21.15.28:0/2594427709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f984c068cd0 con 0x7f9830005c00 2024-04-23T18:22:58.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.872+0000 7f9842a00640 1 -- 172.21.15.28:0/2594427709 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f983c0c1070 con 0x7f9830005c00 2024-04-23T18:22:58.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.872+0000 7f9842a00640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f982c0683b0 0x7f982c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:58.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.872+0000 7f9842a00640 1 -- 172.21.15.28:0/2594427709 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f983c121630 con 0x7f9830005c00 2024-04-23T18:22:58.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.872+0000 7f9849e00640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f982c0683b0 0x7f982c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:58.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.872+0000 7f9849e00640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f982c0683b0 0x7f982c06a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f984c1509c0 tx=0x7f9838008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:58.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:58.876+0000 7f9842a00640 1 -- 172.21.15.28:0/2594427709 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f983c016980 con 0x7f9830005c00 2024-04-23T18:22:59.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.036+0000 7f9851400640 1 -- 172.21.15.28:0/2594427709 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f984c074490 con 0x7f982c0683b0 2024-04-23T18:22:59.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.060+0000 7f9842a00640 1 -- 172.21.15.28:0/2594427709 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7f984c074490 con 0x7f982c0683b0 2024-04-23T18:22:59.056 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:59.058 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:22:59.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 -- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f982c0683b0 msgr2=0x7f982c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f982c0683b0 0x7f982c06a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f984c1509c0 tx=0x7f9838008040 comp rx=0 tx=0).stop 2024-04-23T18:22:59.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 -- 172.21.15.28:0/2594427709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 msgr2=0x7f984c158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 0x7f984c158c40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f983c00acb0 tx=0x7f983c00a7b0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 -- 172.21.15.28:0/2594427709 shutdown_connections 2024-04-23T18:22:59.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f982c0683b0 0x7f982c06a870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f984c0c5970 0x7f984c1f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f984c072cd0 0x7f984c0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 --2- 172.21.15.28:0/2594427709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9830005c00 0x7f984c158c40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 -- 172.21.15.28:0/2594427709 >> 172.21.15.28:0/2594427709 conn(0x7f984c0ccfe0 msgr2=0x7f984c06da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:59.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 -- 172.21.15.28:0/2594427709 shutdown_connections 2024-04-23T18:22:59.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.064+0000 7f9851400640 1 -- 172.21.15.28:0/2594427709 wait complete. 2024-04-23T18:22:59.077 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-23T18:22:57.328571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227696,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747024,"statfs":{"total":773094113280,"available":772860952576,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005400"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876377+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:22:38.876377+0000","last_peered":"2024-04-23T18:22:38.876377+0000","last_clean":"2024-04-23T18:22:38.876377+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:22:38.876377+0000","last_undegraded":"2024-04-23T18:22:38.876377+0000","last_fullsized":"2024-04-23T18:22:38.876377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512435+0000","last_change":"2024-04-23T18:22:33.374920+0000","last_active":"2024-04-23T18:22:38.512435+0000","last_peered":"2024-04-23T18:22:38.512435+0000","last_clean":"2024-04-23T18:22:38.512435+0000","last_became_active":"2024-04-23T18:22:33.374636+0000","last_became_peered":"2024-04-23T18:22:33.374636+0000","last_unstale":"2024-04-23T18:22:38.512435+0000","last_undegraded":"2024-04-23T18:22:38.512435+0000","last_fullsized":"2024-04-23T18:22:38.512435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:15.638456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511738+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:22:38.511738+0000","last_peered":"2024-04-23T18:22:38.511738+0000","last_clean":"2024-04-23T18:22:38.511738+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:22:38.511738+0000","last_undegraded":"2024-04-23T18:22:38.511738+0000","last_fullsized":"2024-04-23T18:22:38.511738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512559+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:22:38.512559+0000","last_peered":"2024-04-23T18:22:38.512559+0000","last_clean":"2024-04-23T18:22:38.512559+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:22:38.512559+0000","last_undegraded":"2024-04-23T18:22:38.512559+0000","last_fullsized":"2024-04-23T18:22:38.512559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876263+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:22:38.876263+0000","last_peered":"2024-04-23T18:22:38.876263+0000","last_clean":"2024-04-23T18:22:38.876263+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:22:38.876263+0000","last_undegraded":"2024-04-23T18:22:38.876263+0000","last_fullsized":"2024-04-23T18:22:38.876263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398723+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:22:38.398723+0000","last_peered":"2024-04-23T18:22:38.398723+0000","last_clean":"2024-04-23T18:22:38.398723+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:22:38.398723+0000","last_undegraded":"2024-04-23T18:22:38.398723+0000","last_fullsized":"2024-04-23T18:22:38.398723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877548+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:22:38.877548+0000","last_peered":"2024-04-23T18:22:38.877548+0000","last_clean":"2024-04-23T18:22:38.877548+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:22:38.877548+0000","last_undegraded":"2024-04-23T18:22:38.877548+0000","last_fullsized":"2024-04-23T18:22:38.877548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520160+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:22:38.520160+0000","last_peered":"2024-04-23T18:22:38.520160+0000","last_clean":"2024-04-23T18:22:38.520160+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:22:38.520160+0000","last_undegraded":"2024-04-23T18:22:38.520160+0000","last_fullsized":"2024-04-23T18:22:38.520160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399105+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:22:38.399105+0000","last_peered":"2024-04-23T18:22:38.399105+0000","last_clean":"2024-04-23T18:22:38.399105+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:22:38.399105+0000","last_undegraded":"2024-04-23T18:22:38.399105+0000","last_fullsized":"2024-04-23T18:22:38.399105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876812+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:22:38.876812+0000","last_peered":"2024-04-23T18:22:38.876812+0000","last_clean":"2024-04-23T18:22:38.876812+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:22:38.876812+0000","last_undegraded":"2024-04-23T18:22:38.876812+0000","last_fullsized":"2024-04-23T18:22:38.876812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520391+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:22:38.520391+0000","last_peered":"2024-04-23T18:22:38.520391+0000","last_clean":"2024-04-23T18:22:38.520391+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:22:38.520391+0000","last_undegraded":"2024-04-23T18:22:38.520391+0000","last_fullsized":"2024-04-23T18:22:38.520391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399129+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:22:38.399129+0000","last_peered":"2024-04-23T18:22:38.399129+0000","last_clean":"2024-04-23T18:22:38.399129+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:22:38.399129+0000","last_undegraded":"2024-04-23T18:22:38.399129+0000","last_fullsized":"2024-04-23T18:22:38.399129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395366+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:22:38.395366+0000","last_peered":"2024-04-23T18:22:38.395366+0000","last_clean":"2024-04-23T18:22:38.395366+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:22:38.395366+0000","last_undegraded":"2024-04-23T18:22:38.395366+0000","last_fullsized":"2024-04-23T18:22:38.395366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877292+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:22:38.877292+0000","last_peered":"2024-04-23T18:22:38.877292+0000","last_clean":"2024-04-23T18:22:38.877292+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:22:38.877292+0000","last_undegraded":"2024-04-23T18:22:38.877292+0000","last_fullsized":"2024-04-23T18:22:38.877292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400086+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:22:38.400086+0000","last_peered":"2024-04-23T18:22:38.400086+0000","last_clean":"2024-04-23T18:22:38.400086+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:22:38.400086+0000","last_undegraded":"2024-04-23T18:22:38.400086+0000","last_fullsized":"2024-04-23T18:22:38.400086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511999+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:22:38.511999+0000","last_peered":"2024-04-23T18:22:38.511999+0000","last_clean":"2024-04-23T18:22:38.511999+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:22:38.511999+0000","last_undegraded":"2024-04-23T18:22:38.511999+0000","last_fullsized":"2024-04-23T18:22:38.511999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772083+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:22:38.772083+0000","last_peered":"2024-04-23T18:22:38.772083+0000","last_clean":"2024-04-23T18:22:38.772083+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:22:38.772083+0000","last_undegraded":"2024-04-23T18:22:38.772083+0000","last_fullsized":"2024-04-23T18:22:38.772083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399812+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:22:38.399812+0000","last_peered":"2024-04-23T18:22:38.399812+0000","last_clean":"2024-04-23T18:22:38.399812+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:22:38.399812+0000","last_undegraded":"2024-04-23T18:22:38.399812+0000","last_fullsized":"2024-04-23T18:22:38.399812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511898+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:22:38.511898+0000","last_peered":"2024-04-23T18:22:38.511898+0000","last_clean":"2024-04-23T18:22:38.511898+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:22:38.511898+0000","last_undegraded":"2024-04-23T18:22:38.511898+0000","last_fullsized":"2024-04-23T18:22:38.511898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771774+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:22:38.771774+0000","last_peered":"2024-04-23T18:22:38.771774+0000","last_clean":"2024-04-23T18:22:38.771774+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:22:38.771774+0000","last_undegraded":"2024-04-23T18:22:38.771774+0000","last_fullsized":"2024-04-23T18:22:38.771774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772456+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:22:38.772456+0000","last_peered":"2024-04-23T18:22:38.772456+0000","last_clean":"2024-04-23T18:22:38.772456+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:22:38.772456+0000","last_undegraded":"2024-04-23T18:22:38.772456+0000","last_fullsized":"2024-04-23T18:22:38.772456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399139+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:22:38.399139+0000","last_peered":"2024-04-23T18:22:38.399139+0000","last_clean":"2024-04-23T18:22:38.399139+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:22:38.399139+0000","last_undegraded":"2024-04-23T18:22:38.399139+0000","last_fullsized":"2024-04-23T18:22:38.399139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876234+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:22:38.876234+0000","last_peered":"2024-04-23T18:22:38.876234+0000","last_clean":"2024-04-23T18:22:38.876234+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:22:38.876234+0000","last_undegraded":"2024-04-23T18:22:38.876234+0000","last_fullsized":"2024-04-23T18:22:38.876234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400185+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:22:38.400185+0000","last_peered":"2024-04-23T18:22:38.400185+0000","last_clean":"2024-04-23T18:22:38.400185+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:22:38.400185+0000","last_undegraded":"2024-04-23T18:22:38.400185+0000","last_fullsized":"2024-04-23T18:22:38.400185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876309+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:22:38.876309+0000","last_peered":"2024-04-23T18:22:38.876309+0000","last_clean":"2024-04-23T18:22:38.876309+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:22:38.876309+0000","last_undegraded":"2024-04-23T18:22:38.876309+0000","last_fullsized":"2024-04-23T18:22:38.876309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396301+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:22:38.396301+0000","last_peered":"2024-04-23T18:22:38.396301+0000","last_clean":"2024-04-23T18:22:38.396301+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:22:38.396301+0000","last_undegraded":"2024-04-23T18:22:38.396301+0000","last_fullsized":"2024-04-23T18:22:38.396301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399544+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:22:38.399544+0000","last_peered":"2024-04-23T18:22:38.399544+0000","last_clean":"2024-04-23T18:22:38.399544+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:22:38.399544+0000","last_undegraded":"2024-04-23T18:22:38.399544+0000","last_fullsized":"2024-04-23T18:22:38.399544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512524+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:22:38.512524+0000","last_peered":"2024-04-23T18:22:38.512524+0000","last_clean":"2024-04-23T18:22:38.512524+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:22:38.512524+0000","last_undegraded":"2024-04-23T18:22:38.512524+0000","last_fullsized":"2024-04-23T18:22:38.512524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772582+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:22:38.772582+0000","last_peered":"2024-04-23T18:22:38.772582+0000","last_clean":"2024-04-23T18:22:38.772582+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:22:38.772582+0000","last_undegraded":"2024-04-23T18:22:38.772582+0000","last_fullsized":"2024-04-23T18:22:38.772582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511607+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:22:38.511607+0000","last_peered":"2024-04-23T18:22:38.511607+0000","last_clean":"2024-04-23T18:22:38.511607+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:22:38.511607+0000","last_undegraded":"2024-04-23T18:22:38.511607+0000","last_fullsized":"2024-04-23T18:22:38.511607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772268+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:22:38.772268+0000","last_peered":"2024-04-23T18:22:38.772268+0000","last_clean":"2024-04-23T18:22:38.772268+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:22:38.772268+0000","last_undegraded":"2024-04-23T18:22:38.772268+0000","last_fullsized":"2024-04-23T18:22:38.772268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877688+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:22:38.877688+0000","last_peered":"2024-04-23T18:22:38.877688+0000","last_clean":"2024-04-23T18:22:38.877688+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:22:38.877688+0000","last_undegraded":"2024-04-23T18:22:38.877688+0000","last_fullsized":"2024-04-23T18:22:38.877688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875996+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:22:38.875996+0000","last_peered":"2024-04-23T18:22:38.875996+0000","last_clean":"2024-04-23T18:22:38.875996+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:22:38.875996+0000","last_undegraded":"2024-04-23T18:22:38.875996+0000","last_fullsized":"2024-04-23T18:22:38.875996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520638+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:22:38.520638+0000","last_peered":"2024-04-23T18:22:38.520638+0000","last_clean":"2024-04-23T18:22:38.520638+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:22:38.520638+0000","last_undegraded":"2024-04-23T18:22:38.520638+0000","last_fullsized":"2024-04-23T18:22:38.520638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772367+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:22:38.772367+0000","last_peered":"2024-04-23T18:22:38.772367+0000","last_clean":"2024-04-23T18:22:38.772367+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:22:38.772367+0000","last_undegraded":"2024-04-23T18:22:38.772367+0000","last_fullsized":"2024-04-23T18:22:38.772367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771877+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:22:38.771877+0000","last_peered":"2024-04-23T18:22:38.771877+0000","last_clean":"2024-04-23T18:22:38.771877+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:22:38.771877+0000","last_undegraded":"2024-04-23T18:22:38.771877+0000","last_fullsized":"2024-04-23T18:22:38.771877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399411+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:22:38.399411+0000","last_peered":"2024-04-23T18:22:38.399411+0000","last_clean":"2024-04-23T18:22:38.399411+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:22:38.399411+0000","last_undegraded":"2024-04-23T18:22:38.399411+0000","last_fullsized":"2024-04-23T18:22:38.399411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520001+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:22:38.520001+0000","last_peered":"2024-04-23T18:22:38.520001+0000","last_clean":"2024-04-23T18:22:38.520001+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:22:38.520001+0000","last_undegraded":"2024-04-23T18:22:38.520001+0000","last_fullsized":"2024-04-23T18:22:38.520001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772519+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:22:38.772519+0000","last_peered":"2024-04-23T18:22:38.772519+0000","last_clean":"2024-04-23T18:22:38.772519+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:22:38.772519+0000","last_undegraded":"2024-04-23T18:22:38.772519+0000","last_fullsized":"2024-04-23T18:22:38.772519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771764+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:22:38.771764+0000","last_peered":"2024-04-23T18:22:38.771764+0000","last_clean":"2024-04-23T18:22:38.771764+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:22:38.771764+0000","last_undegraded":"2024-04-23T18:22:38.771764+0000","last_fullsized":"2024-04-23T18:22:38.771764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.393983+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:22:38.393983+0000","last_peered":"2024-04-23T18:22:38.393983+0000","last_clean":"2024-04-23T18:22:38.393983+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:22:38.393983+0000","last_undegraded":"2024-04-23T18:22:38.393983+0000","last_fullsized":"2024-04-23T18:22:38.393983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772489+0000","last_change":"2024-04-23T18:22:37.434423+0000","last_active":"2024-04-23T18:22:38.772489+0000","last_peered":"2024-04-23T18:22:38.772489+0000","last_clean":"2024-04-23T18:22:38.772489+0000","last_became_active":"2024-04-23T18:22:37.434030+0000","last_became_peered":"2024-04-23T18:22:37.434030+0000","last_unstale":"2024-04-23T18:22:38.772489+0000","last_undegraded":"2024-04-23T18:22:38.772489+0000","last_fullsized":"2024-04-23T18:22:38.772489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:38:05.642960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875593+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:22:38.875593+0000","last_peered":"2024-04-23T18:22:38.875593+0000","last_clean":"2024-04-23T18:22:38.875593+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:22:38.875593+0000","last_undegraded":"2024-04-23T18:22:38.875593+0000","last_fullsized":"2024-04-23T18:22:38.875593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876234+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:22:38.876234+0000","last_peered":"2024-04-23T18:22:38.876234+0000","last_clean":"2024-04-23T18:22:38.876234+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:22:38.876234+0000","last_undegraded":"2024-04-23T18:22:38.876234+0000","last_fullsized":"2024-04-23T18:22:38.876234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876336+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:22:38.876336+0000","last_peered":"2024-04-23T18:22:38.876336+0000","last_clean":"2024-04-23T18:22:38.876336+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:22:38.876336+0000","last_undegraded":"2024-04-23T18:22:38.876336+0000","last_fullsized":"2024-04-23T18:22:38.876336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511913+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:22:38.511913+0000","last_peered":"2024-04-23T18:22:38.511913+0000","last_clean":"2024-04-23T18:22:38.511913+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:22:38.511913+0000","last_undegraded":"2024-04-23T18:22:38.511913+0000","last_fullsized":"2024-04-23T18:22:38.511913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519892+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:22:38.519892+0000","last_peered":"2024-04-23T18:22:38.519892+0000","last_clean":"2024-04-23T18:22:38.519892+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:22:38.519892+0000","last_undegraded":"2024-04-23T18:22:38.519892+0000","last_fullsized":"2024-04-23T18:22:38.519892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876556+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:22:38.876556+0000","last_peered":"2024-04-23T18:22:38.876556+0000","last_clean":"2024-04-23T18:22:38.876556+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:22:38.876556+0000","last_undegraded":"2024-04-23T18:22:38.876556+0000","last_fullsized":"2024-04-23T18:22:38.876556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396052+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:22:38.396052+0000","last_peered":"2024-04-23T18:22:38.396052+0000","last_clean":"2024-04-23T18:22:38.396052+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:22:38.396052+0000","last_undegraded":"2024-04-23T18:22:38.396052+0000","last_fullsized":"2024-04-23T18:22:38.396052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877306+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:22:38.877306+0000","last_peered":"2024-04-23T18:22:38.877306+0000","last_clean":"2024-04-23T18:22:38.877306+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:22:38.877306+0000","last_undegraded":"2024-04-23T18:22:38.877306+0000","last_fullsized":"2024-04-23T18:22:38.877306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394450+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:22:38.394450+0000","last_peered":"2024-04-23T18:22:38.394450+0000","last_clean":"2024-04-23T18:22:38.394450+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:22:38.394450+0000","last_undegraded":"2024-04-23T18:22:38.394450+0000","last_fullsized":"2024-04-23T18:22:38.394450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395296+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:22:38.395296+0000","last_peered":"2024-04-23T18:22:38.395296+0000","last_clean":"2024-04-23T18:22:38.395296+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:22:38.395296+0000","last_undegraded":"2024-04-23T18:22:38.395296+0000","last_fullsized":"2024-04-23T18:22:38.395296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520463+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:22:38.520463+0000","last_peered":"2024-04-23T18:22:38.520463+0000","last_clean":"2024-04-23T18:22:38.520463+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:22:38.520463+0000","last_undegraded":"2024-04-23T18:22:38.520463+0000","last_fullsized":"2024-04-23T18:22:38.520463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772482+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:22:38.772482+0000","last_peered":"2024-04-23T18:22:38.772482+0000","last_clean":"2024-04-23T18:22:38.772482+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:22:38.772482+0000","last_undegraded":"2024-04-23T18:22:38.772482+0000","last_fullsized":"2024-04-23T18:22:38.772482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876108+0000","last_change":"2024-04-23T18:22:37.422351+0000","last_active":"2024-04-23T18:22:38.876108+0000","last_peered":"2024-04-23T18:22:38.876108+0000","last_clean":"2024-04-23T18:22:38.876108+0000","last_became_active":"2024-04-23T18:22:37.421745+0000","last_became_peered":"2024-04-23T18:22:37.421745+0000","last_unstale":"2024-04-23T18:22:38.876108+0000","last_undegraded":"2024-04-23T18:22:38.876108+0000","last_fullsized":"2024-04-23T18:22:38.876108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:43.074101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.878109+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:22:38.878109+0000","last_peered":"2024-04-23T18:22:38.878109+0000","last_clean":"2024-04-23T18:22:38.878109+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:22:38.878109+0000","last_undegraded":"2024-04-23T18:22:38.878109+0000","last_fullsized":"2024-04-23T18:22:38.878109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394651+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:22:38.394651+0000","last_peered":"2024-04-23T18:22:38.394651+0000","last_clean":"2024-04-23T18:22:38.394651+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:22:38.394651+0000","last_undegraded":"2024-04-23T18:22:38.394651+0000","last_fullsized":"2024-04-23T18:22:38.394651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519385+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:22:38.519385+0000","last_peered":"2024-04-23T18:22:38.519385+0000","last_clean":"2024-04-23T18:22:38.519385+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:22:38.519385+0000","last_undegraded":"2024-04-23T18:22:38.519385+0000","last_fullsized":"2024-04-23T18:22:38.519385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877267+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:22:38.877267+0000","last_peered":"2024-04-23T18:22:38.877267+0000","last_clean":"2024-04-23T18:22:38.877267+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:22:38.877267+0000","last_undegraded":"2024-04-23T18:22:38.877267+0000","last_fullsized":"2024-04-23T18:22:38.877267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400190+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:22:38.400190+0000","last_peered":"2024-04-23T18:22:38.400190+0000","last_clean":"2024-04-23T18:22:38.400190+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:22:38.400190+0000","last_undegraded":"2024-04-23T18:22:38.400190+0000","last_fullsized":"2024-04-23T18:22:38.400190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398668+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:22:38.398668+0000","last_peered":"2024-04-23T18:22:38.398668+0000","last_clean":"2024-04-23T18:22:38.398668+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:22:38.398668+0000","last_undegraded":"2024-04-23T18:22:38.398668+0000","last_fullsized":"2024-04-23T18:22:38.398668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876669+0000","last_change":"2024-04-23T18:22:33.407067+0000","last_active":"2024-04-23T18:22:38.876669+0000","last_peered":"2024-04-23T18:22:38.876669+0000","last_clean":"2024-04-23T18:22:38.876669+0000","last_became_active":"2024-04-23T18:22:33.406727+0000","last_became_peered":"2024-04-23T18:22:33.406727+0000","last_unstale":"2024-04-23T18:22:38.876669+0000","last_undegraded":"2024-04-23T18:22:38.876669+0000","last_fullsized":"2024-04-23T18:22:38.876669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:21:04.444047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.393876+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:22:38.393876+0000","last_peered":"2024-04-23T18:22:38.393876+0000","last_clean":"2024-04-23T18:22:38.393876+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:22:38.393876+0000","last_undegraded":"2024-04-23T18:22:38.393876+0000","last_fullsized":"2024-04-23T18:22:38.393876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876191+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:22:38.876191+0000","last_peered":"2024-04-23T18:22:38.876191+0000","last_clean":"2024-04-23T18:22:38.876191+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:22:38.876191+0000","last_undegraded":"2024-04-23T18:22:38.876191+0000","last_fullsized":"2024-04-23T18:22:38.876191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395264+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:22:38.395264+0000","last_peered":"2024-04-23T18:22:38.395264+0000","last_clean":"2024-04-23T18:22:38.395264+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:22:38.395264+0000","last_undegraded":"2024-04-23T18:22:38.395264+0000","last_fullsized":"2024-04-23T18:22:38.395264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395402+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:22:38.395402+0000","last_peered":"2024-04-23T18:22:38.395402+0000","last_clean":"2024-04-23T18:22:38.395402+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:22:38.395402+0000","last_undegraded":"2024-04-23T18:22:38.395402+0000","last_fullsized":"2024-04-23T18:22:38.395402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512523+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:22:38.512523+0000","last_peered":"2024-04-23T18:22:38.512523+0000","last_clean":"2024-04-23T18:22:38.512523+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:22:38.512523+0000","last_undegraded":"2024-04-23T18:22:38.512523+0000","last_fullsized":"2024-04-23T18:22:38.512523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877129+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:22:38.877129+0000","last_peered":"2024-04-23T18:22:38.877129+0000","last_clean":"2024-04-23T18:22:38.877129+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:22:38.877129+0000","last_undegraded":"2024-04-23T18:22:38.877129+0000","last_fullsized":"2024-04-23T18:22:38.877129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519934+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:22:38.519934+0000","last_peered":"2024-04-23T18:22:38.519934+0000","last_clean":"2024-04-23T18:22:38.519934+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:22:38.519934+0000","last_undegraded":"2024-04-23T18:22:38.519934+0000","last_fullsized":"2024-04-23T18:22:38.519934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512108+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:22:38.512108+0000","last_peered":"2024-04-23T18:22:38.512108+0000","last_clean":"2024-04-23T18:22:38.512108+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:22:38.512108+0000","last_undegraded":"2024-04-23T18:22:38.512108+0000","last_fullsized":"2024-04-23T18:22:38.512108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875754+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:22:38.875754+0000","last_peered":"2024-04-23T18:22:38.875754+0000","last_clean":"2024-04-23T18:22:38.875754+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:22:38.875754+0000","last_undegraded":"2024-04-23T18:22:38.875754+0000","last_fullsized":"2024-04-23T18:22:38.875754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876177+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:22:38.876177+0000","last_peered":"2024-04-23T18:22:38.876177+0000","last_clean":"2024-04-23T18:22:38.876177+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:22:38.876177+0000","last_undegraded":"2024-04-23T18:22:38.876177+0000","last_fullsized":"2024-04-23T18:22:38.876177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520575+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:22:38.520575+0000","last_peered":"2024-04-23T18:22:38.520575+0000","last_clean":"2024-04-23T18:22:38.520575+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:22:38.520575+0000","last_undegraded":"2024-04-23T18:22:38.520575+0000","last_fullsized":"2024-04-23T18:22:38.520575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877083+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:22:38.877083+0000","last_peered":"2024-04-23T18:22:38.877083+0000","last_clean":"2024-04-23T18:22:38.877083+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:22:38.877083+0000","last_undegraded":"2024-04-23T18:22:38.877083+0000","last_fullsized":"2024-04-23T18:22:38.877083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:48.087550+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:22:48.087550+0000","last_peered":"2024-04-23T18:22:48.087550+0000","last_clean":"2024-04-23T18:22:48.087550+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:22:48.087550+0000","last_undegraded":"2024-04-23T18:22:48.087550+0000","last_fullsized":"2024-04-23T18:22:48.087550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772018+0000","last_change":"2024-04-23T18:22:37.423270+0000","last_active":"2024-04-23T18:22:38.772018+0000","last_peered":"2024-04-23T18:22:38.772018+0000","last_clean":"2024-04-23T18:22:38.772018+0000","last_became_active":"2024-04-23T18:22:37.422847+0000","last_became_peered":"2024-04-23T18:22:37.422847+0000","last_unstale":"2024-04-23T18:22:38.772018+0000","last_undegraded":"2024-04-23T18:22:38.772018+0000","last_fullsized":"2024-04-23T18:22:38.772018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:42.248011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399891+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:22:38.399891+0000","last_peered":"2024-04-23T18:22:38.399891+0000","last_clean":"2024-04-23T18:22:38.399891+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:22:38.399891+0000","last_undegraded":"2024-04-23T18:22:38.399891+0000","last_fullsized":"2024-04-23T18:22:38.399891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772372+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:22:38.772372+0000","last_peered":"2024-04-23T18:22:38.772372+0000","last_clean":"2024-04-23T18:22:38.772372+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:22:38.772372+0000","last_undegraded":"2024-04-23T18:22:38.772372+0000","last_fullsized":"2024-04-23T18:22:38.772372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399340+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:22:38.399340+0000","last_peered":"2024-04-23T18:22:38.399340+0000","last_clean":"2024-04-23T18:22:38.399340+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:22:38.399340+0000","last_undegraded":"2024-04-23T18:22:38.399340+0000","last_fullsized":"2024-04-23T18:22:38.399340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876364+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:22:38.876364+0000","last_peered":"2024-04-23T18:22:38.876364+0000","last_clean":"2024-04-23T18:22:38.876364+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:22:38.876364+0000","last_undegraded":"2024-04-23T18:22:38.876364+0000","last_fullsized":"2024-04-23T18:22:38.876364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520722+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:22:38.520722+0000","last_peered":"2024-04-23T18:22:38.520722+0000","last_clean":"2024-04-23T18:22:38.520722+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:22:38.520722+0000","last_undegraded":"2024-04-23T18:22:38.520722+0000","last_fullsized":"2024-04-23T18:22:38.520722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511802+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:22:38.511802+0000","last_peered":"2024-04-23T18:22:38.511802+0000","last_clean":"2024-04-23T18:22:38.511802+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:22:38.511802+0000","last_undegraded":"2024-04-23T18:22:38.511802+0000","last_fullsized":"2024-04-23T18:22:38.511802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520447+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:22:38.520447+0000","last_peered":"2024-04-23T18:22:38.520447+0000","last_clean":"2024-04-23T18:22:38.520447+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:22:38.520447+0000","last_undegraded":"2024-04-23T18:22:38.520447+0000","last_fullsized":"2024-04-23T18:22:38.520447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396160+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:22:38.396160+0000","last_peered":"2024-04-23T18:22:38.396160+0000","last_clean":"2024-04-23T18:22:38.396160+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:22:38.396160+0000","last_undegraded":"2024-04-23T18:22:38.396160+0000","last_fullsized":"2024-04-23T18:22:38.396160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511805+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:22:38.511805+0000","last_peered":"2024-04-23T18:22:38.511805+0000","last_clean":"2024-04-23T18:22:38.511805+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:22:38.511805+0000","last_undegraded":"2024-04-23T18:22:38.511805+0000","last_fullsized":"2024-04-23T18:22:38.511805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876162+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:22:38.876162+0000","last_peered":"2024-04-23T18:22:38.876162+0000","last_clean":"2024-04-23T18:22:38.876162+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:22:38.876162+0000","last_undegraded":"2024-04-23T18:22:38.876162+0000","last_fullsized":"2024-04-23T18:22:38.876162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771668+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:22:38.771668+0000","last_peered":"2024-04-23T18:22:38.771668+0000","last_clean":"2024-04-23T18:22:38.771668+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:22:38.771668+0000","last_undegraded":"2024-04-23T18:22:38.771668+0000","last_fullsized":"2024-04-23T18:22:38.771668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519583+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:22:38.519583+0000","last_peered":"2024-04-23T18:22:38.519583+0000","last_clean":"2024-04-23T18:22:38.519583+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:22:38.519583+0000","last_undegraded":"2024-04-23T18:22:38.519583+0000","last_fullsized":"2024-04-23T18:22:38.519583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396141+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:22:38.396141+0000","last_peered":"2024-04-23T18:22:38.396141+0000","last_clean":"2024-04-23T18:22:38.396141+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:22:38.396141+0000","last_undegraded":"2024-04-23T18:22:38.396141+0000","last_fullsized":"2024-04-23T18:22:38.396141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511775+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:22:38.511775+0000","last_peered":"2024-04-23T18:22:38.511775+0000","last_clean":"2024-04-23T18:22:38.511775+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:22:38.511775+0000","last_undegraded":"2024-04-23T18:22:38.511775+0000","last_fullsized":"2024-04-23T18:22:38.511775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511945+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:22:38.511945+0000","last_peered":"2024-04-23T18:22:38.511945+0000","last_clean":"2024-04-23T18:22:38.511945+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:22:38.511945+0000","last_undegraded":"2024-04-23T18:22:38.511945+0000","last_fullsized":"2024-04-23T18:22:38.511945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395587+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:22:38.395587+0000","last_peered":"2024-04-23T18:22:38.395587+0000","last_clean":"2024-04-23T18:22:38.395587+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:22:38.395587+0000","last_undegraded":"2024-04-23T18:22:38.395587+0000","last_fullsized":"2024-04-23T18:22:38.395587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876159+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:22:38.876159+0000","last_peered":"2024-04-23T18:22:38.876159+0000","last_clean":"2024-04-23T18:22:38.876159+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:22:38.876159+0000","last_undegraded":"2024-04-23T18:22:38.876159+0000","last_fullsized":"2024-04-23T18:22:38.876159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394359+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:22:38.394359+0000","last_peered":"2024-04-23T18:22:38.394359+0000","last_clean":"2024-04-23T18:22:38.394359+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:22:38.394359+0000","last_undegraded":"2024-04-23T18:22:38.394359+0000","last_fullsized":"2024-04-23T18:22:38.394359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512130+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:22:38.512130+0000","last_peered":"2024-04-23T18:22:38.512130+0000","last_clean":"2024-04-23T18:22:38.512130+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:22:38.512130+0000","last_undegraded":"2024-04-23T18:22:38.512130+0000","last_fullsized":"2024-04-23T18:22:38.512130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398922+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:22:38.398922+0000","last_peered":"2024-04-23T18:22:38.398922+0000","last_clean":"2024-04-23T18:22:38.398922+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:22:38.398922+0000","last_undegraded":"2024-04-23T18:22:38.398922+0000","last_fullsized":"2024-04-23T18:22:38.398922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512357+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:22:38.512357+0000","last_peered":"2024-04-23T18:22:38.512357+0000","last_clean":"2024-04-23T18:22:38.512357+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:22:38.512357+0000","last_undegraded":"2024-04-23T18:22:38.512357+0000","last_fullsized":"2024-04-23T18:22:38.512357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395074+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:22:38.395074+0000","last_peered":"2024-04-23T18:22:38.395074+0000","last_clean":"2024-04-23T18:22:38.395074+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:22:38.395074+0000","last_undegraded":"2024-04-23T18:22:38.395074+0000","last_fullsized":"2024-04-23T18:22:38.395074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.393976+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:22:38.393976+0000","last_peered":"2024-04-23T18:22:38.393976+0000","last_clean":"2024-04-23T18:22:38.393976+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:22:38.393976+0000","last_undegraded":"2024-04-23T18:22:38.393976+0000","last_fullsized":"2024-04-23T18:22:38.393976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519749+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:22:38.519749+0000","last_peered":"2024-04-23T18:22:38.519749+0000","last_clean":"2024-04-23T18:22:38.519749+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:22:38.519749+0000","last_undegraded":"2024-04-23T18:22:38.519749+0000","last_fullsized":"2024-04-23T18:22:38.519749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876029+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:22:38.876029+0000","last_peered":"2024-04-23T18:22:38.876029+0000","last_clean":"2024-04-23T18:22:38.876029+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:22:38.876029+0000","last_undegraded":"2024-04-23T18:22:38.876029+0000","last_fullsized":"2024-04-23T18:22:38.876029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512257+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:22:38.512257+0000","last_peered":"2024-04-23T18:22:38.512257+0000","last_clean":"2024-04-23T18:22:38.512257+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:22:38.512257+0000","last_undegraded":"2024-04-23T18:22:38.512257+0000","last_fullsized":"2024-04-23T18:22:38.512257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772250+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:22:38.772250+0000","last_peered":"2024-04-23T18:22:38.772250+0000","last_clean":"2024-04-23T18:22:38.772250+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:22:38.772250+0000","last_undegraded":"2024-04-23T18:22:38.772250+0000","last_fullsized":"2024-04-23T18:22:38.772250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396520+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:22:38.396520+0000","last_peered":"2024-04-23T18:22:38.396520+0000","last_clean":"2024-04-23T18:22:38.396520+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:22:38.396520+0000","last_undegraded":"2024-04-23T18:22:38.396520+0000","last_fullsized":"2024-04-23T18:22:38.396520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512421+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:22:38.512421+0000","last_peered":"2024-04-23T18:22:38.512421+0000","last_clean":"2024-04-23T18:22:38.512421+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:22:38.512421+0000","last_undegraded":"2024-04-23T18:22:38.512421+0000","last_fullsized":"2024-04-23T18:22:38.512421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519528+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:22:38.519528+0000","last_peered":"2024-04-23T18:22:38.519528+0000","last_clean":"2024-04-23T18:22:38.519528+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:22:38.519528+0000","last_undegraded":"2024-04-23T18:22:38.519528+0000","last_fullsized":"2024-04-23T18:22:38.519528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512054+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:22:38.512054+0000","last_peered":"2024-04-23T18:22:38.512054+0000","last_clean":"2024-04-23T18:22:38.512054+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:22:38.512054+0000","last_undegraded":"2024-04-23T18:22:38.512054+0000","last_fullsized":"2024-04-23T18:22:38.512054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519675+0000","last_change":"2024-04-23T18:22:33.397675+0000","last_active":"2024-04-23T18:22:38.519675+0000","last_peered":"2024-04-23T18:22:38.519675+0000","last_clean":"2024-04-23T18:22:38.519675+0000","last_became_active":"2024-04-23T18:22:33.396752+0000","last_became_peered":"2024-04-23T18:22:33.396752+0000","last_unstale":"2024-04-23T18:22:38.519675+0000","last_undegraded":"2024-04-23T18:22:38.519675+0000","last_fullsized":"2024-04-23T18:22:38.519675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:26.022097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875901+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:22:38.875901+0000","last_peered":"2024-04-23T18:22:38.875901+0000","last_clean":"2024-04-23T18:22:38.875901+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:22:38.875901+0000","last_undegraded":"2024-04-23T18:22:38.875901+0000","last_fullsized":"2024-04-23T18:22:38.875901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395896+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:22:38.395896+0000","last_peered":"2024-04-23T18:22:38.395896+0000","last_clean":"2024-04-23T18:22:38.395896+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:22:38.395896+0000","last_undegraded":"2024-04-23T18:22:38.395896+0000","last_fullsized":"2024-04-23T18:22:38.395896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877641+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:22:38.877641+0000","last_peered":"2024-04-23T18:22:38.877641+0000","last_clean":"2024-04-23T18:22:38.877641+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:22:38.877641+0000","last_undegraded":"2024-04-23T18:22:38.877641+0000","last_fullsized":"2024-04-23T18:22:38.877641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394629+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:22:38.394629+0000","last_peered":"2024-04-23T18:22:38.394629+0000","last_clean":"2024-04-23T18:22:38.394629+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:22:38.394629+0000","last_undegraded":"2024-04-23T18:22:38.394629+0000","last_fullsized":"2024-04-23T18:22:38.394629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.521048+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:22:38.521048+0000","last_peered":"2024-04-23T18:22:38.521048+0000","last_clean":"2024-04-23T18:22:38.521048+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:22:38.521048+0000","last_undegraded":"2024-04-23T18:22:38.521048+0000","last_fullsized":"2024-04-23T18:22:38.521048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519224+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:22:38.519224+0000","last_peered":"2024-04-23T18:22:38.519224+0000","last_clean":"2024-04-23T18:22:38.519224+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:22:38.519224+0000","last_undegraded":"2024-04-23T18:22:38.519224+0000","last_fullsized":"2024-04-23T18:22:38.519224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771738+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:22:38.771738+0000","last_peered":"2024-04-23T18:22:38.771738+0000","last_clean":"2024-04-23T18:22:38.771738+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:22:38.771738+0000","last_undegraded":"2024-04-23T18:22:38.771738+0000","last_fullsized":"2024-04-23T18:22:38.771738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875743+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:22:38.875743+0000","last_peered":"2024-04-23T18:22:38.875743+0000","last_clean":"2024-04-23T18:22:38.875743+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:22:38.875743+0000","last_undegraded":"2024-04-23T18:22:38.875743+0000","last_fullsized":"2024-04-23T18:22:38.875743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511902+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:22:38.511902+0000","last_peered":"2024-04-23T18:22:38.511902+0000","last_clean":"2024-04-23T18:22:38.511902+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:22:38.511902+0000","last_undegraded":"2024-04-23T18:22:38.511902+0000","last_fullsized":"2024-04-23T18:22:38.511902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399785+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:22:38.399785+0000","last_peered":"2024-04-23T18:22:38.399785+0000","last_clean":"2024-04-23T18:22:38.399785+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:22:38.399785+0000","last_undegraded":"2024-04-23T18:22:38.399785+0000","last_fullsized":"2024-04-23T18:22:38.399785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396466+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:22:38.396466+0000","last_peered":"2024-04-23T18:22:38.396466+0000","last_clean":"2024-04-23T18:22:38.396466+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:22:38.396466+0000","last_undegraded":"2024-04-23T18:22:38.396466+0000","last_fullsized":"2024-04-23T18:22:38.396466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396387+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:22:38.396387+0000","last_peered":"2024-04-23T18:22:38.396387+0000","last_clean":"2024-04-23T18:22:38.396387+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:22:38.396387+0000","last_undegraded":"2024-04-23T18:22:38.396387+0000","last_fullsized":"2024-04-23T18:22:38.396387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.878029+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:22:38.878029+0000","last_peered":"2024-04-23T18:22:38.878029+0000","last_clean":"2024-04-23T18:22:38.878029+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:22:38.878029+0000","last_undegraded":"2024-04-23T18:22:38.878029+0000","last_fullsized":"2024-04-23T18:22:38.878029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511665+0000","last_change":"2024-04-23T18:22:33.397779+0000","last_active":"2024-04-23T18:22:38.511665+0000","last_peered":"2024-04-23T18:22:38.511665+0000","last_clean":"2024-04-23T18:22:38.511665+0000","last_became_active":"2024-04-23T18:22:33.397476+0000","last_became_peered":"2024-04-23T18:22:33.397476+0000","last_unstale":"2024-04-23T18:22:38.511665+0000","last_undegraded":"2024-04-23T18:22:38.511665+0000","last_fullsized":"2024-04-23T18:22:38.511665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:07.442252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876554+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:22:38.876554+0000","last_peered":"2024-04-23T18:22:38.876554+0000","last_clean":"2024-04-23T18:22:38.876554+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:22:38.876554+0000","last_undegraded":"2024-04-23T18:22:38.876554+0000","last_fullsized":"2024-04-23T18:22:38.876554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519455+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:22:38.519455+0000","last_peered":"2024-04-23T18:22:38.519455+0000","last_clean":"2024-04-23T18:22:38.519455+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:22:38.519455+0000","last_undegraded":"2024-04-23T18:22:38.519455+0000","last_fullsized":"2024-04-23T18:22:38.519455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876554+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:22:38.876554+0000","last_peered":"2024-04-23T18:22:38.876554+0000","last_clean":"2024-04-23T18:22:38.876554+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:22:38.876554+0000","last_undegraded":"2024-04-23T18:22:38.876554+0000","last_fullsized":"2024-04-23T18:22:38.876554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520171+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:22:38.520171+0000","last_peered":"2024-04-23T18:22:38.520171+0000","last_clean":"2024-04-23T18:22:38.520171+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:22:38.520171+0000","last_undegraded":"2024-04-23T18:22:38.520171+0000","last_fullsized":"2024-04-23T18:22:38.520171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876012+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:22:38.876012+0000","last_peered":"2024-04-23T18:22:38.876012+0000","last_clean":"2024-04-23T18:22:38.876012+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:22:38.876012+0000","last_undegraded":"2024-04-23T18:22:38.876012+0000","last_fullsized":"2024-04-23T18:22:38.876012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772513+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:22:38.772513+0000","last_peered":"2024-04-23T18:22:38.772513+0000","last_clean":"2024-04-23T18:22:38.772513+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:22:38.772513+0000","last_undegraded":"2024-04-23T18:22:38.772513+0000","last_fullsized":"2024-04-23T18:22:38.772513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877857+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:22:38.877857+0000","last_peered":"2024-04-23T18:22:38.877857+0000","last_clean":"2024-04-23T18:22:38.877857+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:22:38.877857+0000","last_undegraded":"2024-04-23T18:22:38.877857+0000","last_fullsized":"2024-04-23T18:22:38.877857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:22:59.082 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-23T18:22:59.083 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-23T18:22:59.083 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-23T18:22:59.083 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-23T18:22:59.083 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-23T18:22:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.264+0000 7f0b85200640 1 Processor -- start 2024-04-23T18:22:59.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.264+0000 7f0b85200640 1 -- start start 2024-04-23T18:22:59.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b85200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b80072080 0x7f0b800718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:59.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b85200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b800c9de0 con 0x7f0b80152370 2024-04-23T18:22:59.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b85200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b80158cf0 con 0x7f0b80151f90 2024-04-23T18:22:59.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b85200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0b800ca080 con 0x7f0b80072080 2024-04-23T18:22:59.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b7e800640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0b80152370 0x7f0b800c81d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58568/0 (socket says 172.21.15.28:58568) 2024-04-23T18:22:59.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b7e800640 1 -- 172.21.15.28:0/3641320027 learned_addr learned my addr 172.21.15.28:0/3641320027 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:22:59.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b75400640 1 --2- 172.21.15.28:0/3641320027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b80072080 0x7f0b800718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:59.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b7d400640 1 -- 172.21.15.28:0/3641320027 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4135317293 0 0) 0x7f0b800c9de0 con 0x7f0b80152370 2024-04-23T18:22:59.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b7d400640 1 -- 172.21.15.28:0/3641320027 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b64005740 con 0x7f0b80152370 2024-04-23T18:22:59.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b7d400640 1 -- 172.21.15.28:0/3641320027 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2148278857 0 0) 0x7f0b80158cf0 con 0x7f0b80151f90 2024-04-23T18:22:59.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b75400640 1 -- 172.21.15.28:0/3641320027 >> v1:172.21.15.137:6789/0 conn(0x7f0b80151f90 legacy=0x7f0b8015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b75400640 1 -- 172.21.15.28:0/3641320027 >> v1:172.21.15.28:6789/0 conn(0x7f0b80152370 legacy=0x7f0b800c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.268+0000 7f0b75400640 1 -- 172.21.15.28:0/3641320027 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b80157f30 con 0x7f0b80072080 2024-04-23T18:22:59.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b75400640 1 --2- 172.21.15.28:0/3641320027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b80072080 0x7f0b800718d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097f0 tx=0x7f0b6801ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c1e63f70df19f13 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:59.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b7d400640 1 -- 172.21.15.28:0/3641320027 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b680b5070 con 0x7f0b80072080 2024-04-23T18:22:59.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b7d400640 1 -- 172.21.15.28:0/3641320027 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b680a89d0 con 0x7f0b80072080 2024-04-23T18:22:59.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b7d400640 1 -- 172.21.15.28:0/3641320027 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b680a8d80 con 0x7f0b80072080 2024-04-23T18:22:59.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b85200640 1 -- 172.21.15.28:0/3641320027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b80072080 msgr2=0x7f0b800718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b85200640 1 --2- 172.21.15.28:0/3641320027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b80072080 0x7f0b800718d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097f0 tx=0x7f0b6801ecd0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b85200640 1 -- 172.21.15.28:0/3641320027 shutdown_connections 2024-04-23T18:22:59.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b85200640 1 --2- 172.21.15.28:0/3641320027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b80072080 0x7f0b800718d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b85200640 1 -- 172.21.15.28:0/3641320027 >> 172.21.15.28:0/3641320027 conn(0x7f0b8006d0a0 msgr2=0x7f0b800676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:59.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b85200640 1 -- 172.21.15.28:0/3641320027 shutdown_connections 2024-04-23T18:22:59.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b85200640 1 -- 172.21.15.28:0/3641320027 wait complete. 2024-04-23T18:22:59.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b85200640 1 Processor -- start 2024-04-23T18:22:59.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.272+0000 7f0b85200640 1 -- start start 2024-04-23T18:22:59.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b85200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b80072080 0x7f0b800c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:59.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b85200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b80151f90 0x7f0b8014dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:59.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b85200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80152370 0x7f0b8014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:59.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b85200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b801587d0 con 0x7f0b80072080 2024-04-23T18:22:59.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b85200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b801584f0 con 0x7f0b80152370 2024-04-23T18:22:59.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b85200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8015baa0 con 0x7f0b80151f90 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b7de00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b80072080 0x7f0b800c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b7de00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b80072080 0x7f0b800c7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40840/0 (socket says 172.21.15.28:40840) 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b7de00640 1 -- 172.21.15.28:0/1991414921 learned_addr learned my addr 172.21.15.28:0/1991414921 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b75400640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b80151f90 0x7f0b8014dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b7e800640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80152370 0x7f0b8014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b7de00640 1 -- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b80151f90 msgr2=0x7f0b8014dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b7de00640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b80151f90 0x7f0b8014dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b7de00640 1 -- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80152370 msgr2=0x7f0b8014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b7de00640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80152370 0x7f0b8014e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b7de00640 1 -- 172.21.15.28:0/1991414921 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b800c3450 con 0x7f0b80072080 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b7e800640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80152370 0x7f0b8014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:22:59.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b7de00640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b80072080 0x7f0b800c7010 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b70001570 tx=0x7f0b7000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:59.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b76a00640 1 -- 172.21.15.28:0/1991414921 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70017070 con 0x7f0b80072080 2024-04-23T18:22:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b76a00640 1 -- 172.21.15.28:0/1991414921 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b70003db0 con 0x7f0b80072080 2024-04-23T18:22:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b76a00640 1 -- 172.21.15.28:0/1991414921 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b700052b0 con 0x7f0b80072080 2024-04-23T18:22:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b85200640 1 -- 172.21.15.28:0/1991414921 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b801553b0 con 0x7f0b80072080 2024-04-23T18:22:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b85200640 1 -- 172.21.15.28:0/1991414921 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b801f0fa0 con 0x7f0b80072080 2024-04-23T18:22:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b85200640 1 -- 172.21.15.28:0/1991414921 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b80068cd0 con 0x7f0b80072080 2024-04-23T18:22:59.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.276+0000 7f0b76a00640 1 -- 172.21.15.28:0/1991414921 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0b7001a070 con 0x7f0b80072080 2024-04-23T18:22:59.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.280+0000 7f0b76a00640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b5c068380 0x7f0b5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:59.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.280+0000 7f0b76a00640 1 -- 172.21.15.28:0/1991414921 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0b700863a0 con 0x7f0b80072080 2024-04-23T18:22:59.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.280+0000 7f0b75400640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b5c068380 0x7f0b5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:59.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.280+0000 7f0b75400640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b5c068380 0x7f0b5c06a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0b680b2000 tx=0x7f0b680aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:59.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.284+0000 7f0b76a00640 1 -- 172.21.15.28:0/1991414921 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b801553b0 con 0x7f0b80072080 2024-04-23T18:22:59.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.488+0000 7f0b85200640 1 -- 172.21.15.28:0/1991414921 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0b80071b90 con 0x7f0b80072080 2024-04-23T18:22:59.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.492+0000 7f0b76a00640 1 -- 172.21.15.28:0/1991414921 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168089 (secure 0 0 0) 0x7f0b70055f40 con 0x7f0b80072080 2024-04-23T18:22:59.487 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 -- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b5c068380 msgr2=0x7f0b5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b5c068380 0x7f0b5c06a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0b680b2000 tx=0x7f0b680aa070 comp rx=0 tx=0).stop 2024-04-23T18:22:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 -- 172.21.15.28:0/1991414921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b80072080 msgr2=0x7f0b800c7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b80072080 0x7f0b800c7010 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b70001570 tx=0x7f0b7000cd00 comp rx=0 tx=0).stop 2024-04-23T18:22:59.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 -- 172.21.15.28:0/1991414921 shutdown_connections 2024-04-23T18:22:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b5c068380 0x7f0b5c06a840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0b80151f90 0x7f0b8014dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80152370 0x7f0b8014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 --2- 172.21.15.28:0/1991414921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b80072080 0x7f0b800c7010 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 -- 172.21.15.28:0/1991414921 >> 172.21.15.28:0/1991414921 conn(0x7f0b8006d0a0 msgr2=0x7f0b801514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 -- 172.21.15.28:0/1991414921 shutdown_connections 2024-04-23T18:22:59.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.496+0000 7f0b85200640 1 -- 172.21.15.28:0/1991414921 wait complete. 2024-04-23T18:22:59.509 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":5,"flags":0,"active_gid":4114,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2489193639},{"type":"v1","addr":"172.21.15.137:6833","nonce":2489193639}]},"active_addr":"172.21.15.137:6833/2489193639","active_change":"2024-04-23T18:22:13.307908+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4122,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":812105221}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1062452819}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":488577337}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":219980887}]}]} 2024-04-23T18:22:59.512 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-23T18:22:59.512 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-23T18:22:59.513 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:59.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3ee400640 1 Processor -- start 2024-04-23T18:22:59.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3ee400640 1 -- start start 2024-04-23T18:22:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3ee400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd3e8152230 0x7fd3e80cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3ee400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e8071d10 0x7fd3e80cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3ee400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e8158ef0 con 0x7fd3e80c8740 2024-04-23T18:22:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3ee400640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e815b580 con 0x7fd3e8152230 2024-04-23T18:22:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3ee400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e80c95d0 con 0x7fd3e8071d10 2024-04-23T18:22:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3e7400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd3e8152230 0x7fd3e80cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3e7400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd3e8152230 0x7fd3e80cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40854/0 (socket says 172.21.15.28:40854) 2024-04-23T18:22:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3e7400640 1 -- 172.21.15.28:0/3837151097 learned_addr learned my addr 172.21.15.28:0/3837151097 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:59.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3dfe00640 1 --2- 172.21.15.28:0/3837151097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e8071d10 0x7fd3e80cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:59.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3e7400640 1 -- 172.21.15.28:0/3837151097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e8071d10 msgr2=0x7fd3e80cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:22:59.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3e7400640 1 --2- 172.21.15.28:0/3837151097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e8071d10 0x7fd3e80cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3e7400640 1 -- 172.21.15.28:0/3837151097 >> v1:172.21.15.28:6789/0 conn(0x7fd3e80c8740 legacy=0x7fd3e815ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3e7400640 1 -- 172.21.15.28:0/3837151097 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e8158c10 con 0x7fd3e8152230 2024-04-23T18:22:59.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.660+0000 7fd3e6a00640 1 -- 172.21.15.28:0/3837151097 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 497576268 0 0) 0x7fd3e8158ef0 con 0x7fd3e80c8740 2024-04-23T18:22:59.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3e7400640 1 --2- 172.21.15.28:0/3837151097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3e8152230 0x7fd3e80cd6b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009870 tx=0x7fd3d801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc8c08e8c91fa76 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:59.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3e6a00640 1 -- 172.21.15.28:0/3837151097 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d80ab650 con 0x7fd3e8152230 2024-04-23T18:22:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3e6a00640 1 -- 172.21.15.28:0/3837151097 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d80b0070 con 0x7fd3e8152230 2024-04-23T18:22:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3e6a00640 1 -- 172.21.15.28:0/3837151097 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d80aba10 con 0x7fd3e8152230 2024-04-23T18:22:59.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3ee400640 1 -- 172.21.15.28:0/3837151097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3e8152230 msgr2=0x7fd3e80cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3ee400640 1 --2- 172.21.15.28:0/3837151097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3e8152230 0x7fd3e80cd6b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009870 tx=0x7fd3d801c560 comp rx=0 tx=0).stop 2024-04-23T18:22:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3ee400640 1 -- 172.21.15.28:0/3837151097 shutdown_connections 2024-04-23T18:22:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3ee400640 1 --2- 172.21.15.28:0/3837151097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e8071d10 0x7fd3e80cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3ee400640 1 --2- 172.21.15.28:0/3837151097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3e8152230 0x7fd3e80cd6b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3ee400640 1 -- 172.21.15.28:0/3837151097 >> 172.21.15.28:0/3837151097 conn(0x7fd3e806b9e0 msgr2=0x7fd3e806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3ee400640 1 -- 172.21.15.28:0/3837151097 shutdown_connections 2024-04-23T18:22:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.664+0000 7fd3ee400640 1 -- 172.21.15.28:0/3837151097 wait complete. 2024-04-23T18:22:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3ee400640 1 Processor -- start 2024-04-23T18:22:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3ee400640 1 -- start start 2024-04-23T18:22:59.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3ee400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e8071d10 0x7fd3e81f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:59.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3ee400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e80c8740 0x7fd3e81f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:59.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3ee400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3e8152230 0x7fd3e8156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:59.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3ee400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e80c8f70 con 0x7fd3e8152230 2024-04-23T18:22:59.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3ee400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e8152610 con 0x7fd3e80c8740 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3ee400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e8163050 con 0x7fd3e8071d10 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3e7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3e8152230 0x7fd3e8156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3e7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3e8152230 0x7fd3e8156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40862/0 (socket says 172.21.15.28:40862) 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3e7e00640 1 -- 172.21.15.28:0/3587313332 learned_addr learned my addr 172.21.15.28:0/3587313332 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3e7400640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e8071d10 0x7fd3e81f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3dfe00640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e80c8740 0x7fd3e81f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3e7e00640 1 -- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e8071d10 msgr2=0x7fd3e81f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3e7e00640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e8071d10 0x7fd3e81f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3e7e00640 1 -- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e80c8740 msgr2=0x7fd3e81f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3e7e00640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e80c8740 0x7fd3e81f7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3e7e00640 1 -- 172.21.15.28:0/3587313332 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e8165520 con 0x7fd3e8152230 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3e7e00640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3e8152230 0x7fd3e8156df0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000c7b0 tx=0x7fd3e000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3df400640 1 -- 172.21.15.28:0/3587313332 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0003db0 con 0x7fd3e8152230 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3df400640 1 -- 172.21.15.28:0/3587313332 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e0005070 con 0x7fd3e8152230 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3df400640 1 -- 172.21.15.28:0/3587313332 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0005460 con 0x7fd3e8152230 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3ee400640 1 -- 172.21.15.28:0/3587313332 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e8165800 con 0x7fd3e8152230 2024-04-23T18:22:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3ee400640 1 -- 172.21.15.28:0/3587313332 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e81f41b0 con 0x7fd3e8152230 2024-04-23T18:22:59.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.668+0000 7fd3ee400640 1 -- 172.21.15.28:0/3587313332 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e8068cd0 con 0x7fd3e8152230 2024-04-23T18:22:59.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.672+0000 7fd3df400640 1 -- 172.21.15.28:0/3587313332 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd3e0005600 con 0x7fd3e8152230 2024-04-23T18:22:59.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.672+0000 7fd3df400640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd3c4068380 0x7fd3c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:22:59.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.672+0000 7fd3df400640 1 -- 172.21.15.28:0/3587313332 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd3e0086cb0 con 0x7fd3e8152230 2024-04-23T18:22:59.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.672+0000 7fd3e7400640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd3c4068380 0x7fd3c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:22:59.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.672+0000 7fd3e7400640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd3c4068380 0x7fd3c406a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80af000 tx=0x7fd3d80a7000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:22:59.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.676+0000 7fd3df400640 1 -- 172.21.15.28:0/3587313332 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd3e0056f30 con 0x7fd3e8152230 2024-04-23T18:22:59.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.840+0000 7fd3ee400640 1 -- 172.21.15.28:0/3587313332 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3e80703e0 con 0x7fd3e8152230 2024-04-23T18:22:59.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3df400640 1 -- 172.21.15.28:0/3587313332 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fd3e0056830 con 0x7fd3e8152230 2024-04-23T18:22:59.836 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:22:59.837 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:22:59.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 -- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd3c4068380 msgr2=0x7fd3c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd3c4068380 0x7fd3c406a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80af000 tx=0x7fd3d80a7000 comp rx=0 tx=0).stop 2024-04-23T18:22:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 -- 172.21.15.28:0/3587313332 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3e8152230 msgr2=0x7fd3e8156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:22:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3e8152230 0x7fd3e8156df0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000c7b0 tx=0x7fd3e000cc70 comp rx=0 tx=0).stop 2024-04-23T18:22:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 -- 172.21.15.28:0/3587313332 shutdown_connections 2024-04-23T18:22:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd3c4068380 0x7fd3c406a840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3e8152230 0x7fd3e8156df0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3e80c8740 0x7fd3e81f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 --2- 172.21.15.28:0/3587313332 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd3e8071d10 0x7fd3e81f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:22:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 -- 172.21.15.28:0/3587313332 >> 172.21.15.28:0/3587313332 conn(0x7fd3e806b9e0 msgr2=0x7fd3e806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:22:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 -- 172.21.15.28:0/3587313332 shutdown_connections 2024-04-23T18:22:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:22:59.844+0000 7fd3ee400640 1 -- 172.21.15.28:0/3587313332 wait complete. 2024-04-23T18:22:59.859 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-23T18:22:59.859 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:22:59.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f0640200640 1 Processor -- start 2024-04-23T18:23:00.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f0640200640 1 -- start start 2024-04-23T18:23:00.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f0640200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f06380c91e0 0x7f06380710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f0640200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f063806c3f0 0x7f063815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f0640200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f063815b650 con 0x7f06381444e0 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f0640200640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f063806c860 con 0x7f06380c91e0 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f0640200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f063815b930 con 0x7f063806c3f0 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f063ce00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f06380c91e0 0x7f06380710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f063d800640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f06381444e0 0x7f0638072dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58582/0 (socket says 172.21.15.28:58582) 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f063d800640 1 -- 172.21.15.28:0/238987626 learned_addr learned my addr 172.21.15.28:0/238987626 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f063e200640 1 --2- 172.21.15.28:0/238987626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f063806c3f0 0x7f063815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f063ce00640 1 -- 172.21.15.28:0/238987626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f063806c3f0 msgr2=0x7f063815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f063ce00640 1 --2- 172.21.15.28:0/238987626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f063806c3f0 0x7f063815ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f063ce00640 1 -- 172.21.15.28:0/238987626 >> v1:172.21.15.28:6789/0 conn(0x7f06381444e0 legacy=0x7f0638072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f063ce00640 1 -- 172.21.15.28:0/238987626 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063815bc10 con 0x7f06380c91e0 2024-04-23T18:23:00.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f0637e00640 1 -- 172.21.15.28:0/238987626 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3993686474 0 0) 0x7f063815b650 con 0x7f06381444e0 2024-04-23T18:23:00.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.008+0000 7f063e200640 1 --2- 172.21.15.28:0/238987626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f063806c3f0 0x7f063815ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:00.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f063ce00640 1 --2- 172.21.15.28:0/238987626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06380c91e0 0x7f06380710e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06240097c0 tx=0x7f062401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7ffba784c6db6c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0637e00640 1 -- 172.21.15.28:0/238987626 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06240b5070 con 0x7f06380c91e0 2024-04-23T18:23:00.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0637e00640 1 -- 172.21.15.28:0/238987626 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06240a8990 con 0x7f06380c91e0 2024-04-23T18:23:00.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0637e00640 1 -- 172.21.15.28:0/238987626 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06240a8d60 con 0x7f06380c91e0 2024-04-23T18:23:00.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0640200640 1 -- 172.21.15.28:0/238987626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06380c91e0 msgr2=0x7f06380710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0640200640 1 --2- 172.21.15.28:0/238987626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06380c91e0 0x7f06380710e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06240097c0 tx=0x7f062401ec90 comp rx=0 tx=0).stop 2024-04-23T18:23:00.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0640200640 1 -- 172.21.15.28:0/238987626 shutdown_connections 2024-04-23T18:23:00.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0640200640 1 --2- 172.21.15.28:0/238987626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f063806c3f0 0x7f063815ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0640200640 1 --2- 172.21.15.28:0/238987626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06380c91e0 0x7f06380710e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0640200640 1 -- 172.21.15.28:0/238987626 >> 172.21.15.28:0/238987626 conn(0x7f06380676e0 msgr2=0x7f0638067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0640200640 1 -- 172.21.15.28:0/238987626 shutdown_connections 2024-04-23T18:23:00.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0640200640 1 -- 172.21.15.28:0/238987626 wait complete. 2024-04-23T18:23:00.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0640200640 1 Processor -- start 2024-04-23T18:23:00.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.012+0000 7f0640200640 1 -- start start 2024-04-23T18:23:00.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0640200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f063806c3f0 0x7f06381f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0640200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06380c91e0 0x7f06381f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0640200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06381444e0 0x7f06380ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0640200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f063815b300 con 0x7f06380c91e0 2024-04-23T18:23:00.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0640200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f063815c1d0 con 0x7f06381444e0 2024-04-23T18:23:00.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0640200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f06381448c0 con 0x7f063806c3f0 2024-04-23T18:23:00.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f063ce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06380c91e0 0x7f06381f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f063ce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06380c91e0 0x7f06381f4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40888/0 (socket says 172.21.15.28:40888) 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f063ce00640 1 -- 172.21.15.28:0/3410854468 learned_addr learned my addr 172.21.15.28:0/3410854468 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f063d800640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f063806c3f0 0x7f06381f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f063e200640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06381444e0 0x7f06380ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f063ce00640 1 -- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f063806c3f0 msgr2=0x7f06381f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f063ce00640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f063806c3f0 0x7f06381f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f063ce00640 1 -- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06381444e0 msgr2=0x7f06380ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f063ce00640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06381444e0 0x7f06380ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f063ce00640 1 -- 172.21.15.28:0/3410854468 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06380cd2a0 con 0x7f06380c91e0 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f063ce00640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06380c91e0 0x7f06381f4690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f06240b3040 tx=0x7f062401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0635600640 1 -- 172.21.15.28:0/3410854468 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06240bf070 con 0x7f06380c91e0 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0635600640 1 -- 172.21.15.28:0/3410854468 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06240b0820 con 0x7f06380c91e0 2024-04-23T18:23:00.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0640200640 1 -- 172.21.15.28:0/3410854468 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0638141590 con 0x7f06380c91e0 2024-04-23T18:23:00.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0635600640 1 -- 172.21.15.28:0/3410854468 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06240b5040 con 0x7f06380c91e0 2024-04-23T18:23:00.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0640200640 1 -- 172.21.15.28:0/3410854468 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06380cd540 con 0x7f06380c91e0 2024-04-23T18:23:00.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0640200640 1 -- 172.21.15.28:0/3410854468 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06380cd920 con 0x7f06380c91e0 2024-04-23T18:23:00.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.016+0000 7f0635600640 1 -- 172.21.15.28:0/3410854468 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06240c2070 con 0x7f06380c91e0 2024-04-23T18:23:00.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.020+0000 7f0635600640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0618068380 0x7f061806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.020+0000 7f0635600640 1 -- 172.21.15.28:0/3410854468 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0624123570 con 0x7f06380c91e0 2024-04-23T18:23:00.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.020+0000 7f063d800640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0618068380 0x7f061806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.020+0000 7f063d800640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0618068380 0x7f061806a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f062c000f70 tx=0x7f062c007c10 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.024+0000 7f0635600640 1 -- 172.21.15.28:0/3410854468 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06380cd920 con 0x7f06380c91e0 2024-04-23T18:23:00.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.188+0000 7f0640200640 1 -- 172.21.15.28:0/3410854468 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0638068cd0 con 0x7f06380c91e0 2024-04-23T18:23:00.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.188+0000 7f0635600640 1 -- 172.21.15.28:0/3410854468 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f06240187f0 con 0x7f06380c91e0 2024-04-23T18:23:00.183 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:00.183 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:23:00.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 -- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0618068380 msgr2=0x7f061806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0618068380 0x7f061806a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f062c000f70 tx=0x7f062c007c10 comp rx=0 tx=0).stop 2024-04-23T18:23:00.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 -- 172.21.15.28:0/3410854468 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06380c91e0 msgr2=0x7f06381f4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06380c91e0 0x7f06381f4690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f06240b3040 tx=0x7f062401ba30 comp rx=0 tx=0).stop 2024-04-23T18:23:00.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 -- 172.21.15.28:0/3410854468 shutdown_connections 2024-04-23T18:23:00.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0618068380 0x7f061806a840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06381444e0 0x7f06380ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f06380c91e0 0x7f06381f4690 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 --2- 172.21.15.28:0/3410854468 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f063806c3f0 0x7f06381f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 -- 172.21.15.28:0/3410854468 >> 172.21.15.28:0/3410854468 conn(0x7f06380676e0 msgr2=0x7f06380cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 -- 172.21.15.28:0/3410854468 shutdown_connections 2024-04-23T18:23:00.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.192+0000 7f0640200640 1 -- 172.21.15.28:0/3410854468 wait complete. 2024-04-23T18:23:00.205 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-23T18:23:00.205 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-23T18:23:00.205 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-23T18:23:00.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-23T18:23:00.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-23T18:23:00.207 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-23T18:23:00.207 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-23T18:23:00.207 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-23T18:23:00.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.460+0000 7f3f7a200640 1 Processor -- start 2024-04-23T18:23:00.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.460+0000 7fa31d600640 1 Processor -- start 2024-04-23T18:23:00.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.460+0000 7f3f7a200640 1 -- start start 2024-04-23T18:23:00.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.460+0000 7fa31d600640 1 -- start start 2024-04-23T18:23:00.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.460+0000 7fa31d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa310046db0 0x7fa3100dad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.460+0000 7fa31d600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3100dbae0 con 0x7fa31004b710 2024-04-23T18:23:00.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.460+0000 7fa31d600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa310045ff0 con 0x7fa31004b330 2024-04-23T18:23:00.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.460+0000 7f3f7a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f74151380 0x7f3f740c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.460+0000 7f3f7a200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f740c8650 0x7f3f740c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.460+0000 7fa31d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa3100dbd80 con 0x7fa310046db0 2024-04-23T18:23:00.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7fa316a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa31004b330 0x7fa310005ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40194/0 (socket says 172.21.15.28:40194) 2024-04-23T18:23:00.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7fa316a00640 1 -- 172.21.15.28:0/1747827411 learned_addr learned my addr 172.21.15.28:0/1747827411 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:00.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f3f7a200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f740c8200 con 0x7f3f74150fa0 2024-04-23T18:23:00.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f3f7a200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3f74157560 con 0x7f3f740c8650 2024-04-23T18:23:00.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f3f7a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3f741580a0 con 0x7f3f74151380 2024-04-23T18:23:00.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f3f73e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f740c8650 0x7f3f740c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f3f73400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3f74150fa0 0x7f3f7415b020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40210/0 (socket says 172.21.15.28:40210) 2024-04-23T18:23:00.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f3f73400640 1 -- 172.21.15.28:0/1109960157 learned_addr learned my addr 172.21.15.28:0/1109960157 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:00.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7fa317400640 1 --2- 172.21.15.28:0/1747827411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa310046db0 0x7fa3100dad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7fa315600640 1 -- 172.21.15.28:0/1747827411 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2618543379 0 0) 0x7fa310045ff0 con 0x7fa31004b330 2024-04-23T18:23:00.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7fa315600640 1 -- 172.21.15.28:0/1747827411 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2fc005740 con 0x7fa31004b330 2024-04-23T18:23:00.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7fa317400640 1 -- 172.21.15.28:0/1747827411 >> v1:172.21.15.137:6789/0 conn(0x7fa31004b330 legacy=0x7fa310005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7fa317400640 1 -- 172.21.15.28:0/1747827411 >> v1:172.21.15.28:6789/0 conn(0x7fa31004b710 legacy=0x7fa3100d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7fa317400640 1 -- 172.21.15.28:0/1747827411 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3100462d0 con 0x7fa310046db0 2024-04-23T18:23:00.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f4f74800640 1 Processor -- start 2024-04-23T18:23:00.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f4f74800640 1 -- start start 2024-04-23T18:23:00.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f3f72a00640 1 --2- 172.21.15.28:0/1109960157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f74151380 0x7f3f740c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f3f73e00640 1 -- 172.21.15.28:0/1109960157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f74151380 msgr2=0x7f3f740c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f3f73e00640 1 --2- 172.21.15.28:0/1109960157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f74151380 0x7f3f740c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f3f73e00640 1 -- 172.21.15.28:0/1109960157 >> v1:172.21.15.137:6789/0 conn(0x7f3f74150fa0 legacy=0x7f3f7415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f3f73e00640 1 -- 172.21.15.28:0/1109960157 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f74157800 con 0x7f3f740c8650 2024-04-23T18:23:00.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f4f74800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c14da30 0x7f4f6c0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f4f74800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f6c157c60 0x7f4f6c158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f4f74800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f6c0c87e0 con 0x7f4f6c0cc4e0 2024-04-23T18:23:00.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f4f74800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4f6c0c8a50 con 0x7f4f6c157c60 2024-04-23T18:23:00.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.464+0000 7f4f74800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6c0c8d30 con 0x7f4f6c14da30 2024-04-23T18:23:00.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f4f71400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f6c157c60 0x7f4f6c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f4f71400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4f6c157c60 0x7f4f6c158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42724/0 (socket says 172.21.15.28:42724) 2024-04-23T18:23:00.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f4f71400640 1 -- 172.21.15.28:0/302607181 learned_addr learned my addr 172.21.15.28:0/302607181 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f4f71e00640 1 --2- 172.21.15.28:0/302607181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c14da30 0x7f4f6c0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f4f70a00640 1 -- 172.21.15.28:0/302607181 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2645958707 0 0) 0x7f4f6c0c87e0 con 0x7f4f6c0cc4e0 2024-04-23T18:23:00.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f4f70a00640 1 -- 172.21.15.28:0/302607181 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f54003530 con 0x7f4f6c0cc4e0 2024-04-23T18:23:00.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f4f71400640 1 -- 172.21.15.28:0/302607181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c14da30 msgr2=0x7f4f6c0c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f4f71400640 1 --2- 172.21.15.28:0/302607181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c14da30 0x7f4f6c0c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f4f71400640 1 -- 172.21.15.28:0/302607181 >> v1:172.21.15.137:6789/0 conn(0x7f4f6c0cc4e0 legacy=0x7f4f6c0c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f4f71400640 1 -- 172.21.15.28:0/302607181 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c0c9010 con 0x7f4f6c157c60 2024-04-23T18:23:00.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f393de00640 1 Processor -- start 2024-04-23T18:23:00.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f393de00640 1 -- start start 2024-04-23T18:23:00.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f3f73e00640 1 --2- 172.21.15.28:0/1109960157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f740c8650 0x7f3f740c8ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009d90 tx=0x7f3f6c01c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38bf598ad222c0b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7fa317400640 1 --2- 172.21.15.28:0/1747827411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa310046db0 0x7fa3100dad70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa318074ca0 tx=0x7fa318098ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44ee45845a73f175 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f3f72000640 1 -- 172.21.15.28:0/1109960157 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0a6700 con 0x7f3f740c8650 2024-04-23T18:23:00.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7fa315600640 1 -- 172.21.15.28:0/1747827411 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31812e070 con 0x7fa310046db0 2024-04-23T18:23:00.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7fa315600640 1 -- 172.21.15.28:0/1747827411 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa31004c970 con 0x7fa310046db0 2024-04-23T18:23:00.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7fa315600640 1 -- 172.21.15.28:0/1747827411 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318071040 con 0x7fa310046db0 2024-04-23T18:23:00.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f3f72000640 1 -- 172.21.15.28:0/1109960157 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f6c0a68a0 con 0x7f3f740c8650 2024-04-23T18:23:00.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.468+0000 7f3f72000640 1 -- 172.21.15.28:0/1109960157 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0a6c70 con 0x7f3f740c8650 2024-04-23T18:23:00.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3f7a200640 1 -- 172.21.15.28:0/1109960157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f740c8650 msgr2=0x7f3f740c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3f7a200640 1 --2- 172.21.15.28:0/1109960157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f740c8650 0x7f3f740c8ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009d90 tx=0x7f3f6c01c800 comp rx=0 tx=0).stop 2024-04-23T18:23:00.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f393de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f393814da30 0x7f39380c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f393de00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3938158540 0x7f39380c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f393de00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39380c87e0 con 0x7f3938157c60 2024-04-23T18:23:00.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f393de00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f3938158970 con 0x7f3938158540 2024-04-23T18:23:00.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f393de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f39380c8a50 con 0x7f393814da30 2024-04-23T18:23:00.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7fa31d600640 1 -- 172.21.15.28:0/1747827411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa310046db0 msgr2=0x7fa3100dad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3f7a200640 1 -- 172.21.15.28:0/1109960157 shutdown_connections 2024-04-23T18:23:00.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3f7a200640 1 --2- 172.21.15.28:0/1109960157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f740c8650 0x7f3f740c8ae0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7fa31d600640 1 --2- 172.21.15.28:0/1747827411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa310046db0 0x7fa3100dad70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa318074ca0 tx=0x7fa318098ee0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3f7a200640 1 --2- 172.21.15.28:0/1109960157 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f74151380 0x7f3f740c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3f7a200640 1 -- 172.21.15.28:0/1109960157 >> 172.21.15.28:0/1109960157 conn(0x7f3f740676e0 msgr2=0x7f3f74067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3936a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f393814da30 0x7f39380c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3937400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3938158540 0x7f39380c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f392fe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3938157c60 0x7f39380cc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40230/0 (socket says 172.21.15.28:40230) 2024-04-23T18:23:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f392fe00640 1 -- 172.21.15.28:0/4197017321 learned_addr learned my addr 172.21.15.28:0/4197017321 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7fa31d600640 1 -- 172.21.15.28:0/1747827411 shutdown_connections 2024-04-23T18:23:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7fa31d600640 1 --2- 172.21.15.28:0/1747827411 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa310046db0 0x7fa3100dad70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7fa31d600640 1 -- 172.21.15.28:0/1747827411 >> 172.21.15.28:0/1747827411 conn(0x7fa3100501c0 msgr2=0x7fa3100505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3f7a200640 1 -- 172.21.15.28:0/1109960157 shutdown_connections 2024-04-23T18:23:00.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3f7a200640 1 -- 172.21.15.28:0/1109960157 wait complete. 2024-04-23T18:23:00.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7fa31d600640 1 -- 172.21.15.28:0/1747827411 shutdown_connections 2024-04-23T18:23:00.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3936000640 1 -- 172.21.15.28:0/4197017321 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1983780914 0 0) 0x7f39380c87e0 con 0x7f3938157c60 2024-04-23T18:23:00.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3936000640 1 -- 172.21.15.28:0/4197017321 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f391c005740 con 0x7f3938157c60 2024-04-23T18:23:00.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7fa31d600640 1 -- 172.21.15.28:0/1747827411 wait complete. 2024-04-23T18:23:00.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3097600640 1 Processor -- start 2024-04-23T18:23:00.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f4f71400640 1 --2- 172.21.15.28:0/302607181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c157c60 0x7f4f6c158540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4f60008870 tx=0x7f4f60021250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c553d765f178d062 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f4f70a00640 1 -- 172.21.15.28:0/302607181 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600b8070 con 0x7f4f6c157c60 2024-04-23T18:23:00.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3097600640 1 -- start start 2024-04-23T18:23:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f4f70a00640 1 -- 172.21.15.28:0/302607181 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f600b3410 con 0x7f4f6c157c60 2024-04-23T18:23:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f4f70a00640 1 -- 172.21.15.28:0/302607181 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600b37e0 con 0x7f4f6c157c60 2024-04-23T18:23:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3f7a200640 1 Processor -- start 2024-04-23T18:23:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3f7a200640 1 -- start start 2024-04-23T18:23:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3937400640 1 -- 172.21.15.28:0/4197017321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f393814da30 msgr2=0x7f39380c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3937400640 1 --2- 172.21.15.28:0/4197017321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f393814da30 0x7f39380c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3937400640 1 -- 172.21.15.28:0/4197017321 >> v1:172.21.15.137:6789/0 conn(0x7f3938157c60 legacy=0x7f39380cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.472+0000 7f3937400640 1 -- 172.21.15.28:0/4197017321 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39380ccbf0 con 0x7f3938158540 2024-04-23T18:23:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f4f74800640 1 -- 172.21.15.28:0/302607181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c157c60 msgr2=0x7f4f6c158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f4f74800640 1 --2- 172.21.15.28:0/302607181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c157c60 0x7f4f6c158540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4f60008870 tx=0x7f4f60021250 comp rx=0 tx=0).stop 2024-04-23T18:23:00.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7febe1e00640 1 Processor -- start 2024-04-23T18:23:00.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7febe1e00640 1 -- start start 2024-04-23T18:23:00.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3097600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f30901598f0 0x7f309015f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7fa31d600640 1 Processor -- start 2024-04-23T18:23:00.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3097600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f30900c6250 0x7f30900c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3097600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309015fe50 con 0x7f3090163610 2024-04-23T18:23:00.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3097600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f30900cbfd0 con 0x7f30900c6250 2024-04-23T18:23:00.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3097600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f309015fc00 con 0x7f30901598f0 2024-04-23T18:23:00.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7fa31d600640 1 -- start start 2024-04-23T18:23:00.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3094c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f30901598f0 0x7f309015f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3094c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f30901598f0 0x7f309015f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42734/0 (socket says 172.21.15.28:42734) 2024-04-23T18:23:00.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3094c00640 1 -- 172.21.15.28:0/3080312692 learned_addr learned my addr 172.21.15.28:0/3080312692 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3f7a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f740c8650 0x7f3f74156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3095600640 1 --2- 172.21.15.28:0/3080312692 >> v2:172.21.15.28:3300/0 conn(0x7f30900c6250 0x7f30900c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3094c00640 1 -- 172.21.15.28:0/3080312692 >> v2:172.21.15.28:3300/0 conn(0x7f30900c6250 msgr2=0x7f30900c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3094c00640 1 --2- 172.21.15.28:0/3080312692 >> v2:172.21.15.28:3300/0 conn(0x7f30900c6250 0x7f30900c66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3094c00640 1 -- 172.21.15.28:0/3080312692 >> v1:172.21.15.137:6789/0 conn(0x7f3090163610 legacy=0x7f3090072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3094c00640 1 -- 172.21.15.28:0/3080312692 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3090160130 con 0x7f30901598f0 2024-04-23T18:23:00.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7febe1e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febdc159670 0x7febdc1632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3f7a200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f74150fa0 0x7f3f74148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3f73400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f740c8650 0x7f3f74156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3f73400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f740c8650 0x7f3f74156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42750/0 (socket says 172.21.15.28:42750) 2024-04-23T18:23:00.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3f73400640 1 -- 172.21.15.28:0/1545232238 learned_addr learned my addr 172.21.15.28:0/1545232238 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7fa31d600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa310046db0 0x7fa310047270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7fa31d600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa31004b330 0x7fa310182860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7fa31d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa31004b710 0x7fa31004f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7fa31d600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa3100d5410 con 0x7fa310046db0 2024-04-23T18:23:00.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7fa31d600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa3100d5290 con 0x7fa31004b710 2024-04-23T18:23:00.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7fa31d600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa3100e8f20 con 0x7fa31004b330 2024-04-23T18:23:00.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3f7a200640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f74151380 0x7f3f74144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3f740c7e10 con 0x7f3f74150fa0 2024-04-23T18:23:00.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7febe0a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febdc159670 0x7febdc1632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7febe1e00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febdc0c8c20 con 0x7febdc0cd660 2024-04-23T18:23:00.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7febe0a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febdc159670 0x7febdc1632f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:42760/0 (socket says 172.21.15.28:42760) 2024-04-23T18:23:00.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7febe0a00640 1 -- 172.21.15.28:0/3288073882 learned_addr learned my addr 172.21.15.28:0/3288073882 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7febe1e00640 1 -- 172.21.15.28:0/3288073882 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febdc15fba0 con 0x7febdc15f380 2024-04-23T18:23:00.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7febe1e00640 1 -- 172.21.15.28:0/3288073882 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7febdc163830 con 0x7febdc159670 2024-04-23T18:23:00.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7febdbe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7febdc15f380 0x7febdc0c8510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40248/0 (socket says 172.21.15.28:40248) 2024-04-23T18:23:00.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f0bba600640 1 Processor -- start 2024-04-23T18:23:00.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7fa317400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa31004b710 0x7fa31004f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa316000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa31004b330 0x7fa310182860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7415ab00 con 0x7f3f740c8650 2024-04-23T18:23:00.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f73e00640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f74151380 0x7f3f74144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3f740719f0 con 0x7f3f74151380 2024-04-23T18:23:00.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa317400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa31004b710 0x7fa31004f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42764/0 (socket says 172.21.15.28:42764) 2024-04-23T18:23:00.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa316000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa31004b330 0x7fa310182860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:42774/0 (socket says 172.21.15.28:42774) 2024-04-23T18:23:00.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa317400640 1 -- 172.21.15.28:0/1114018135 learned_addr learned my addr 172.21.15.28:0/1114018135 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa316a00640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa310046db0 0x7fa310047270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7febdb400640 1 -- 172.21.15.28:0/3288073882 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 988274957 0 0) 0x7febdc15fba0 con 0x7febdc15f380 2024-04-23T18:23:00.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7febdb400640 1 -- 172.21.15.28:0/3288073882 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febc0003530 con 0x7febdc15f380 2024-04-23T18:23:00.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f72a00640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f74150fa0 0x7f3f74148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f4f74800640 1 -- 172.21.15.28:0/302607181 shutdown_connections 2024-04-23T18:23:00.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f4f74800640 1 --2- 172.21.15.28:0/302607181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c157c60 0x7f4f6c158540 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f4f74800640 1 --2- 172.21.15.28:0/302607181 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c14da30 0x7f4f6c0c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f4f74800640 1 -- 172.21.15.28:0/302607181 >> 172.21.15.28:0/302607181 conn(0x7f4f6c075e30 msgr2=0x7f4f6c0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.476+0000 7f0bba600640 1 -- start start 2024-04-23T18:23:00.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f35f7c00640 1 Processor -- start 2024-04-23T18:23:00.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f73e00640 1 -- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f740c8650 msgr2=0x7f3f74156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f73e00640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f740c8650 0x7f3f74156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f73e00640 1 -- 172.21.15.28:0/1545232238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f74150fa0 msgr2=0x7f3f74148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f73e00640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f74150fa0 0x7f3f74148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f73e00640 1 -- 172.21.15.28:0/1545232238 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f74159f90 con 0x7f3f74151380 2024-04-23T18:23:00.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa316000640 1 -- 172.21.15.28:0/1114018135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa31004b710 msgr2=0x7fa31004f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa316000640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa31004b710 0x7fa31004f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa316000640 1 -- 172.21.15.28:0/1114018135 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa310046db0 msgr2=0x7fa310047270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa316000640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa310046db0 0x7fa310047270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa316000640 1 -- 172.21.15.28:0/1114018135 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa310185230 con 0x7fa31004b330 2024-04-23T18:23:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa317400640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa31004b710 0x7fa31004f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f73400640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f740c8650 0x7f3f74156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:00.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f72a00640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f74150fa0 0x7f3f74148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f73e00640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f74151380 0x7f3f74144280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3f74068560 tx=0x7f3f6c0195a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f0bba600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0bb40cad90 0x7f0bb40cca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f0bba600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0bb415b3f0 0x7f0bb415b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f0bba600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb415bed0 con 0x7f0bb4152120 2024-04-23T18:23:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f0bba600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb40ca900 con 0x7f0bb415b3f0 2024-04-23T18:23:00.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f0bba600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb415c1b0 con 0x7f0bb40cad90 2024-04-23T18:23:00.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7febe0a00640 1 -- 172.21.15.28:0/3288073882 >> v1:172.21.15.137:6789/0 conn(0x7febdc15f380 legacy=0x7febdc0c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7febe0a00640 1 -- 172.21.15.28:0/3288073882 >> v1:172.21.15.28:6789/0 conn(0x7febdc0cd660 legacy=0x7febdc169d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7febe0a00640 1 -- 172.21.15.28:0/3288073882 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febdc159a50 con 0x7febdc159670 2024-04-23T18:23:00.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f0bb3400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0bb4152120 0x7f0bb40c8830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40260/0 (socket says 172.21.15.28:40260) 2024-04-23T18:23:00.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f0bb3400640 1 -- 172.21.15.28:0/3686638479 learned_addr learned my addr 172.21.15.28:0/3686638479 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:00.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f0bb2a00640 1 --2- 172.21.15.28:0/3686638479 >> v2:172.21.15.137:3300/0 conn(0x7f0bb40cad90 0x7f0bb40cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f35f7c00640 1 -- start start 2024-04-23T18:23:00.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa316000640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa31004b330 0x7fa310182860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa30400c410 tx=0x7fa30400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f67400640 1 -- 172.21.15.28:0/1545232238 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0ba680 con 0x7f3f74151380 2024-04-23T18:23:00.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f67400640 1 -- 172.21.15.28:0/1545232238 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f6c0ba820 con 0x7f3f74151380 2024-04-23T18:23:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f67400640 1 -- 172.21.15.28:0/1545232238 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0babf0 con 0x7f3f74151380 2024-04-23T18:23:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7415a270 con 0x7f3f74151380 2024-04-23T18:23:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f0bb3e00640 1 --2- 172.21.15.28:0/3686638479 >> v2:172.21.15.28:3300/0 conn(0x7f0bb415b3f0 0x7f0bb415b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f35f7c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35f01597f0 0x7f35f00c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f35f7c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f35f00c8fb0 0x7f35f0162cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f35f7c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f0159bd0 con 0x7f35f00c8b90 2024-04-23T18:23:00.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f35f7c00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f35f00b2f40 con 0x7f35f00c8fb0 2024-04-23T18:23:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f35f7c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f35f015f7e0 con 0x7f35f01597f0 2024-04-23T18:23:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa30ea00640 1 -- 172.21.15.28:0/1114018135 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304017070 con 0x7fa31004b330 2024-04-23T18:23:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa30ea00640 1 -- 172.21.15.28:0/1114018135 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3040069e0 con 0x7fa31004b330 2024-04-23T18:23:00.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3937400640 1 --2- 172.21.15.28:0/4197017321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3938158540 0x7f39380c79c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3930006580 tx=0x7f393001f020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6558416776bdd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f35f5200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35f01597f0 0x7f35f00c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f35f5200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35f01597f0 0x7f35f00c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:42786/0 (socket says 172.21.15.28:42786) 2024-04-23T18:23:00.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f35f5200640 1 -- 172.21.15.28:0/2167373048 learned_addr learned my addr 172.21.15.28:0/2167373048 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f35f5c00640 1 --2- 172.21.15.28:0/2167373048 >> v2:172.21.15.28:3300/0 conn(0x7f35f00c8fb0 0x7f35f0162cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7fa30ea00640 1 -- 172.21.15.28:0/1114018135 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304006e10 con 0x7fa31004b330 2024-04-23T18:23:00.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3094c00640 1 --2- 172.21.15.28:0/3080312692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30901598f0 0x7f309015f6c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f30900737f0 tx=0x7f307801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6b7b6a3539444f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f4f74800640 1 -- 172.21.15.28:0/302607181 shutdown_connections 2024-04-23T18:23:00.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f3936000640 1 -- 172.21.15.28:0/4197017321 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300b5070 con 0x7f3938158540 2024-04-23T18:23:00.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f3936000640 1 -- 172.21.15.28:0/4197017321 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39300a8d20 con 0x7f3938158540 2024-04-23T18:23:00.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f3936000640 1 -- 172.21.15.28:0/4197017321 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300b0660 con 0x7f3938158540 2024-04-23T18:23:00.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f0bb2000640 1 -- 172.21.15.28:0/3686638479 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 56815787 0 0) 0x7f0bb415bed0 con 0x7f0bb4152120 2024-04-23T18:23:00.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f0bb2000640 1 -- 172.21.15.28:0/3686638479 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b98003530 con 0x7f0bb4152120 2024-04-23T18:23:00.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.480+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f74158fb0 con 0x7f3f74151380 2024-04-23T18:23:00.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f35f5c00640 1 -- 172.21.15.28:0/2167373048 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35f01597f0 msgr2=0x7f35f00c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f35f5c00640 1 --2- 172.21.15.28:0/2167373048 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35f01597f0 0x7f35f00c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f35f5c00640 1 -- 172.21.15.28:0/2167373048 >> v1:172.21.15.137:6789/0 conn(0x7f35f00c8b90 legacy=0x7f35f006cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f35f5c00640 1 -- 172.21.15.28:0/2167373048 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f015fac0 con 0x7f35f00c8fb0 2024-04-23T18:23:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3f50001040 con 0x7f3f74151380 2024-04-23T18:23:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7fa31d600640 1 -- 172.21.15.28:0/1114018135 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa310185510 con 0x7fa31004b330 2024-04-23T18:23:00.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7fa31d600640 1 -- 172.21.15.28:0/1114018135 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa310185ad0 con 0x7fa31004b330 2024-04-23T18:23:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f4f74800640 1 -- 172.21.15.28:0/302607181 wait complete. 2024-04-23T18:23:00.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f393de00640 1 -- 172.21.15.28:0/4197017321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3938158540 msgr2=0x7f39380c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f393de00640 1 --2- 172.21.15.28:0/4197017321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3938158540 0x7f39380c79c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3930006580 tx=0x7f393001f020 comp rx=0 tx=0).stop 2024-04-23T18:23:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f308f400640 1 -- 172.21.15.28:0/3080312692 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30780b5070 con 0x7f30901598f0 2024-04-23T18:23:00.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f308f400640 1 -- 172.21.15.28:0/3080312692 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30780a8a10 con 0x7f30901598f0 2024-04-23T18:23:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f308f400640 1 -- 172.21.15.28:0/3080312692 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30780a8de0 con 0x7f30901598f0 2024-04-23T18:23:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f0bb3e00640 1 -- 172.21.15.28:0/3686638479 >> v2:172.21.15.137:3300/0 conn(0x7f0bb40cad90 msgr2=0x7f0bb40cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f0bb3e00640 1 --2- 172.21.15.28:0/3686638479 >> v2:172.21.15.137:3300/0 conn(0x7f0bb40cad90 0x7f0bb40cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f0bb3e00640 1 -- 172.21.15.28:0/3686638479 >> v1:172.21.15.137:6789/0 conn(0x7f0bb4152120 legacy=0x7f0bb40c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f0bb3e00640 1 -- 172.21.15.28:0/3686638479 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb40ca2b0 con 0x7f0bb415b3f0 2024-04-23T18:23:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f4f74800640 1 Processor -- start 2024-04-23T18:23:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f4f74800640 1 -- start start 2024-04-23T18:23:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f3f67400640 1 -- 172.21.15.28:0/1545232238 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f6c0c2020 con 0x7f3f74151380 2024-04-23T18:23:00.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7fa31d600640 1 -- 172.21.15.28:0/1114018135 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa310047920 con 0x7fa31004b330 2024-04-23T18:23:00.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f393de00640 1 -- 172.21.15.28:0/4197017321 shutdown_connections 2024-04-23T18:23:00.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f35f5c00640 1 --2- 172.21.15.28:0/2167373048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f35f00c8fb0 0x7f35f0162cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009d90 tx=0x7f35e801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a9bde3413da9a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f393de00640 1 --2- 172.21.15.28:0/4197017321 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3938158540 0x7f39380c79c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f393de00640 1 --2- 172.21.15.28:0/4197017321 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f393814da30 0x7f39380c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f393de00640 1 -- 172.21.15.28:0/4197017321 >> 172.21.15.28:0/4197017321 conn(0x7f3938075e30 msgr2=0x7f39380676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7febe0a00640 1 --2- 172.21.15.28:0/3288073882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febdc159670 0x7febdc1632f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7febc80098a0 tx=0x7febc801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56de6eaceef0681 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.484+0000 7f393de00640 1 -- 172.21.15.28:0/4197017321 shutdown_connections 2024-04-23T18:23:00.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f393de00640 1 -- 172.21.15.28:0/4197017321 wait complete. 2024-04-23T18:23:00.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f74800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f6c0cc4e0 0x7f4f6c154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3097600640 1 -- 172.21.15.28:0/3080312692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30901598f0 msgr2=0x7f309015f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3097600640 1 --2- 172.21.15.28:0/3080312692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30901598f0 0x7f309015f6c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f30900737f0 tx=0x7f307801ed10 comp rx=0 tx=0).stop 2024-04-23T18:23:00.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f74800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c14da30 0x7f4f6c14a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f74800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c157c60 0x7f4f6c14ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f74800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c0cce60 con 0x7f4f6c0cc4e0 2024-04-23T18:23:00.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f74800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c0c95d0 con 0x7f4f6c157c60 2024-04-23T18:23:00.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f74800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6c14de10 con 0x7f4f6c14da30 2024-04-23T18:23:00.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3097600640 1 -- 172.21.15.28:0/3080312692 shutdown_connections 2024-04-23T18:23:00.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3097600640 1 --2- 172.21.15.28:0/3080312692 >> v2:172.21.15.28:3300/0 conn(0x7f30900c6250 0x7f30900c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3097600640 1 --2- 172.21.15.28:0/3080312692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30901598f0 0x7f309015f6c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3097600640 1 -- 172.21.15.28:0/3080312692 >> 172.21.15.28:0/3080312692 conn(0x7f3090075dd0 msgr2=0x7f309006ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f35ef400640 1 -- 172.21.15.28:0/2167373048 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80b4070 con 0x7f35f00c8fb0 2024-04-23T18:23:00.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f71e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f6c0cc4e0 0x7f4f6c154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3097600640 1 -- 172.21.15.28:0/3080312692 shutdown_connections 2024-04-23T18:23:00.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f35ef400640 1 -- 172.21.15.28:0/2167373048 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e80af600 con 0x7f35f00c8fb0 2024-04-23T18:23:00.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f35ef400640 1 -- 172.21.15.28:0/2167373048 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80af9d0 con 0x7f35f00c8fb0 2024-04-23T18:23:00.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3f67400640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3f54068450 0x7f3f5406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3f67400640 1 -- 172.21.15.28:0/1545232238 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3f6c1227c0 con 0x7f3f74151380 2024-04-23T18:23:00.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3f67400640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] conn(0x7f3f54071bc0 0x7f3f54074000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3f67400640 1 -- 172.21.15.28:0/1545232238 --> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f6c0020f0 con 0x7f3f54071bc0 2024-04-23T18:23:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3f67400640 1 -- 172.21.15.28:0/1545232238 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3f6c122bb0 con 0x7f3f74151380 2024-04-23T18:23:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f71e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f6c0cc4e0 0x7f4f6c154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40958/0 (socket says 172.21.15.28:40958) 2024-04-23T18:23:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f71e00640 1 -- 172.21.15.28:0/4122226354 learned_addr learned my addr 172.21.15.28:0/4122226354 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f72800640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c157c60 0x7f4f6c14ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f71400640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c14da30 0x7f4f6c14a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f71400640 1 -- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c157c60 msgr2=0x7f4f6c14ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f71400640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4f6c157c60 0x7f4f6c14ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f71400640 1 -- 172.21.15.28:0/4122226354 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f6c0cc4e0 msgr2=0x7f4f6c154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f71400640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f6c0cc4e0 0x7f4f6c154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f71400640 1 -- 172.21.15.28:0/4122226354 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c153cd0 con 0x7f4f6c14da30 2024-04-23T18:23:00.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3f73400640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3f54068450 0x7f3f5406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f35f7c00640 1 -- 172.21.15.28:0/2167373048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f35f00c8fb0 msgr2=0x7f35f0162cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f35f7c00640 1 --2- 172.21.15.28:0/2167373048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f35f00c8fb0 0x7f35f0162cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009d90 tx=0x7f35e801f150 comp rx=0 tx=0).stop 2024-04-23T18:23:00.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3097600640 1 -- 172.21.15.28:0/3080312692 wait complete. 2024-04-23T18:23:00.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f71400640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c14da30 0x7f4f6c14a650 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f600b2000 tx=0x7f4f6001dff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f393de00640 1 Processor -- start 2024-04-23T18:23:00.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7febdb400640 1 -- 172.21.15.28:0/3288073882 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc80a9400 con 0x7febdc159670 2024-04-23T18:23:00.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7febdb400640 1 -- 172.21.15.28:0/3288073882 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc80a95a0 con 0x7febdc159670 2024-04-23T18:23:00.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7febdb400640 1 -- 172.21.15.28:0/3288073882 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc80a9400 con 0x7febdc159670 2024-04-23T18:23:00.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7febe1e00640 1 -- 172.21.15.28:0/3288073882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febdc159670 msgr2=0x7febdc1632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7febe1e00640 1 --2- 172.21.15.28:0/3288073882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febdc159670 0x7febdc1632f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7febc80098a0 tx=0x7febc801c560 comp rx=0 tx=0).stop 2024-04-23T18:23:00.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f66000640 1 -- 172.21.15.28:0/4122226354 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600b8070 con 0x7f4f6c14da30 2024-04-23T18:23:00.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f74800640 1 -- 172.21.15.28:0/4122226354 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6c14b1f0 con 0x7f4f6c14da30 2024-04-23T18:23:00.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7fa30ea00640 1 -- 172.21.15.28:0/1114018135 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa30401a070 con 0x7fa31004b330 2024-04-23T18:23:00.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f74800640 1 -- 172.21.15.28:0/4122226354 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6c0c5a50 con 0x7f4f6c14da30 2024-04-23T18:23:00.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f66000640 1 -- 172.21.15.28:0/4122226354 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f600b39d0 con 0x7f4f6c14da30 2024-04-23T18:23:00.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f4f66000640 1 -- 172.21.15.28:0/4122226354 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600b3da0 con 0x7f4f6c14da30 2024-04-23T18:23:00.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7febe1e00640 1 -- 172.21.15.28:0/3288073882 shutdown_connections 2024-04-23T18:23:00.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7febe1e00640 1 --2- 172.21.15.28:0/3288073882 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febdc159670 0x7febdc1632f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7febe1e00640 1 -- 172.21.15.28:0/3288073882 >> 172.21.15.28:0/3288073882 conn(0x7febdc06e2f0 msgr2=0x7febdc06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3097600640 1 Processor -- start 2024-04-23T18:23:00.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3097600640 1 -- start start 2024-04-23T18:23:00.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7fa30ea00640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa2f80683d0 0x7fa2f806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3f72a00640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] conn(0x7f3f54071bc0 0x7f3f54074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3f72a00640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] conn(0x7f3f54071bc0 0x7f3f54074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7febe1e00640 1 -- 172.21.15.28:0/3288073882 shutdown_connections 2024-04-23T18:23:00.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f3f73400640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3f54068450 0x7f3f5406a910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f60000f70 tx=0x7f3f60007ef0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7f393de00640 1 -- start start 2024-04-23T18:23:00.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f4f74800640 1 -- 172.21.15.28:0/4122226354 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4f48001040 con 0x7f4f6c14da30 2024-04-23T18:23:00.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7fa30ea00640 1 -- 172.21.15.28:0/1114018135 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa304085fe0 con 0x7fa31004b330 2024-04-23T18:23:00.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7fa30ea00640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] conn(0x7fa2f8071ad0 0x7fa2f8073f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.488+0000 7febe1e00640 1 -- 172.21.15.28:0/3288073882 wait complete. 2024-04-23T18:23:00.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f35f7c00640 1 -- 172.21.15.28:0/2167373048 shutdown_connections 2024-04-23T18:23:00.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f35f7c00640 1 --2- 172.21.15.28:0/2167373048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f35f00c8fb0 0x7f35f0162cb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f35f7c00640 1 --2- 172.21.15.28:0/2167373048 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35f01597f0 0x7f35f00c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f35f7c00640 1 -- 172.21.15.28:0/2167373048 >> 172.21.15.28:0/2167373048 conn(0x7f35f00cccb0 msgr2=0x7f35f00cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7fa316a00640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa2f80683d0 0x7fa2f806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7fa30ea00640 1 -- 172.21.15.28:0/1114018135 --> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2f80745e0 con 0x7fa2f8071ad0 2024-04-23T18:23:00.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f35f7c00640 1 -- 172.21.15.28:0/2167373048 shutdown_connections 2024-04-23T18:23:00.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7fa317400640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] conn(0x7fa2f8071ad0 0x7fa2f8073f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f0bb3e00640 1 --2- 172.21.15.28:0/3686638479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb415b3f0 0x7f0bb415b820 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40cc5e0 tx=0x7f0ba401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d3b056006e5ca server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f35f7c00640 1 -- 172.21.15.28:0/2167373048 wait complete. 2024-04-23T18:23:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7fa30ea00640 1 -- 172.21.15.28:0/1114018135 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa30408d050 con 0x7fa31004b330 2024-04-23T18:23:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f393de00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f393814da30 0x7f3938150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f0bb2000640 1 -- 172.21.15.28:0/3686638479 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba40ab430 con 0x7f0bb415b3f0 2024-04-23T18:23:00.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f0bb2000640 1 -- 172.21.15.28:0/3686638479 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba40b0070 con 0x7f0bb415b3f0 2024-04-23T18:23:00.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f0bb2000640 1 -- 172.21.15.28:0/3686638479 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba40ab7f0 con 0x7f0bb415b3f0 2024-04-23T18:23:00.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f393de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3938157c60 0x7f3938159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f393de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3938158540 0x7f393815a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f393de00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f39380c92f0 con 0x7f393814da30 2024-04-23T18:23:00.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f393de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f39380c9010 con 0x7f3938158540 2024-04-23T18:23:00.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7fa316a00640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa2f80683d0 0x7fa2f806a890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa3080049e0 tx=0x7fa30800b240 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7fa317400640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] conn(0x7fa2f8071ad0 0x7fa2f8073f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7febe1e00640 1 Processor -- start 2024-04-23T18:23:00.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3097600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30900c6250 0x7f3090153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7febe1e00640 1 -- start start 2024-04-23T18:23:00.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3097600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30901598f0 0x7f309015d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3097600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3090163610 0x7f3090154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3097600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f30900c5d30 con 0x7f30900c6250 2024-04-23T18:23:00.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3097600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f30900c5a50 con 0x7f3090163610 2024-04-23T18:23:00.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3097600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f30900cb510 con 0x7f30901598f0 2024-04-23T18:23:00.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3094c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30900c6250 0x7f3090153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f393de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f39380c95d0 con 0x7f3938157c60 2024-04-23T18:23:00.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3936a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f393814da30 0x7f3938150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3936a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f393814da30 0x7f3938150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40966/0 (socket says 172.21.15.28:40966) 2024-04-23T18:23:00.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3936a00640 1 -- 172.21.15.28:0/2249484010 learned_addr learned my addr 172.21.15.28:0/2249484010 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f392fe00640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3938157c60 0x7f3938159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f392fe00640 1 -- 172.21.15.28:0/2249484010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3938158540 msgr2=0x7f393815a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f392fe00640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3938158540 0x7f393815a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f392fe00640 1 -- 172.21.15.28:0/2249484010 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f393814da30 msgr2=0x7f3938150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f392fe00640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f393814da30 0x7f3938150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f392fe00640 1 -- 172.21.15.28:0/2249484010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39381f50b0 con 0x7f3938157c60 2024-04-23T18:23:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3094c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30900c6250 0x7f3090153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40970/0 (socket says 172.21.15.28:40970) 2024-04-23T18:23:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3094c00640 1 -- 172.21.15.28:0/3616749820 learned_addr learned my addr 172.21.15.28:0/3616749820 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f308fe00640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30901598f0 0x7f309015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f3095600640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3090163610 0x7f3090154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f0bba600640 1 -- 172.21.15.28:0/3686638479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb415b3f0 msgr2=0x7f0bb415b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f0bba600640 1 --2- 172.21.15.28:0/3686638479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb415b3f0 0x7f0bb415b820 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40cc5e0 tx=0x7f0ba401c490 comp rx=0 tx=0).stop 2024-04-23T18:23:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f35f7c00640 1 Processor -- start 2024-04-23T18:23:00.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f0bba600640 1 -- 172.21.15.28:0/3686638479 shutdown_connections 2024-04-23T18:23:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f0bba600640 1 --2- 172.21.15.28:0/3686638479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb415b3f0 0x7f0bb415b820 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f0bba600640 1 --2- 172.21.15.28:0/3686638479 >> v2:172.21.15.137:3300/0 conn(0x7f0bb40cad90 0x7f0bb40cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f0bba600640 1 -- 172.21.15.28:0/3686638479 >> 172.21.15.28:0/3686638479 conn(0x7f0bb406fa50 msgr2=0x7f0bb406fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f7c00640 1 -- start start 2024-04-23T18:23:00.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f3f67400640 1 -- 172.21.15.28:0/1545232238 <== osd.2 v2:172.21.15.28:6824/769511597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3f6c0020f0 con 0x7f3f54071bc0 2024-04-23T18:23:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7febe1e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febdc0cd660 0x7febdc1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7febe1e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febdc159670 0x7febdc157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.492+0000 7f392fe00640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3938157c60 0x7f3938159bd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f392800c420 tx=0x7f392800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f3094c00640 1 -- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30901598f0 msgr2=0x7f309015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f3094c00640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30901598f0 0x7f309015d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f3094c00640 1 -- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3090163610 msgr2=0x7f3090154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f3094c00640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3090163610 0x7f3090154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f3094c00640 1 -- 172.21.15.28:0/3616749820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30901f5aa0 con 0x7f30900c6250 2024-04-23T18:23:00.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7febe1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febdc15f380 0x7febdc157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f392f400640 1 -- 172.21.15.28:0/2249484010 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928011790 con 0x7f3938157c60 2024-04-23T18:23:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f392f400640 1 -- 172.21.15.28:0/2249484010 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3928017070 con 0x7f3938157c60 2024-04-23T18:23:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f392f400640 1 -- 172.21.15.28:0/2249484010 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928011b50 con 0x7f3938157c60 2024-04-23T18:23:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7febe1e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7febdc162dd0 con 0x7febdc0cd660 2024-04-23T18:23:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7febe1e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7febdc162af0 con 0x7febdc15f380 2024-04-23T18:23:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7febe1e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7febdc160870 con 0x7febdc159670 2024-04-23T18:23:00.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7febdbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febdc159670 0x7febdc157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7febe0a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febdc0cd660 0x7febdc1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f393de00640 1 -- 172.21.15.28:0/2249484010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39381f92f0 con 0x7f3938157c60 2024-04-23T18:23:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f393de00640 1 -- 172.21.15.28:0/2249484010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39381f5650 con 0x7f3938157c60 2024-04-23T18:23:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7febe0a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febdc0cd660 0x7febdc1582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40982/0 (socket says 172.21.15.28:40982) 2024-04-23T18:23:00.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7febe0a00640 1 -- 172.21.15.28:0/1979862180 learned_addr learned my addr 172.21.15.28:0/1979862180 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f3094c00640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30900c6250 0x7f3090153ba0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3078009930 tx=0x7f307801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f7c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35f00c8b90 0x7f35f0161d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f7c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f01597f0 0x7f35f01f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f7c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f35f0156470 0x7f35f015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f7c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f35f0160360 con 0x7f35f0156470 2024-04-23T18:23:00.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f7c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f35f0160080 con 0x7f35f01597f0 2024-04-23T18:23:00.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f7c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f35f015f490 con 0x7f35f00c8b90 2024-04-23T18:23:00.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f5c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f35f0156470 0x7f35f015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f5c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f35f0156470 0x7f35f015dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40988/0 (socket says 172.21.15.28:40988) 2024-04-23T18:23:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f5c00640 1 -- 172.21.15.28:0/3792051354 learned_addr learned my addr 172.21.15.28:0/3792051354 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f5c00640 1 -- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35f00c8b90 msgr2=0x7f35f0161d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T18:23:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f5c00640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f35f00c8b90 0x7f35f0161d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f5c00640 1 -- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f01597f0 msgr2=0x7f35f01f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f5c00640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f01597f0 0x7f35f01f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f35f5c00640 1 -- 172.21.15.28:0/3792051354 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f015e980 con 0x7f35f0156470 2024-04-23T18:23:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f35f5c00640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f35f0156470 0x7f35f015dd30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009d90 tx=0x7f35e801bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7febe0a00640 1 -- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febdc159670 msgr2=0x7febdc157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7febe0a00640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7febdc159670 0x7febdc157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7febe0a00640 1 -- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febdc15f380 msgr2=0x7febdc157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7febe0a00640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7febdc15f380 0x7febdc157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7febe0a00640 1 -- 172.21.15.28:0/1979862180 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febdc1f8a70 con 0x7febdc0cd660 2024-04-23T18:23:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f4f66000640 1 -- 172.21.15.28:0/4122226354 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f600bc030 con 0x7f4f6c14da30 2024-04-23T18:23:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f4f66000640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4f50068380 0x7f4f5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f35ecc00640 1 -- 172.21.15.28:0/3792051354 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80b4070 con 0x7f35f0156470 2024-04-23T18:23:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f308cc00640 1 -- 172.21.15.28:0/3616749820 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30780be070 con 0x7f30900c6250 2024-04-23T18:23:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f308cc00640 1 -- 172.21.15.28:0/3616749820 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30780b0700 con 0x7f30900c6250 2024-04-23T18:23:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.496+0000 7f308cc00640 1 -- 172.21.15.28:0/3616749820 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30780b5040 con 0x7f30900c6250 2024-04-23T18:23:00.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f35ecc00640 1 -- 172.21.15.28:0/3792051354 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e80d2070 con 0x7f35f0156470 2024-04-23T18:23:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f35ecc00640 1 -- 172.21.15.28:0/3792051354 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80cb7f0 con 0x7f35f0156470 2024-04-23T18:23:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f3095600640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3090163610 0x7f3090154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f3097600640 1 -- 172.21.15.28:0/3616749820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30900c7d30 con 0x7f30900c6250 2024-04-23T18:23:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f3097600640 1 -- 172.21.15.28:0/3616749820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30900c82f0 con 0x7f30900c6250 2024-04-23T18:23:00.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f4f66000640 1 -- 172.21.15.28:0/4122226354 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4f60124a00 con 0x7f4f6c14da30 2024-04-23T18:23:00.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f35f7c00640 1 -- 172.21.15.28:0/3792051354 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f01e88a0 con 0x7f35f0156470 2024-04-23T18:23:00.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f35f7c00640 1 -- 172.21.15.28:0/3792051354 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f01f8cb0 con 0x7f35f0156470 2024-04-23T18:23:00.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f4f66000640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] conn(0x7f4f50071a70 0x7f4f50073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f4f66000640 1 -- 172.21.15.28:0/4122226354 --> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f60007e80 con 0x7f4f50071a70 2024-04-23T18:23:00.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f4f66000640 1 -- 172.21.15.28:0/4122226354 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4f60124db0 con 0x7f4f6c14da30 2024-04-23T18:23:00.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f3086000640 1 -- 172.21.15.28:0/3616749820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3090068db0 con 0x7f30900c6250 2024-04-23T18:23:00.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f4f72800640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] conn(0x7f4f50071a70 0x7f4f50073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f4f71e00640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4f50068380 0x7f4f5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f393de00640 1 -- 172.21.15.28:0/2249484010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3938068db0 con 0x7f3938157c60 2024-04-23T18:23:00.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7febe0a00640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febdc0cd660 0x7febdc1582f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7febc801a190 tx=0x7febc8019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f0bba600640 1 -- 172.21.15.28:0/3686638479 shutdown_connections 2024-04-23T18:23:00.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f0bba600640 1 -- 172.21.15.28:0/3686638479 wait complete. 2024-04-23T18:23:00.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.500+0000 7f0bba600640 1 Processor -- start 2024-04-23T18:23:00.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7fa30ea00640 1 -- 172.21.15.28:0/1114018135 <== osd.0 v2:172.21.15.28:6800/1141872294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2f80745e0 con 0x7fa2f8071ad0 2024-04-23T18:23:00.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f0bba600640 1 -- start start 2024-04-23T18:23:00.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f35f7c00640 1 -- 172.21.15.28:0/3792051354 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f35f0074290 con 0x7f35f0156470 2024-04-23T18:23:00.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f392f400640 1 -- 172.21.15.28:0/2249484010 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3928011cf0 con 0x7f3938157c60 2024-04-23T18:23:00.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f0bba600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bb40cad90 0x7f0bb414c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f4f71e00640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4f50068380 0x7f4f5006a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009bb0 tx=0x7f4f5c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f4f72800640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] conn(0x7f4f50071a70 0x7f4f50073eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f392f400640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3914068450 0x7f391406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f392f400640 1 -- 172.21.15.28:0/2249484010 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3928086af0 con 0x7f3938157c60 2024-04-23T18:23:00.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f392f400640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] conn(0x7f3914071bd0 0x7f3914074010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f392f400640 1 -- 172.21.15.28:0/2249484010 --> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39140746e0 con 0x7f3914071bd0 2024-04-23T18:23:00.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f392f400640 1 -- 172.21.15.28:0/2249484010 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f392808b2a0 con 0x7f3938157c60 2024-04-23T18:23:00.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f0bba600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb4152120 0x7f0bb406bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f3936a00640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3914068450 0x7f391406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f0bba600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb415b3f0 0x7f0bb406c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f0bb2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb4152120 0x7f0bb406bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f0bba600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb4067860 con 0x7f0bb415b3f0 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f0bba600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb40676e0 con 0x7f0bb4152120 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f0bba600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb40679e0 con 0x7f0bb40cad90 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f0bb2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb4152120 0x7f0bb406bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42836/0 (socket says 172.21.15.28:42836) 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f0bb2a00640 1 -- 172.21.15.28:0/3070351204 learned_addr learned my addr 172.21.15.28:0/3070351204 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.504+0000 7f0bb3400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bb40cad90 0x7f0bb414c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bb2a00640 1 -- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bb40cad90 msgr2=0x7f0bb414c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bb2a00640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bb40cad90 0x7f0bb414c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bb2a00640 1 -- 172.21.15.28:0/3070351204 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb415b3f0 msgr2=0x7f0bb406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bb2a00640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bb415b3f0 0x7f0bb406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bb2a00640 1 -- 172.21.15.28:0/3070351204 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb414b7e0 con 0x7f0bb4152120 2024-04-23T18:23:00.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f4f66000640 1 -- 172.21.15.28:0/4122226354 <== osd.1 v2:172.21.15.28:6808/3900609679 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f60007e80 con 0x7f4f50071a70 2024-04-23T18:23:00.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bb3400640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bb40cad90 0x7f0bb414c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:00.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bb2a00640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb4152120 0x7f0bb406bc40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00efc0 tx=0x7f0bac00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f3936a00640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3914068450 0x7f391406a910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3920009b10 tx=0x7f3920008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bab400640 1 -- 172.21.15.28:0/3070351204 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac018020 con 0x7f0bb4152120 2024-04-23T18:23:00.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bab400640 1 -- 172.21.15.28:0/3070351204 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bac014480 con 0x7f0bb4152120 2024-04-23T18:23:00.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bab400640 1 -- 172.21.15.28:0/3070351204 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac014850 con 0x7f0bb4152120 2024-04-23T18:23:00.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bba600640 1 -- 172.21.15.28:0/3070351204 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb42048e0 con 0x7f0bb4152120 2024-04-23T18:23:00.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f0bba600640 1 -- 172.21.15.28:0/3070351204 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb4204bc0 con 0x7f0bb4152120 2024-04-23T18:23:00.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f3937400640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] conn(0x7f3914071bd0 0x7f3914074010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f35ecc00640 1 -- 172.21.15.28:0/3792051354 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f35e80af480 con 0x7f35f0156470 2024-04-23T18:23:00.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f35ecc00640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f35d0068400 0x7f35d006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7febd8c00640 1 -- 172.21.15.28:0/1979862180 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc80a9400 con 0x7febdc0cd660 2024-04-23T18:23:00.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7febe1e00640 1 -- 172.21.15.28:0/1979862180 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febdc1f8d50 con 0x7febdc0cd660 2024-04-23T18:23:00.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7febe1e00640 1 -- 172.21.15.28:0/1979862180 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febdc0c90f0 con 0x7febdc0cd660 2024-04-23T18:23:00.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7febd8c00640 1 -- 172.21.15.28:0/1979862180 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc80b1600 con 0x7febdc0cd660 2024-04-23T18:23:00.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7febd8c00640 1 -- 172.21.15.28:0/1979862180 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc80b1a10 con 0x7febdc0cd660 2024-04-23T18:23:00.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.508+0000 7f35f5200640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f35d0068400 0x7f35d006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f308cc00640 1 -- 172.21.15.28:0/3616749820 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30780b0ab0 con 0x7f30900c6250 2024-04-23T18:23:00.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f35f5200640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f35d0068400 0x7f35d006a8c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35e40099e0 tx=0x7f35e4009240 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f0bab400640 1 -- 172.21.15.28:0/3070351204 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0bac01b020 con 0x7f0bb4152120 2024-04-23T18:23:00.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f3937400640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] conn(0x7f3914071bd0 0x7f3914074010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f308cc00640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f306c068400 0x7f306c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f308cc00640 1 -- 172.21.15.28:0/3616749820 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3078124120 con 0x7f30900c6250 2024-04-23T18:23:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f308cc00640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] conn(0x7f306c071b70 0x7f306c073fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f308cc00640 1 -- 172.21.15.28:0/3616749820 --> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30780b5e50 con 0x7f306c071b70 2024-04-23T18:23:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f308cc00640 1 -- 172.21.15.28:0/3616749820 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f30781244d0 con 0x7f30900c6250 2024-04-23T18:23:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f3095600640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] conn(0x7f306c071b70 0x7f306c073fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f0bba600640 1 -- 172.21.15.28:0/3070351204 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b8c001040 con 0x7f0bb4152120 2024-04-23T18:23:00.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f0bab400640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b94068450 0x7f0b9406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7f0bab400640 1 -- 172.21.15.28:0/3070351204 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0bac087c10 con 0x7f0bb4152120 2024-04-23T18:23:00.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.512+0000 7febe1e00640 1 -- 172.21.15.28:0/1979862180 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7febb4001040 con 0x7febdc0cd660 2024-04-23T18:23:00.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f0bb3400640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b94068450 0x7f0b9406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f0bab400640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] conn(0x7f0b94071b40 0x7f0b94073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f392f400640 1 -- 172.21.15.28:0/2249484010 <== osd.3 v2:172.21.15.28:6816/1483415769 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39140746e0 con 0x7f3914071bd0 2024-04-23T18:23:00.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f0bab400640 1 -- 172.21.15.28:0/3070351204 --> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bac0020c0 con 0x7f0b94071b40 2024-04-23T18:23:00.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f0bab400640 1 -- 172.21.15.28:0/3070351204 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0bac08e050 con 0x7f0bb4152120 2024-04-23T18:23:00.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f0bb3e00640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] conn(0x7f0b94071b40 0x7f0b94073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f308fe00640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f306c068400 0x7f306c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f3095600640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] conn(0x7f306c071b70 0x7f306c073fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f35ecc00640 1 -- 172.21.15.28:0/3792051354 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f35e8002020 con 0x7f35f0156470 2024-04-23T18:23:00.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f0bb3e00640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] conn(0x7f0b94071b40 0x7f0b94073f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f0bb3400640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b94068450 0x7f0b9406a910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00011f0 tx=0x7f0ba0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f35ecc00640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] conn(0x7f35d0071af0 0x7f35d0073f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f308fe00640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f306c068400 0x7f306c06a8c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f309015f6b0 tx=0x7f3088009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f35ecc00640 1 -- 172.21.15.28:0/3792051354 --> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35e80d8e70 con 0x7f35d0071af0 2024-04-23T18:23:00.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f35ecc00640 1 -- 172.21.15.28:0/3792051354 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f35e8102930 con 0x7f35f0156470 2024-04-23T18:23:00.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f35efe00640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] conn(0x7f35d0071af0 0x7f35d0073f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f308cc00640 1 -- 172.21.15.28:0/3616749820 <== osd.5 v2:172.21.15.137:6824/1206756250 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f30780b5e50 con 0x7f306c071b70 2024-04-23T18:23:00.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f0bab400640 1 -- 172.21.15.28:0/3070351204 <== osd.6 v2:172.21.15.137:6816/276934842 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0bac0020c0 con 0x7f0b94071b40 2024-04-23T18:23:00.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7febd8c00640 1 -- 172.21.15.28:0/1979862180 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7febc80b1bb0 con 0x7febdc0cd660 2024-04-23T18:23:00.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.516+0000 7f35efe00640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] conn(0x7f35d0071af0 0x7f35d0073f30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.520+0000 7febd8c00640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7febbc068380 0x7febbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.520+0000 7febd8c00640 1 -- 172.21.15.28:0/1979862180 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7febc8120d60 con 0x7febdc0cd660 2024-04-23T18:23:00.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.520+0000 7febd8c00640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] conn(0x7febbc071b00 0x7febbc073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.520+0000 7febd8c00640 1 -- 172.21.15.28:0/1979862180 --> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febc8001d40 con 0x7febbc071b00 2024-04-23T18:23:00.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.520+0000 7febd8c00640 1 -- 172.21.15.28:0/1979862180 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7febc81233c0 con 0x7febdc0cd660 2024-04-23T18:23:00.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.520+0000 7febdbe00640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7febbc068380 0x7febbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.520+0000 7febe1400640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] conn(0x7febbc071b00 0x7febbc073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.520+0000 7f35ecc00640 1 -- 172.21.15.28:0/3792051354 <== osd.7 v2:172.21.15.137:6800/2261796983 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f35e80d8e70 con 0x7f35d0071af0 2024-04-23T18:23:00.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.520+0000 7febe1400640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] conn(0x7febbc071b00 0x7febbc073f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.520+0000 7febdbe00640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7febbc068380 0x7febbc06a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7febdc073e20 tx=0x7febcc007d00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.524+0000 7febd8c00640 1 -- 172.21.15.28:0/1979862180 <== osd.4 v2:172.21.15.137:6806/3497527296 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7febc8001d40 con 0x7febbc071b00 2024-04-23T18:23:00.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.524+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 --> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3f50002de0 con 0x7f3f54071bc0 2024-04-23T18:23:00.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f67400640 1 -- 172.21.15.28:0/1545232238 <== osd.2 v2:172.21.15.28:6824/769511597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3f50002de0 con 0x7f3f54071bc0 2024-04-23T18:23:00.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7fa31d600640 1 -- 172.21.15.28:0/1114018135 --> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa31004c970 con 0x7fa2f8071ad0 2024-04-23T18:23:00.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 >> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] conn(0x7f3f54071bc0 msgr2=0x7f3f54074000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f7a200640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] conn(0x7f3f54071bc0 0x7f3f54074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3f54068450 msgr2=0x7f3f5406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f7a200640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3f54068450 0x7f3f5406a910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f60000f70 tx=0x7f3f60007ef0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f74151380 msgr2=0x7f3f74144280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f7a200640 1 --2- 172.21.15.28:0/1545232238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f74151380 0x7f3f74144280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3f74068560 tx=0x7f3f6c0195a0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f73e00640 1 -- 172.21.15.28:0/1545232238 reap_dead start 2024-04-23T18:23:00.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 shutdown_connections 2024-04-23T18:23:00.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 >> 172.21.15.28:0/1545232238 conn(0x7f3f740676e0 msgr2=0x7f3f74149920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7fa30ea00640 1 -- 172.21.15.28:0/1114018135 <== osd.0 v2:172.21.15.28:6800/1141872294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa31004c970 con 0x7fa2f8071ad0 2024-04-23T18:23:00.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7fa31d600640 1 -- 172.21.15.28:0/1114018135 >> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] conn(0x7fa2f8071ad0 msgr2=0x7fa2f8073f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7fa31d600640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] conn(0x7fa2f8071ad0 0x7fa2f8073f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7fa31d600640 1 -- 172.21.15.28:0/1114018135 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa2f80683d0 msgr2=0x7fa2f806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7fa31d600640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa2f80683d0 0x7fa2f806a890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa3080049e0 tx=0x7fa30800b240 comp rx=0 tx=0).stop 2024-04-23T18:23:00.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7fa31d600640 1 -- 172.21.15.28:0/1114018135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa31004b330 msgr2=0x7fa310182860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7fa31d600640 1 --2- 172.21.15.28:0/1114018135 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa31004b330 0x7fa310182860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa30400c410 tx=0x7fa30400c8d0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7fa317400640 1 -- 172.21.15.28:0/1114018135 reap_dead start 2024-04-23T18:23:00.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 shutdown_connections 2024-04-23T18:23:00.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7fa31d600640 1 -- 172.21.15.28:0/1114018135 shutdown_connections 2024-04-23T18:23:00.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7fa31d600640 1 -- 172.21.15.28:0/1114018135 >> 172.21.15.28:0/1114018135 conn(0x7fa3100501c0 msgr2=0x7fa3100d2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.532+0000 7f3f7a200640 1 -- 172.21.15.28:0/1545232238 wait complete. 2024-04-23T18:23:00.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.536+0000 7fa31d600640 1 -- 172.21.15.28:0/1114018135 shutdown_connections 2024-04-23T18:23:00.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.536+0000 7fa31d600640 1 -- 172.21.15.28:0/1114018135 wait complete. 2024-04-23T18:23:00.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f4f74800640 1 -- 172.21.15.28:0/4122226354 --> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4f48002de0 con 0x7f4f50071a70 2024-04-23T18:23:00.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f4f66000640 1 -- 172.21.15.28:0/4122226354 <== osd.1 v2:172.21.15.28:6808/3900609679 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4f48002de0 con 0x7f4f50071a70 2024-04-23T18:23:00.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f393de00640 1 -- 172.21.15.28:0/2249484010 --> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f393814d090 con 0x7f3914071bd0 2024-04-23T18:23:00.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f392f400640 1 -- 172.21.15.28:0/2249484010 <== osd.3 v2:172.21.15.28:6816/1483415769 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f393814d090 con 0x7f3914071bd0 2024-04-23T18:23:00.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f4f5b400640 1 -- 172.21.15.28:0/4122226354 >> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] conn(0x7f4f50071a70 msgr2=0x7f4f50073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f4f5b400640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] conn(0x7f4f50071a70 0x7f4f50073eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f393de00640 1 -- 172.21.15.28:0/2249484010 >> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] conn(0x7f3914071bd0 msgr2=0x7f3914074010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f393de00640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] conn(0x7f3914071bd0 0x7f3914074010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f393de00640 1 -- 172.21.15.28:0/2249484010 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3914068450 msgr2=0x7f391406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f393de00640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3914068450 0x7f391406a910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3920009b10 tx=0x7f3920008040 comp rx=0 tx=0).stop 2024-04-23T18:23:00.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f393de00640 1 -- 172.21.15.28:0/2249484010 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3938157c60 msgr2=0x7f3938159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.544+0000 7f4f5b400640 1 -- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4f50068380 msgr2=0x7f4f5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.544+0000 7f4f5b400640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4f50068380 0x7f4f5006a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009bb0 tx=0x7f4f5c008040 comp rx=0 tx=0).stop 2024-04-23T18:23:00.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.544+0000 7f4f5b400640 1 -- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c14da30 msgr2=0x7f4f6c14a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.544+0000 7f4f5b400640 1 --2- 172.21.15.28:0/4122226354 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4f6c14da30 0x7f4f6c14a650 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f600b2000 tx=0x7f4f6001dff0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.544+0000 7f4f72800640 1 -- 172.21.15.28:0/4122226354 reap_dead start 2024-04-23T18:23:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.544+0000 7f4f5b400640 1 -- 172.21.15.28:0/4122226354 shutdown_connections 2024-04-23T18:23:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.544+0000 7f4f5b400640 1 -- 172.21.15.28:0/4122226354 >> 172.21.15.28:0/4122226354 conn(0x7f4f6c075e30 msgr2=0x7f4f6c0c7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f393de00640 1 --2- 172.21.15.28:0/2249484010 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3938157c60 0x7f3938159bd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f392800c420 tx=0x7f392800c8e0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.540+0000 7f3937400640 1 -- 172.21.15.28:0/2249484010 reap_dead start 2024-04-23T18:23:00.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.544+0000 7f393de00640 1 -- 172.21.15.28:0/2249484010 shutdown_connections 2024-04-23T18:23:00.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.544+0000 7f393de00640 1 -- 172.21.15.28:0/2249484010 >> 172.21.15.28:0/2249484010 conn(0x7f3938075e30 msgr2=0x7f39380c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.544+0000 7f393de00640 1 -- 172.21.15.28:0/2249484010 shutdown_connections 2024-04-23T18:23:00.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.544+0000 7f393de00640 1 -- 172.21.15.28:0/2249484010 wait complete. 2024-04-23T18:23:00.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f4f5b400640 1 -- 172.21.15.28:0/4122226354 shutdown_connections 2024-04-23T18:23:00.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f4f5b400640 1 -- 172.21.15.28:0/4122226354 wait complete. 2024-04-23T18:23:00.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f3086000640 1 -- 172.21.15.28:0/3616749820 --> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f30900cadc0 con 0x7f306c071b70 2024-04-23T18:23:00.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f308cc00640 1 -- 172.21.15.28:0/3616749820 <== osd.5 v2:172.21.15.137:6824/1206756250 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f30900cadc0 con 0x7f306c071b70 2024-04-23T18:23:00.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f3097600640 1 -- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] conn(0x7f306c071b70 msgr2=0x7f306c073fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f3097600640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] conn(0x7f306c071b70 0x7f306c073fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f0bba600640 1 -- 172.21.15.28:0/3070351204 --> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0b8c002de0 con 0x7f0b94071b40 2024-04-23T18:23:00.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f3097600640 1 -- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f306c068400 msgr2=0x7f306c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f3097600640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f306c068400 0x7f306c06a8c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f309015f6b0 tx=0x7f3088009040 comp rx=0 tx=0).stop 2024-04-23T18:23:00.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f3097600640 1 -- 172.21.15.28:0/3616749820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30900c6250 msgr2=0x7f3090153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f0bab400640 1 -- 172.21.15.28:0/3070351204 <== osd.6 v2:172.21.15.137:6816/276934842 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0b8c002de0 con 0x7f0b94071b40 2024-04-23T18:23:00.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f3097600640 1 --2- 172.21.15.28:0/3616749820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30900c6250 0x7f3090153ba0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3078009930 tx=0x7f307801bab0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f0bba600640 1 -- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] conn(0x7f0b94071b40 msgr2=0x7f0b94073f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f0bba600640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] conn(0x7f0b94071b40 0x7f0b94073f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f3095600640 1 -- 172.21.15.28:0/3616749820 reap_dead start 2024-04-23T18:23:00.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f3097600640 1 -- 172.21.15.28:0/3616749820 shutdown_connections 2024-04-23T18:23:00.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.548+0000 7f3097600640 1 -- 172.21.15.28:0/3616749820 >> 172.21.15.28:0/3616749820 conn(0x7f3090075dd0 msgr2=0x7f30900d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f3097600640 1 -- 172.21.15.28:0/3616749820 shutdown_connections 2024-04-23T18:23:00.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f3097600640 1 -- 172.21.15.28:0/3616749820 wait complete. 2024-04-23T18:23:00.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f35f7c00640 1 -- 172.21.15.28:0/3792051354 --> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f35f0163600 con 0x7f35d0071af0 2024-04-23T18:23:00.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f0bba600640 1 -- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b94068450 msgr2=0x7f0b9406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f0bba600640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b94068450 0x7f0b9406a910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00011f0 tx=0x7f0ba0009040 comp rx=0 tx=0).stop 2024-04-23T18:23:00.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f0bba600640 1 -- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb4152120 msgr2=0x7f0bb406bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f0bba600640 1 --2- 172.21.15.28:0/3070351204 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb4152120 0x7f0bb406bc40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00efc0 tx=0x7f0bac00c490 comp rx=0 tx=0).stop 2024-04-23T18:23:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f0bb3e00640 1 -- 172.21.15.28:0/3070351204 reap_dead start 2024-04-23T18:23:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f0bba600640 1 -- 172.21.15.28:0/3070351204 shutdown_connections 2024-04-23T18:23:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f0bba600640 1 -- 172.21.15.28:0/3070351204 >> 172.21.15.28:0/3070351204 conn(0x7f0bb406fa50 msgr2=0x7f0bb40c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f0bba600640 1 -- 172.21.15.28:0/3070351204 shutdown_connections 2024-04-23T18:23:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f35ecc00640 1 -- 172.21.15.28:0/3792051354 <== osd.7 v2:172.21.15.137:6800/2261796983 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f35f0163600 con 0x7f35d0071af0 2024-04-23T18:23:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f0bba600640 1 -- 172.21.15.28:0/3070351204 wait complete. 2024-04-23T18:23:00.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7febe1e00640 1 -- 172.21.15.28:0/1979862180 --> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7febb4002de0 con 0x7febbc071b00 2024-04-23T18:23:00.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f35f7c00640 1 -- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] conn(0x7f35d0071af0 msgr2=0x7f35d0073f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.552+0000 7f35f7c00640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] conn(0x7f35d0071af0 0x7f35d0073f30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7f35f7c00640 1 -- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f35d0068400 msgr2=0x7f35d006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7f35f7c00640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f35d0068400 0x7f35d006a8c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35e40099e0 tx=0x7f35e4009240 comp rx=0 tx=0).stop 2024-04-23T18:23:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7f35f7c00640 1 -- 172.21.15.28:0/3792051354 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f35f0156470 msgr2=0x7f35f015dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7f35f7c00640 1 --2- 172.21.15.28:0/3792051354 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f35f0156470 0x7f35f015dd30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009d90 tx=0x7f35e801bef0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7f35f5c00640 1 -- 172.21.15.28:0/3792051354 reap_dead start 2024-04-23T18:23:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febd8c00640 1 -- 172.21.15.28:0/1979862180 <== osd.4 v2:172.21.15.137:6806/3497527296 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7febb4002de0 con 0x7febbc071b00 2024-04-23T18:23:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7f35f7c00640 1 -- 172.21.15.28:0/3792051354 shutdown_connections 2024-04-23T18:23:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7f35f7c00640 1 -- 172.21.15.28:0/3792051354 >> 172.21.15.28:0/3792051354 conn(0x7f35f00cccb0 msgr2=0x7f35f00c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febe1e00640 1 -- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] conn(0x7febbc071b00 msgr2=0x7febbc073f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febe1e00640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] conn(0x7febbc071b00 0x7febbc073f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febe1e00640 1 -- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7febbc068380 msgr2=0x7febbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febe1e00640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7febbc068380 0x7febbc06a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7febdc073e20 tx=0x7febcc007d00 comp rx=0 tx=0).stop 2024-04-23T18:23:00.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7f35f7c00640 1 -- 172.21.15.28:0/3792051354 shutdown_connections 2024-04-23T18:23:00.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7f35f7c00640 1 -- 172.21.15.28:0/3792051354 wait complete. 2024-04-23T18:23:00.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febe1e00640 1 -- 172.21.15.28:0/1979862180 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febdc0cd660 msgr2=0x7febdc1582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febe1e00640 1 --2- 172.21.15.28:0/1979862180 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7febdc0cd660 0x7febdc1582f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7febc801a190 tx=0x7febc8019300 comp rx=0 tx=0).stop 2024-04-23T18:23:00.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febe1400640 1 -- 172.21.15.28:0/1979862180 reap_dead start 2024-04-23T18:23:00.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febe1e00640 1 -- 172.21.15.28:0/1979862180 shutdown_connections 2024-04-23T18:23:00.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febe1e00640 1 -- 172.21.15.28:0/1979862180 >> 172.21.15.28:0/1979862180 conn(0x7febdc06e2f0 msgr2=0x7febdc15dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febe1e00640 1 -- 172.21.15.28:0/1979862180 shutdown_connections 2024-04-23T18:23:00.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.556+0000 7febe1e00640 1 -- 172.21.15.28:0/1979862180 wait complete. 2024-04-23T18:23:00.582 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:00.583 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T18:23:00.583 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:00.584 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T18:23:00.584 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:00.585 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T18:23:00.585 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:00.586 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T18:23:00.587 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:00.587 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T18:23:00.588 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:00.589 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T18:23:00.591 INFO:teuthology.orchestra.run.smithi028.stdout:55834574861 2024-04-23T18:23:00.592 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T18:23:00.602 INFO:teuthology.orchestra.run.smithi028.stdout:55834574858 2024-04-23T18:23:00.603 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T18:23:00.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.832+0000 7fe45de00640 1 Processor -- start 2024-04-23T18:23:00.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.832+0000 7fe45de00640 1 -- start start 2024-04-23T18:23:00.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.836+0000 7fe45de00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe4500d5000 0x7fe45004c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.836+0000 7fe45de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4500db440 0x7fe4500e5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.836+0000 7fe45de00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe45004c820 con 0x7fe4500347a0 2024-04-23T18:23:00.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.836+0000 7fe45de00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe45004b990 con 0x7fe4500d5000 2024-04-23T18:23:00.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.836+0000 7fe45de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe45004bc70 con 0x7fe4500db440 2024-04-23T18:23:00.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.836+0000 7fe456000640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe4500347a0 0x7fe4500dad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58604/0 (socket says 172.21.15.28:58604) 2024-04-23T18:23:00.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.836+0000 7fe456000640 1 -- 172.21.15.28:0/1649002031 learned_addr learned my addr 172.21.15.28:0/1649002031 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:00.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.840+0000 7f3963600640 1 Processor -- start 2024-04-23T18:23:00.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.840+0000 7f3963600640 1 -- start start 2024-04-23T18:23:00.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.836+0000 7fe457400640 1 --2- 172.21.15.28:0/1649002031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4500db440 0x7fe4500e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.836+0000 7fe456a00640 1 --2- 172.21.15.28:0/1649002031 >> v2:172.21.15.28:3300/0 conn(0x7fe4500d5000 0x7fe45004c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.840+0000 7fe455600640 1 -- 172.21.15.28:0/1649002031 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4170252271 0 0) 0x7fe448001120 con 0x7fe4500347a0 2024-04-23T18:23:00.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.840+0000 7fe455600640 1 -- 172.21.15.28:0/1649002031 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe43c003530 con 0x7fe4500347a0 2024-04-23T18:23:00.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.840+0000 7fe456a00640 1 -- 172.21.15.28:0/1649002031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4500db440 msgr2=0x7fe4500e5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.840+0000 7fe456a00640 1 --2- 172.21.15.28:0/1649002031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4500db440 0x7fe4500e5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.840+0000 7fe456a00640 1 -- 172.21.15.28:0/1649002031 >> v1:172.21.15.28:6789/0 conn(0x7fe4500347a0 legacy=0x7fe4500dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.840+0000 7fe456a00640 1 -- 172.21.15.28:0/1649002031 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe450006a50 con 0x7fe4500d5000 2024-04-23T18:23:00.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.840+0000 7fabbf000640 1 Processor -- start 2024-04-23T18:23:00.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.840+0000 7fabbf000640 1 -- start start 2024-04-23T18:23:00.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f3963600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f395c0c39e0 0x7f395c0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f3963600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f395c157cf0 con 0x7f395c0c87b0 2024-04-23T18:23:00.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fe456a00640 1 --2- 172.21.15.28:0/1649002031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4500d5000 0x7fe45004c2e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe458000b70 tx=0x7fe45809b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8ee061481f3111 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f3963600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f395c0c7c10 con 0x7f395c151480 2024-04-23T18:23:00.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f3963600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f395c0c79c0 con 0x7f395c0c39e0 2024-04-23T18:23:00.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f3960c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f395c151480 0x7f395c0c97c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40284/0 (socket says 172.21.15.28:40284) 2024-04-23T18:23:00.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f3960c00640 1 -- 172.21.15.28:0/3071154172 learned_addr learned my addr 172.21.15.28:0/3071154172 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:00.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f395be00640 1 --2- 172.21.15.28:0/3071154172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f395c0c39e0 0x7f395c0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fabbf000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fabb80cc250 0x7fabb80c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fe455600640 1 -- 172.21.15.28:0/1649002031 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458130070 con 0x7fe4500d5000 2024-04-23T18:23:00.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fe455600640 1 -- 172.21.15.28:0/1649002031 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45812b640 con 0x7fe4500d5000 2024-04-23T18:23:00.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fe455600640 1 -- 172.21.15.28:0/1649002031 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458130070 con 0x7fe4500d5000 2024-04-23T18:23:00.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f395b400640 1 -- 172.21.15.28:0/3071154172 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1028916835 0 0) 0x7f395c0c7c10 con 0x7f395c151480 2024-04-23T18:23:00.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f395b400640 1 -- 172.21.15.28:0/3071154172 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3944003530 con 0x7f395c151480 2024-04-23T18:23:00.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fabbdc00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fabb80cc250 0x7fabb80c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fabbd200640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fabb80c81a0 0x7fabb80c9a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40290/0 (socket says 172.21.15.28:40290) 2024-04-23T18:23:00.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f395be00640 1 -- 172.21.15.28:0/3071154172 >> v1:172.21.15.137:6789/0 conn(0x7f395c151480 legacy=0x7f395c0c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f395be00640 1 -- 172.21.15.28:0/3071154172 >> v1:172.21.15.28:6789/0 conn(0x7f395c0c87b0 legacy=0x7f395c0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7f395be00640 1 -- 172.21.15.28:0/3071154172 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c0c8fc0 con 0x7f395c0c39e0 2024-04-23T18:23:00.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fabbd200640 1 -- 172.21.15.28:0/2883658811 learned_addr learned my addr 172.21.15.28:0/2883658811 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:00.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fabbf000640 1 -- 172.21.15.28:0/2883658811 --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb80c8680 con 0x7fabb80ca160 2024-04-23T18:23:00.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fabbf000640 1 -- 172.21.15.28:0/2883658811 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb80c8940 con 0x7fabb80c81a0 2024-04-23T18:23:00.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fabbf000640 1 -- 172.21.15.28:0/2883658811 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fabb80c8c20 con 0x7fabb80cc250 2024-04-23T18:23:00.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 119780273 0 0) 0x7fabb80c8940 con 0x7fabb80c81a0 2024-04-23T18:23:00.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.844+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faba0003530 con 0x7fabb80c81a0 2024-04-23T18:23:00.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fb6bb200640 1 Processor -- start 2024-04-23T18:23:00.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2308833532 0 0) 0x7fabb80c8680 con 0x7fabb80ca160 2024-04-23T18:23:00.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabb80c8940 con 0x7fabb80ca160 2024-04-23T18:23:00.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fb6bb200640 1 -- start start 2024-04-23T18:23:00.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 170566497 0 0) 0x7faba0003530 con 0x7fabb80c81a0 2024-04-23T18:23:00.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fe45de00640 1 -- 172.21.15.28:0/1649002031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4500d5000 msgr2=0x7fe45004c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fe45de00640 1 --2- 172.21.15.28:0/1649002031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4500d5000 0x7fe45004c2e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe458000b70 tx=0x7fe45809b610 comp rx=0 tx=0).stop 2024-04-23T18:23:00.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 >> v2:172.21.15.28:3300/0 conn(0x7fabb80cc250 msgr2=0x7fabb80c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 --2- 172.21.15.28:0/2883658811 >> v2:172.21.15.28:3300/0 conn(0x7fabb80cc250 0x7fabb80c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 >> v1:172.21.15.28:6789/0 conn(0x7fabb80ca160 legacy=0x7fabb80ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb80c8f70 con 0x7fabb80c81a0 2024-04-23T18:23:00.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7fabb0001680 con 0x7fabb80c81a0 2024-04-23T18:23:00.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 >> v1:172.21.15.137:6789/0 conn(0x7fabb80c81a0 legacy=0x7fabb80c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 --2- 172.21.15.28:0/2883658811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faba0003ba0 0x7faba0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 --2- 172.21.15.28:0/2883658811 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faba0004810 0x7faba0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 --2- 172.21.15.28:0/2883658811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba00051d0 0x7faba000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fabb80c8c20 con 0x7faba0004810 2024-04-23T18:23:00.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faba000bff0 con 0x7faba0003ba0 2024-04-23T18:23:00.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faba000c1f0 con 0x7faba00051d0 2024-04-23T18:23:00.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fe45de00640 1 -- 172.21.15.28:0/1649002031 shutdown_connections 2024-04-23T18:23:00.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fe45de00640 1 --2- 172.21.15.28:0/1649002031 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4500db440 0x7fe4500e5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fe45de00640 1 --2- 172.21.15.28:0/1649002031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4500d5000 0x7fe45004c2e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fe45de00640 1 -- 172.21.15.28:0/1649002031 >> 172.21.15.28:0/1649002031 conn(0x7fe450050190 msgr2=0x7fe4500505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabbd200640 1 --2- 172.21.15.28:0/2883658811 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faba0004810 0x7faba0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabbdc00640 1 --2- 172.21.15.28:0/2883658811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faba0003ba0 0x7faba0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabbe600640 1 --2- 172.21.15.28:0/2883658811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba00051d0 0x7faba000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabbd200640 1 -- 172.21.15.28:0/2883658811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba00051d0 msgr2=0x7faba000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabbd200640 1 --2- 172.21.15.28:0/2883658811 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba00051d0 0x7faba000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabbd200640 1 -- 172.21.15.28:0/2883658811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faba0003ba0 msgr2=0x7faba0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabbd200640 1 --2- 172.21.15.28:0/2883658811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faba0003ba0 0x7faba0003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabbd200640 1 -- 172.21.15.28:0/2883658811 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba0003530 con 0x7faba0004810 2024-04-23T18:23:00.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fabbe600640 1 -- 172.21.15.28:0/2883658811 reap_dead start 2024-04-23T18:23:00.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fe45de00640 1 -- 172.21.15.28:0/1649002031 shutdown_connections 2024-04-23T18:23:00.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fe45de00640 1 -- 172.21.15.28:0/1649002031 wait complete. 2024-04-23T18:23:00.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fb6bb200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb6b40cc7a0 0x7fb6b40713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fb6bb200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb6b4157170 0x7fb6b40718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fb6bb200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b4157600 con 0x7fb6b40ccb80 2024-04-23T18:23:00.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fb6bb200640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b41578e0 con 0x7fb6b4157170 2024-04-23T18:23:00.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fb6bb200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b4157bc0 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fb6b3400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb6b4157170 0x7fb6b40718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fb6b3400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb6b4157170 0x7fb6b40718e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41026/0 (socket says 172.21.15.28:41026) 2024-04-23T18:23:00.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fb6b3400640 1 -- 172.21.15.28:0/3936536937 learned_addr learned my addr 172.21.15.28:0/3936536937 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.848+0000 7fb6b3e00640 1 --2- 172.21.15.28:0/3936536937 >> v2:172.21.15.137:3300/0 conn(0x7fb6b40cc7a0 0x7fb6b40713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fb6b3400640 1 -- 172.21.15.28:0/3936536937 >> v2:172.21.15.137:3300/0 conn(0x7fb6b40cc7a0 msgr2=0x7fb6b40713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fb6b3400640 1 --2- 172.21.15.28:0/3936536937 >> v2:172.21.15.137:3300/0 conn(0x7fb6b40cc7a0 0x7fb6b40713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fb6b3400640 1 -- 172.21.15.28:0/3936536937 >> v1:172.21.15.28:6789/0 conn(0x7fb6b40ccb80 legacy=0x7fb6b4150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fb6b3400640 1 -- 172.21.15.28:0/3936536937 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b4157ea0 con 0x7fb6b4157170 2024-04-23T18:23:00.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fb6b3e00640 1 --2- 172.21.15.28:0/3936536937 >> v2:172.21.15.137:3300/0 conn(0x7fb6b40cc7a0 0x7fb6b40713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:00.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f05c9800640 1 Processor -- start 2024-04-23T18:23:00.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fe45de00640 1 Processor -- start 2024-04-23T18:23:00.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fc91ae00640 1 Processor -- start 2024-04-23T18:23:00.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fe45de00640 1 -- start start 2024-04-23T18:23:00.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fc91ae00640 1 -- start start 2024-04-23T18:23:00.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f395be00640 1 --2- 172.21.15.28:0/3071154172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f395c0c39e0 0x7f395c0c7ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f39480097c0 tx=0x7f394801e630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a81ef2686f0210f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f05c9800640 1 -- start start 2024-04-23T18:23:00.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fe45de00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4500347a0 0x7fe4500d7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fe45de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4500d5000 0x7fe450174bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fe45de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4500db440 0x7fe450175100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fe45de00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe450045130 con 0x7fe4500347a0 2024-04-23T18:23:00.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fe45de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe450007010 con 0x7fe4500d5000 2024-04-23T18:23:00.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fe45de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe4500d53e0 con 0x7fe4500db440 2024-04-23T18:23:00.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f05c9800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f05c40c3d70 0x7f05c415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f05c9800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f05c40c75c0 0x7f05c40c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f05c9800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c4160490 con 0x7f05c4159770 2024-04-23T18:23:00.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f05c9800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f05c415fbf0 con 0x7f05c40c75c0 2024-04-23T18:23:00.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f05c9800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f05c415fed0 con 0x7f05c40c3d70 2024-04-23T18:23:00.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f395b400640 1 -- 172.21.15.28:0/3071154172 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39480ad640 con 0x7f395c0c39e0 2024-04-23T18:23:00.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f395b400640 1 -- 172.21.15.28:0/3071154172 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39480b2070 con 0x7f395c0c39e0 2024-04-23T18:23:00.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f395b400640 1 -- 172.21.15.28:0/3071154172 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39480ada00 con 0x7f395c0c39e0 2024-04-23T18:23:00.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f05c2000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f05c40c3d70 0x7f05c415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f05c2000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f05c40c3d70 0x7f05c415f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42862/0 (socket says 172.21.15.28:42862) 2024-04-23T18:23:00.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f05c2000640 1 -- 172.21.15.28:0/907558366 learned_addr learned my addr 172.21.15.28:0/907558366 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fc91ae00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc9140cc250 0x7fc9140c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fe456000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4500d5000 0x7fe450174bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fabbd200640 1 --2- 172.21.15.28:0/2883658811 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faba0004810 0x7faba0004c90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fabb80c85b0 tx=0x7fabb001f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d44c3fb26698cc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fc91ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9140c81a0 0x7fc9140c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f3963600640 1 -- 172.21.15.28:0/3071154172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f395c0c39e0 msgr2=0x7f395c0c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f3963600640 1 --2- 172.21.15.28:0/3071154172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f395c0c39e0 0x7f395c0c7ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f39480097c0 tx=0x7f394801e630 comp rx=0 tx=0).stop 2024-04-23T18:23:00.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7fe457400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4500db440 0x7fe450175100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe456a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4500347a0 0x7fe4500d7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.852+0000 7f05c3400640 1 --2- 172.21.15.28:0/907558366 >> v2:172.21.15.28:3300/0 conn(0x7f05c40c75c0 0x7f05c40c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f05c2000640 1 -- 172.21.15.28:0/907558366 >> v2:172.21.15.28:3300/0 conn(0x7f05c40c75c0 msgr2=0x7f05c40c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f3963600640 1 -- 172.21.15.28:0/3071154172 shutdown_connections 2024-04-23T18:23:00.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f05c2000640 1 --2- 172.21.15.28:0/907558366 >> v2:172.21.15.28:3300/0 conn(0x7f05c40c75c0 0x7f05c40c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f05c2000640 1 -- 172.21.15.28:0/907558366 >> v1:172.21.15.28:6789/0 conn(0x7f05c4159770 legacy=0x7f05c41633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f3963600640 1 --2- 172.21.15.28:0/3071154172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f395c0c39e0 0x7f395c0c7ef0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f3963600640 1 -- 172.21.15.28:0/3071154172 >> 172.21.15.28:0/3071154172 conn(0x7f395c0676e0 msgr2=0x7f395c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f3963600640 1 -- 172.21.15.28:0/3071154172 shutdown_connections 2024-04-23T18:23:00.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc919a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc9140cc250 0x7fc9140c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc919a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc9140cc250 0x7fc9140c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42872/0 (socket says 172.21.15.28:42872) 2024-04-23T18:23:00.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe456a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4500347a0 0x7fe4500d7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41032/0 (socket says 172.21.15.28:41032) 2024-04-23T18:23:00.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe456a00640 1 -- 172.21.15.28:0/2028565704 learned_addr learned my addr 172.21.15.28:0/2028565704 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0007c30 con 0x7faba0004810 2024-04-23T18:23:00.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb00ac070 con 0x7faba0004810 2024-04-23T18:23:00.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fabb7e00640 1 -- 172.21.15.28:0/2883658811 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0005b20 con 0x7faba0004810 2024-04-23T18:23:00.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f05c2000640 1 -- 172.21.15.28:0/907558366 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c41601b0 con 0x7f05c40c3d70 2024-04-23T18:23:00.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc91a400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc9140cc630 0x7fc914163140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40302/0 (socket says 172.21.15.28:40302) 2024-04-23T18:23:00.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc91a400640 1 -- 172.21.15.28:0/3800057198 learned_addr learned my addr 172.21.15.28:0/3800057198 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:00.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc91ae00640 1 -- 172.21.15.28:0/3800057198 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9140c8680 con 0x7fc9140cc630 2024-04-23T18:23:00.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc91ae00640 1 -- 172.21.15.28:0/3800057198 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc9140c8940 con 0x7fc9140cc250 2024-04-23T18:23:00.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc91ae00640 1 -- 172.21.15.28:0/3800057198 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc9140c8c20 con 0x7fc9140c81a0 2024-04-23T18:23:00.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc919000640 1 --2- 172.21.15.28:0/3800057198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9140c81a0 0x7fc9140c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f3963600640 1 -- 172.21.15.28:0/3071154172 wait complete. 2024-04-23T18:23:00.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc913e00640 1 -- 172.21.15.28:0/3800057198 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4105212776 0 0) 0x7fc9140c8680 con 0x7fc9140cc630 2024-04-23T18:23:00.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc913e00640 1 -- 172.21.15.28:0/3800057198 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8fc003530 con 0x7fc9140cc630 2024-04-23T18:23:00.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe456a00640 1 -- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4500db440 msgr2=0x7fe450175100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe456a00640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4500db440 0x7fe450175100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe456a00640 1 -- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4500d5000 msgr2=0x7fe450174bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fabbf000640 1 -- 172.21.15.28:0/2883658811 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faba0004810 msgr2=0x7faba0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fabbf000640 1 --2- 172.21.15.28:0/2883658811 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faba0004810 0x7faba0004c90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fabb80c85b0 tx=0x7fabb001f270 comp rx=0 tx=0).stop 2024-04-23T18:23:00.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc919a00640 1 -- 172.21.15.28:0/3800057198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9140c81a0 msgr2=0x7fc9140c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc913e00640 1 -- 172.21.15.28:0/3800057198 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 149424505 0 0) 0x7fc8fc003530 con 0x7fc9140cc630 2024-04-23T18:23:00.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe456a00640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4500d5000 0x7fe450174bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe456a00640 1 -- 172.21.15.28:0/2028565704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4500d2af0 con 0x7fe4500347a0 2024-04-23T18:23:00.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc919a00640 1 --2- 172.21.15.28:0/3800057198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9140c81a0 0x7fc9140c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc919a00640 1 -- 172.21.15.28:0/3800057198 >> v1:172.21.15.137:6789/0 conn(0x7fc9140cc630 legacy=0x7fc914163140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fabbf000640 1 -- 172.21.15.28:0/2883658811 shutdown_connections 2024-04-23T18:23:00.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fabbf000640 1 --2- 172.21.15.28:0/2883658811 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faba0004810 0x7faba0004c90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fabbf000640 1 -- 172.21.15.28:0/2883658811 >> 172.21.15.28:0/2883658811 conn(0x7fabb8072dd0 msgr2=0x7fabb80731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fabbf000640 1 -- 172.21.15.28:0/2883658811 shutdown_connections 2024-04-23T18:23:00.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc919a00640 1 -- 172.21.15.28:0/3800057198 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9140c8f70 con 0x7fc9140cc250 2024-04-23T18:23:00.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe456a00640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4500347a0 0x7fe4500d7ad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe458051690 tx=0x7fe458099ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fc919000640 1 --2- 172.21.15.28:0/3800057198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9140c81a0 0x7fc9140c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:00.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f3963600640 1 Processor -- start 2024-04-23T18:23:00.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fabbf000640 1 -- 172.21.15.28:0/2883658811 wait complete. 2024-04-23T18:23:00.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe44f400640 1 -- 172.21.15.28:0/2028565704 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458130070 con 0x7fe4500347a0 2024-04-23T18:23:00.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f9f71400640 1 Processor -- start 2024-04-23T18:23:00.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f05c3400640 1 --2- 172.21.15.28:0/907558366 >> v2:172.21.15.28:3300/0 conn(0x7f05c40c75c0 0x7f05c40c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:00.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe44f400640 1 -- 172.21.15.28:0/2028565704 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45813a070 con 0x7fe4500347a0 2024-04-23T18:23:00.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7fe44f400640 1 -- 172.21.15.28:0/2028565704 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458134850 con 0x7fe4500347a0 2024-04-23T18:23:00.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f9f71400640 1 -- start start 2024-04-23T18:23:00.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6b3400640 1 --2- 172.21.15.28:0/3936536937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6b4157170 0x7fb6b40718e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4008870 tx=0x7fb6a401ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c10c94b93dd26f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.856+0000 7f3963600640 1 -- start start 2024-04-23T18:23:00.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6b2a00640 1 -- 172.21.15.28:0/3936536937 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40ad070 con 0x7fb6b4157170 2024-04-23T18:23:00.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fabbf000640 1 Processor -- start 2024-04-23T18:23:00.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6b2a00640 1 -- 172.21.15.28:0/3936536937 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a40a7a10 con 0x7fb6b4157170 2024-04-23T18:23:00.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6b2a00640 1 -- 172.21.15.28:0/3936536937 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40a7de0 con 0x7fb6b4157170 2024-04-23T18:23:00.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f71400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f6c15b1b0 0x7f9f6c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f71400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c0c6690 0x7f9f6c072c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f71400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6c15b600 con 0x7f9f6c1521f0 2024-04-23T18:23:00.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f71400640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f9f6c0c5cc0 con 0x7f9f6c15b1b0 2024-04-23T18:23:00.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f71400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6c15c150 con 0x7f9f6c0c6690 2024-04-23T18:23:00.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fabbf000640 1 -- start start 2024-04-23T18:23:00.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f6a800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9f6c1521f0 0x7f9f6c15f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40310/0 (socket says 172.21.15.28:40310) 2024-04-23T18:23:00.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f6a800640 1 -- 172.21.15.28:0/2813419858 learned_addr learned my addr 172.21.15.28:0/2813419858 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:00.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f63e00640 1 --2- 172.21.15.28:0/2813419858 >> v2:172.21.15.28:3300/0 conn(0x7f9f6c15b1b0 0x7f9f6c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f6b200640 1 --2- 172.21.15.28:0/2813419858 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c0c6690 0x7f9f6c072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f63e00640 1 -- 172.21.15.28:0/2813419858 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c0c6690 msgr2=0x7f9f6c072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f63e00640 1 --2- 172.21.15.28:0/2813419858 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c0c6690 0x7f9f6c072c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f63e00640 1 -- 172.21.15.28:0/2813419858 >> v1:172.21.15.137:6789/0 conn(0x7f9f6c1521f0 legacy=0x7f9f6c15f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f69e00640 1 -- 172.21.15.28:0/2813419858 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4222033098 0 0) 0x7f9f6c15b600 con 0x7f9f6c1521f0 2024-04-23T18:23:00.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f9f63e00640 1 -- 172.21.15.28:0/2813419858 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6c15b8b0 con 0x7f9f6c15b1b0 2024-04-23T18:23:00.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6bb200640 1 -- 172.21.15.28:0/3936536937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6b4157170 msgr2=0x7fb6b40718e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6bb200640 1 --2- 172.21.15.28:0/3936536937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6b4157170 0x7fb6b40718e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4008870 tx=0x7fb6a401ea30 comp rx=0 tx=0).stop 2024-04-23T18:23:00.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6bb200640 1 -- 172.21.15.28:0/3936536937 shutdown_connections 2024-04-23T18:23:00.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6bb200640 1 --2- 172.21.15.28:0/3936536937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6b4157170 0x7fb6b40718e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6bb200640 1 --2- 172.21.15.28:0/3936536937 >> v2:172.21.15.137:3300/0 conn(0x7fb6b40cc7a0 0x7fb6b40713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6bb200640 1 -- 172.21.15.28:0/3936536937 >> 172.21.15.28:0/3936536937 conn(0x7fb6b4075e30 msgr2=0x7fb6b40676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6bb200640 1 -- 172.21.15.28:0/3936536937 shutdown_connections 2024-04-23T18:23:00.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fb6bb200640 1 -- 172.21.15.28:0/3936536937 wait complete. 2024-04-23T18:23:00.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f05c2000640 1 --2- 172.21.15.28:0/907558366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c40c3d70 0x7f05c415f4f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05c4160660 tx=0x7f05bc01c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaf1a1548f699c76 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f05c1600640 1 -- 172.21.15.28:0/907558366 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0a5780 con 0x7f05c40c3d70 2024-04-23T18:23:00.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f3963600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f395c0c39e0 0x7f395c153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f05c1600640 1 -- 172.21.15.28:0/907558366 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05bc0a5920 con 0x7f05c40c3d70 2024-04-23T18:23:00.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f05c1600640 1 -- 172.21.15.28:0/907558366 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0a5cf0 con 0x7f05c40c3d70 2024-04-23T18:23:00.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f3963600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f395c0c87b0 0x7f395c152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f3963600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f395c151480 0x7f395c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f3963600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f395c165560 con 0x7f395c0c39e0 2024-04-23T18:23:00.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f3963600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f395c0c9330 con 0x7f395c0c87b0 2024-04-23T18:23:00.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f3963600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f395c1656e0 con 0x7f395c151480 2024-04-23T18:23:00.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f3960c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f395c0c39e0 0x7f395c153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f3960c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f395c0c39e0 0x7f395c153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41072/0 (socket says 172.21.15.28:41072) 2024-04-23T18:23:00.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f3960c00640 1 -- 172.21.15.28:0/2434107976 learned_addr learned my addr 172.21.15.28:0/2434107976 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7f395be00640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f395c0c87b0 0x7f395c152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fe45de00640 1 -- 172.21.15.28:0/2028565704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4501780d0 con 0x7fe4500347a0 2024-04-23T18:23:00.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fe45de00640 1 -- 172.21.15.28:0/2028565704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe450178690 con 0x7fe4500347a0 2024-04-23T18:23:00.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fabbf000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba0004810 0x7fabb80cf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fabbf000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb815a2b0 0x7fabb8070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fabbf000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabb80712e0 0x7fabb8159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fabbf000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fabb80cc630 con 0x7fabb80712e0 2024-04-23T18:23:00.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fabbf000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fabb80c9530 con 0x7fabb815a2b0 2024-04-23T18:23:00.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.860+0000 7fabbf000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fabb80cc7b0 con 0x7faba0004810 2024-04-23T18:23:00.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabbdc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba0004810 0x7fabb80cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabbdc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba0004810 0x7fabb80cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:42902/0 (socket says 172.21.15.28:42902) 2024-04-23T18:23:00.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabbdc00640 1 -- 172.21.15.28:0/1106579010 learned_addr learned my addr 172.21.15.28:0/1106579010 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fc919a00640 1 --2- 172.21.15.28:0/3800057198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9140cc250 0x7fc9140c7c60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009d90 tx=0x7fc90c01f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecb543642de56bd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabbd200640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb815a2b0 0x7fabb8070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f395be00640 1 -- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f395c151480 msgr2=0x7f395c15a7a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T18:23:00.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f395be00640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f395c151480 0x7f395c15a7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f395be00640 1 -- 172.21.15.28:0/2434107976 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f395c0c39e0 msgr2=0x7f395c153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f395be00640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f395c0c39e0 0x7f395c153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f395be00640 1 -- 172.21.15.28:0/2434107976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c15c280 con 0x7f395c0c87b0 2024-04-23T18:23:00.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f3960c00640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f395c0c39e0 0x7f395c153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:00.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fe45de00640 1 -- 172.21.15.28:0/2028565704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4500053a0 con 0x7fe4500347a0 2024-04-23T18:23:00.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6bb200640 1 Processor -- start 2024-04-23T18:23:00.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f05c9800640 1 -- 172.21.15.28:0/907558366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c40c3d70 msgr2=0x7f05c415f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f05c9800640 1 --2- 172.21.15.28:0/907558366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c40c3d70 0x7f05c415f4f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05c4160660 tx=0x7f05bc01c9d0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6bb200640 1 -- start start 2024-04-23T18:23:00.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fc913e00640 1 -- 172.21.15.28:0/3800057198 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0b5070 con 0x7fc9140cc250 2024-04-23T18:23:00.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fc913e00640 1 -- 172.21.15.28:0/3800057198 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc90c0a8bd0 con 0x7fc9140cc250 2024-04-23T18:23:00.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fc913e00640 1 -- 172.21.15.28:0/3800057198 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900001680 con 0x7fc9140cc250 2024-04-23T18:23:00.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabbe600640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabb80712e0 0x7fabb8159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f05c9800640 1 -- 172.21.15.28:0/907558366 shutdown_connections 2024-04-23T18:23:00.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f395be00640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f395c0c87b0 0x7f395c152430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f39480ae000 tx=0x7f394801ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabbdc00640 1 -- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb815a2b0 msgr2=0x7fabb8070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabbdc00640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb815a2b0 0x7fabb8070da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabbdc00640 1 -- 172.21.15.28:0/1106579010 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabb80712e0 msgr2=0x7fabb8159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabbdc00640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabb80712e0 0x7fabb8159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabbdc00640 1 -- 172.21.15.28:0/1106579010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb80ce130 con 0x7faba0004810 2024-04-23T18:23:00.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fc91ae00640 1 -- 172.21.15.28:0/3800057198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9140cc250 msgr2=0x7fc9140c7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fc91ae00640 1 --2- 172.21.15.28:0/3800057198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9140cc250 0x7fc9140c7c60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009d90 tx=0x7fc90c01f080 comp rx=0 tx=0).stop 2024-04-23T18:23:00.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabbdc00640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba0004810 0x7fabb80cf770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faba4011930 tx=0x7faba4011df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6bb200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6b40cc7a0 0x7fb6b42048a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6bb200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6b40ccb80 0x7fb6b4154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f05c9800640 1 --2- 172.21.15.28:0/907558366 >> v2:172.21.15.28:3300/0 conn(0x7f05c40c75c0 0x7f05c40c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f05c9800640 1 --2- 172.21.15.28:0/907558366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c40c3d70 0x7f05c415f4f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f05c9800640 1 -- 172.21.15.28:0/907558366 >> 172.21.15.28:0/907558366 conn(0x7f05c4075e30 msgr2=0x7f05c40676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f3958c00640 1 -- 172.21.15.28:0/2434107976 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39480bc070 con 0x7f395c0c87b0 2024-04-23T18:23:00.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabb5600640 1 -- 172.21.15.28:0/1106579010 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4019070 con 0x7faba0004810 2024-04-23T18:23:00.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6bb200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6b4155610 0x7fb6b4201d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6bb200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b4163a40 con 0x7fb6b40ccb80 2024-04-23T18:23:00.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6bb200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b40c9f00 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6bb200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b4163bc0 con 0x7fb6b4155610 2024-04-23T18:23:00.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6b3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6b40cc7a0 0x7fb6b42048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6b3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6b40cc7a0 0x7fb6b42048a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42890/0 (socket says 172.21.15.28:42890) 2024-04-23T18:23:00.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6b3e00640 1 -- 172.21.15.28:0/602271209 learned_addr learned my addr 172.21.15.28:0/602271209 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f05c9800640 1 -- 172.21.15.28:0/907558366 shutdown_connections 2024-04-23T18:23:00.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f3958c00640 1 -- 172.21.15.28:0/2434107976 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39480ade00 con 0x7f395c0c87b0 2024-04-23T18:23:00.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabb5600640 1 -- 172.21.15.28:0/1106579010 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba4004240 con 0x7faba0004810 2024-04-23T18:23:00.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fabb5600640 1 -- 172.21.15.28:0/1106579010 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4019070 con 0x7faba0004810 2024-04-23T18:23:00.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f05c9800640 1 -- 172.21.15.28:0/907558366 wait complete. 2024-04-23T18:23:00.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f3958c00640 1 -- 172.21.15.28:0/2434107976 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39480b6660 con 0x7f395c0c87b0 2024-04-23T18:23:00.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7f3963600640 1 -- 172.21.15.28:0/2434107976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395c153fb0 con 0x7f395c0c87b0 2024-04-23T18:23:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6b3e00640 1 -- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6b4155610 msgr2=0x7fb6b4201d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T18:23:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6b3e00640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6b4155610 0x7fb6b4201d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6b3e00640 1 -- 172.21.15.28:0/602271209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6b40ccb80 msgr2=0x7fb6b4154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6b3e00640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6b40ccb80 0x7fb6b4154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.864+0000 7fb6b3e00640 1 -- 172.21.15.28:0/602271209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b4204de0 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7f3963600640 1 -- 172.21.15.28:0/2434107976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395c1f9e20 con 0x7f395c0c87b0 2024-04-23T18:23:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fabbf000640 1 -- 172.21.15.28:0/1106579010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb81f5650 con 0x7faba0004810 2024-04-23T18:23:00.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fabbf000640 1 -- 172.21.15.28:0/1106579010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb81f5bf0 con 0x7faba0004810 2024-04-23T18:23:00.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fb6b3e00640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6b40cc7a0 0x7fb6b42048a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009fc0 tx=0x7fb6ac00d560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fb6abe00640 1 -- 172.21.15.28:0/602271209 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac01a070 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fb6abe00640 1 -- 172.21.15.28:0/602271209 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ac003ba0 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fb6abe00640 1 -- 172.21.15.28:0/602271209 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac004030 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fb6bb200640 1 -- 172.21.15.28:0/602271209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b4158370 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fb6bb200640 1 -- 172.21.15.28:0/602271209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b4158930 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fabbf000640 1 -- 172.21.15.28:0/1106579010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb8074290 con 0x7faba0004810 2024-04-23T18:23:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fe44f400640 1 -- 172.21.15.28:0/2028565704 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4581349f0 con 0x7fe4500347a0 2024-04-23T18:23:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fe44f400640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4380683d0 0x7fe43806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fe44f400640 1 -- 172.21.15.28:0/2028565704 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe45816eff0 con 0x7fe4500347a0 2024-04-23T18:23:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fe456000640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4380683d0 0x7fe43806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7f05c9800640 1 Processor -- start 2024-04-23T18:23:00.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7f05c9800640 1 -- start start 2024-04-23T18:23:00.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7f3963600640 1 -- 172.21.15.28:0/2434107976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395c068cd0 con 0x7f395c0c87b0 2024-04-23T18:23:00.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fc91ae00640 1 -- 172.21.15.28:0/3800057198 shutdown_connections 2024-04-23T18:23:00.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fc91ae00640 1 --2- 172.21.15.28:0/3800057198 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9140c81a0 0x7fc9140c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fc91ae00640 1 --2- 172.21.15.28:0/3800057198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9140cc250 0x7fc9140c7c60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fc91ae00640 1 -- 172.21.15.28:0/3800057198 >> 172.21.15.28:0/3800057198 conn(0x7fc914072dd0 msgr2=0x7fc9140731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fc91ae00640 1 -- 172.21.15.28:0/3800057198 shutdown_connections 2024-04-23T18:23:00.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fe456000640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4380683d0 0x7fe43806a890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe448007fd0 tx=0x7fe448009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.868+0000 7fc91ae00640 1 -- 172.21.15.28:0/3800057198 wait complete. 2024-04-23T18:23:00.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fabb5600640 1 -- 172.21.15.28:0/1106579010 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faba401c070 con 0x7faba0004810 2024-04-23T18:23:00.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f9f63e00640 1 --2- 172.21.15.28:0/2813419858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6c15b1b0 0x7f9f6c0c6150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0097c0 tx=0x7f9f5c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc4514c1c5b1ac1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f3958c00640 1 -- 172.21.15.28:0/2434107976 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f39480bf070 con 0x7f395c0c87b0 2024-04-23T18:23:00.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fabb5600640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fab980685b0 0x7fab9806aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fb6abe00640 1 -- 172.21.15.28:0/602271209 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6ac01d070 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fb6bb200640 1 -- 172.21.15.28:0/602271209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b4068db0 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fb6abe00640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb694068480 0x7fb69406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c40c3d70 0x7f05c4073680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c9800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c40c75c0 0x7f05c4152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c9800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05c4159770 0x7f05c406e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c9800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f05c40c4440 con 0x7f05c4159770 2024-04-23T18:23:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c9800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05c40c42c0 con 0x7f05c40c3d70 2024-04-23T18:23:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c9800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05c40c8ac0 con 0x7f05c40c75c0 2024-04-23T18:23:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05c4159770 0x7f05c406e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05c4159770 0x7f05c406e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41090/0 (socket says 172.21.15.28:41090) 2024-04-23T18:23:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c3400640 1 -- 172.21.15.28:0/2397558104 learned_addr learned my addr 172.21.15.28:0/2397558104 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fabbd200640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fab980685b0 0x7fab9806aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f3958c00640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f393c068480 0x7f393c06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fabb5600640 1 -- 172.21.15.28:0/1106579010 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faba4086d40 con 0x7faba0004810 2024-04-23T18:23:00.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fc91ae00640 1 Processor -- start 2024-04-23T18:23:00.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c2a00640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c40c3d70 0x7f05c4073680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f3958c00640 1 -- 172.21.15.28:0/2434107976 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3948120990 con 0x7f395c0c87b0 2024-04-23T18:23:00.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fc91ae00640 1 -- start start 2024-04-23T18:23:00.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fb6abe00640 1 -- 172.21.15.28:0/602271209 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb6ac086f50 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fb6b3400640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb694068480 0x7fb69406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c2000640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c40c75c0 0x7f05c4152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7fabbd200640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fab980685b0 0x7fab9806aa70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fabb00ae000 tx=0x7fabb00aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f3960c00640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f393c068480 0x7f393c06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c3400640 1 -- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c40c75c0 msgr2=0x7f05c4152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c3400640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c40c75c0 0x7f05c4152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c3400640 1 -- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c40c3d70 msgr2=0x7f05c4073680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c3400640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c40c3d70 0x7f05c4073680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.872+0000 7f05c3400640 1 -- 172.21.15.28:0/2397558104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c41f7fc0 con 0x7f05c4159770 2024-04-23T18:23:00.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f9f69e00640 1 -- 172.21.15.28:0/2813419858 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0b0070 con 0x7f9f6c15b1b0 2024-04-23T18:23:00.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f9f69e00640 1 -- 172.21.15.28:0/2813419858 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f5c0ab600 con 0x7f9f6c15b1b0 2024-04-23T18:23:00.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f9f69e00640 1 -- 172.21.15.28:0/2813419858 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0ab9d0 con 0x7f9f6c15b1b0 2024-04-23T18:23:00.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fb6b3400640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb694068480 0x7fb69406a940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40b2000 tx=0x7fb6a4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f3960c00640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f393c068480 0x7f393c06a940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3950005890 tx=0x7f3950009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9140c81a0 0x7fc91415da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fe44f400640 1 -- 172.21.15.28:0/2028565704 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe458095240 con 0x7fe4500347a0 2024-04-23T18:23:00.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f05c3400640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05c4159770 0x7f05c406e880 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f05b000c7f0 tx=0x7f05b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91ae00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9140cc250 0x7fc9141f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9140cc630 0x7fc9141f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91ae00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc9140cdd80 con 0x7fc9140cc250 2024-04-23T18:23:00.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9140c9530 con 0x7fc9140cc630 2024-04-23T18:23:00.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f9f71400640 1 -- 172.21.15.28:0/2813419858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6c15b1b0 msgr2=0x7f9f6c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f9f71400640 1 --2- 172.21.15.28:0/2813419858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6c15b1b0 0x7f9f6c0c6150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0097c0 tx=0x7f9f5c01c4a0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc9140cdf00 con 0x7fc9140c81a0 2024-04-23T18:23:00.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f05baa00640 1 -- 172.21.15.28:0/2397558104 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0015070 con 0x7f05c4159770 2024-04-23T18:23:00.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f05baa00640 1 -- 172.21.15.28:0/2397558104 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b0007860 con 0x7f05c4159770 2024-04-23T18:23:00.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f05baa00640 1 -- 172.21.15.28:0/2397558104 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0007c50 con 0x7f05c4159770 2024-04-23T18:23:00.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9140cc630 0x7fc9141f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9140cc630 0x7fc9141f8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42912/0 (socket says 172.21.15.28:42912) 2024-04-23T18:23:00.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91a400640 1 -- 172.21.15.28:0/306417215 learned_addr learned my addr 172.21.15.28:0/306417215 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc919a00640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9140c81a0 0x7fc91415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc919000640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9140cc250 0x7fc9141f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f9f71400640 1 -- 172.21.15.28:0/2813419858 shutdown_connections 2024-04-23T18:23:00.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f9f71400640 1 --2- 172.21.15.28:0/2813419858 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c0c6690 0x7f9f6c072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f9f71400640 1 --2- 172.21.15.28:0/2813419858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6c15b1b0 0x7f9f6c0c6150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f9f71400640 1 -- 172.21.15.28:0/2813419858 >> 172.21.15.28:0/2813419858 conn(0x7f9f6c075dd0 msgr2=0x7f9f6c06ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f9f71400640 1 -- 172.21.15.28:0/2813419858 shutdown_connections 2024-04-23T18:23:00.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f9f71400640 1 -- 172.21.15.28:0/2813419858 wait complete. 2024-04-23T18:23:00.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f05c9800640 1 -- 172.21.15.28:0/2397558104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c41f8240 con 0x7f05c4159770 2024-04-23T18:23:00.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f05c9800640 1 -- 172.21.15.28:0/2397558104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c41f8800 con 0x7f05c4159770 2024-04-23T18:23:00.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91a400640 1 -- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9140c81a0 msgr2=0x7fc91415da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91a400640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9140c81a0 0x7fc91415da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91a400640 1 -- 172.21.15.28:0/306417215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9140cc250 msgr2=0x7fc9141f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91a400640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9140cc250 0x7fc9141f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91a400640 1 -- 172.21.15.28:0/306417215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9140b04e0 con 0x7fc9140cc630 2024-04-23T18:23:00.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7fc91a400640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9140cc630 0x7fc9141f8f60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc90000c6d0 tx=0x7fc90000cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.876+0000 7f05c9800640 1 -- 172.21.15.28:0/2397558104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c4068db0 con 0x7f05c4159770 2024-04-23T18:23:00.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f71400640 1 Processor -- start 2024-04-23T18:23:00.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f71400640 1 -- start start 2024-04-23T18:23:00.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f05baa00640 1 -- 172.21.15.28:0/2397558104 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05b0018070 con 0x7f05c4159770 2024-04-23T18:23:00.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f71400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6c0c6690 0x7f9f6c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f71400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c1521f0 0x7f9f6c14bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f71400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f6c15b1b0 0x7f9f6c1f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f71400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c0cb640 con 0x7f9f6c0c6690 2024-04-23T18:23:00.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f71400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c0cb4c0 con 0x7f9f6c15b1b0 2024-04-23T18:23:00.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f71400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6c168350 con 0x7f9f6c1521f0 2024-04-23T18:23:00.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f05baa00640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05a40683d0 0x7f05a406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f05baa00640 1 -- 172.21.15.28:0/2397558104 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f05b00871f0 con 0x7f05c4159770 2024-04-23T18:23:00.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7fabb5600640 1 -- 172.21.15.28:0/1106579010 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faba4056840 con 0x7faba0004810 2024-04-23T18:23:00.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f63e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c1521f0 0x7f9f6c14bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f6a800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6c0c6690 0x7f9f6c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f63e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c1521f0 0x7f9f6c14bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:42944/0 (socket says 172.21.15.28:42944) 2024-04-23T18:23:00.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f63e00640 1 -- 172.21.15.28:0/395801585 learned_addr learned my addr 172.21.15.28:0/395801585 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f05c2a00640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05a40683d0 0x7f05a406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f63e00640 1 -- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f6c15b1b0 msgr2=0x7f9f6c1f6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f63e00640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f6c15b1b0 0x7f9f6c1f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f63e00640 1 -- 172.21.15.28:0/395801585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6c0c6690 msgr2=0x7f9f6c14b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f63e00640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6c0c6690 0x7f9f6c14b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f63e00640 1 -- 172.21.15.28:0/395801585 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6c1f5a70 con 0x7f9f6c1521f0 2024-04-23T18:23:00.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.880+0000 7f9f6a800640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6c0c6690 0x7f9f6c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:00.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.884+0000 7f9f63e00640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c1521f0 0x7f9f6c14bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0ae040 tx=0x7f9f5c019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.884+0000 7f9f62a00640 1 -- 172.21.15.28:0/395801585 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0ba070 con 0x7f9f6c1521f0 2024-04-23T18:23:00.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.884+0000 7f9f62a00640 1 -- 172.21.15.28:0/395801585 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f5c0b43f0 con 0x7f9f6c1521f0 2024-04-23T18:23:00.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.884+0000 7f9f62a00640 1 -- 172.21.15.28:0/395801585 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0b0040 con 0x7f9f6c1521f0 2024-04-23T18:23:00.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.884+0000 7f05c2a00640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05a40683d0 0x7f05a406a890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f05b40098e0 tx=0x7f05b4009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.884+0000 7f9f71400640 1 -- 172.21.15.28:0/395801585 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f6c1f5d50 con 0x7f9f6c1521f0 2024-04-23T18:23:00.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.884+0000 7f9f71400640 1 -- 172.21.15.28:0/395801585 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f6c1f6310 con 0x7f9f6c1521f0 2024-04-23T18:23:00.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.884+0000 7f9f71400640 1 -- 172.21.15.28:0/395801585 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f6c068db0 con 0x7f9f6c1521f0 2024-04-23T18:23:00.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.884+0000 7f9f62a00640 1 -- 172.21.15.28:0/395801585 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f5c0bd070 con 0x7f9f6c1521f0 2024-04-23T18:23:00.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.888+0000 7f9f62a00640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9f480683d0 0x7f9f4806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.888+0000 7f9f62a00640 1 -- 172.21.15.28:0/395801585 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9f5c11fff0 con 0x7f9f6c1521f0 2024-04-23T18:23:00.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.888+0000 7f9f6a800640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9f480683d0 0x7f9f4806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.888+0000 7f05baa00640 1 -- 172.21.15.28:0/2397558104 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f05c41f7fc0 con 0x7f05c4159770 2024-04-23T18:23:00.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.888+0000 7f3958c00640 1 -- 172.21.15.28:0/2434107976 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39480c6020 con 0x7f395c0c87b0 2024-04-23T18:23:00.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.888+0000 7f9f6a800640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9f480683d0 0x7f9f4806a890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9f54000f70 tx=0x7f9f54007df0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2fa600640 1 Processor -- start 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2fa600640 1 -- start start 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2fa600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2f4159570 0x7fa2f4070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2fa600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa2f4071d30 0x7fa2f40721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2fa600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f4159950 con 0x7fa2f40728c0 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2fa600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f415ffa0 con 0x7fa2f4071d30 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2fa600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f4070650 con 0x7fa2f4159570 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2f9200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2f4159570 0x7fa2f4070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2f9c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa2f4071d30 0x7fa2f40721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2f9200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2f4159570 0x7fa2f4070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:42952/0 (socket says 172.21.15.28:42952) 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2f9200640 1 -- 172.21.15.28:0/3995450953 learned_addr learned my addr 172.21.15.28:0/3995450953 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2f9c00640 1 -- 172.21.15.28:0/3995450953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2f4159570 msgr2=0x7fa2f4070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2f9c00640 1 --2- 172.21.15.28:0/3995450953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2f4159570 0x7fa2f4070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2f9c00640 1 -- 172.21.15.28:0/3995450953 >> v1:172.21.15.137:6789/0 conn(0x7fa2f40728c0 legacy=0x7fa2f4163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.908+0000 7fa2f9c00640 1 -- 172.21.15.28:0/3995450953 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f415f390 con 0x7fa2f4071d30 2024-04-23T18:23:00.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7f9f62a00640 1 -- 172.21.15.28:0/395801585 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f5c0c5080 con 0x7f9f6c1521f0 2024-04-23T18:23:00.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fc911600640 1 -- 172.21.15.28:0/306417215 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900005ae0 con 0x7fc9140cc630 2024-04-23T18:23:00.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fc911600640 1 -- 172.21.15.28:0/306417215 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc900005c80 con 0x7fc9140cc630 2024-04-23T18:23:00.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fc911600640 1 -- 172.21.15.28:0/306417215 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900007290 con 0x7fc9140cc630 2024-04-23T18:23:00.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fa2f9c00640 1 --2- 172.21.15.28:0/3995450953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f4071d30 0x7fa2f40721b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4160120 tx=0x7fa2ec01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ca098f474df58a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fa2f3400640 1 -- 172.21.15.28:0/3995450953 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0b4070 con 0x7fa2f4071d30 2024-04-23T18:23:00.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fa2f3400640 1 -- 172.21.15.28:0/3995450953 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ec0af600 con 0x7fa2f4071d30 2024-04-23T18:23:00.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fa2f3400640 1 -- 172.21.15.28:0/3995450953 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0af9d0 con 0x7fa2f4071d30 2024-04-23T18:23:00.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fc91ae00640 1 -- 172.21.15.28:0/306417215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc914071690 con 0x7fc9140cc630 2024-04-23T18:23:00.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fc91ae00640 1 -- 172.21.15.28:0/306417215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9141f9930 con 0x7fc9140cc630 2024-04-23T18:23:00.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fa2fa600640 1 -- 172.21.15.28:0/3995450953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f4071d30 msgr2=0x7fa2f40721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fa2fa600640 1 --2- 172.21.15.28:0/3995450953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f4071d30 0x7fa2f40721b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4160120 tx=0x7fa2ec01f130 comp rx=0 tx=0).stop 2024-04-23T18:23:00.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fa2fa600640 1 -- 172.21.15.28:0/3995450953 shutdown_connections 2024-04-23T18:23:00.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fa2fa600640 1 --2- 172.21.15.28:0/3995450953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f4071d30 0x7fa2f40721b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fa2fa600640 1 --2- 172.21.15.28:0/3995450953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2f4159570 0x7fa2f4070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.912+0000 7fa2fa600640 1 -- 172.21.15.28:0/3995450953 >> 172.21.15.28:0/3995450953 conn(0x7fa2f406b9e0 msgr2=0x7fa2f406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:00.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.916+0000 7fa2fa600640 1 -- 172.21.15.28:0/3995450953 shutdown_connections 2024-04-23T18:23:00.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.916+0000 7fa2fa600640 1 -- 172.21.15.28:0/3995450953 wait complete. 2024-04-23T18:23:00.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.916+0000 7fc906a00640 1 -- 172.21.15.28:0/306417215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc914074290 con 0x7fc9140cc630 2024-04-23T18:23:00.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.916+0000 7fb6abe00640 1 -- 172.21.15.28:0/602271209 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6ac010070 con 0x7fb6b40cc7a0 2024-04-23T18:23:00.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.916+0000 7fa2fa600640 1 Processor -- start 2024-04-23T18:23:00.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.916+0000 7fa2fa600640 1 -- start start 2024-04-23T18:23:00.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.916+0000 7fc911600640 1 -- 172.21.15.28:0/306417215 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc900007430 con 0x7fc9140cc630 2024-04-23T18:23:00.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fc911600640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc8f4068400 0x7fc8f406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fc911600640 1 -- 172.21.15.28:0/306417215 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc900054540 con 0x7fc9140cc630 2024-04-23T18:23:00.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fc919a00640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc8f4068400 0x7fc8f406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2fa600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f4071d30 0x7fa2f415a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2fa600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2f40728c0 0x7fa2f4158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2fa600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2f4159570 0x7fa2f4151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2fa600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f415fc30 con 0x7fa2f4071d30 2024-04-23T18:23:00.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2fa600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f415f950 con 0x7fa2f4159570 2024-04-23T18:23:00.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2fa600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f4160770 con 0x7fa2f40728c0 2024-04-23T18:23:00.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f9c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2f4159570 0x7fa2f4151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f9c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2f4159570 0x7fa2f4151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42932/0 (socket says 172.21.15.28:42932) 2024-04-23T18:23:00.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f9c00640 1 -- 172.21.15.28:0/2838839660 learned_addr learned my addr 172.21.15.28:0/2838839660 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:00.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f9200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f4071d30 0x7fa2f415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f3e00640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2f40728c0 0x7fa2f4158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fc919a00640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc8f4068400 0x7fc8f406a8c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc90c0b2000 tx=0x7fc90c0aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f9200640 1 -- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2f40728c0 msgr2=0x7fa2f4158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f9200640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2f40728c0 0x7fa2f4158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f9200640 1 -- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2f4159570 msgr2=0x7fa2f4151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:00.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f9200640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2f4159570 0x7fa2f4151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:00.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f9200640 1 -- 172.21.15.28:0/2838839660 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f406c190 con 0x7fa2f4071d30 2024-04-23T18:23:00.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f9c00640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2f4159570 0x7fa2f4151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:00.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.920+0000 7fa2f9200640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f4071d30 0x7fa2f415a530 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800e870 tx=0x7fa2e800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.924+0000 7fa2f0c00640 1 -- 172.21.15.28:0/2838839660 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8017070 con 0x7fa2f4071d30 2024-04-23T18:23:00.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.924+0000 7fa2f0c00640 1 -- 172.21.15.28:0/2838839660 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e800ee60 con 0x7fa2f4071d30 2024-04-23T18:23:00.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.924+0000 7fa2fa600640 1 -- 172.21.15.28:0/2838839660 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f415ae20 con 0x7fa2f4071d30 2024-04-23T18:23:00.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.924+0000 7fa2f0c00640 1 -- 172.21.15.28:0/2838839660 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800cb60 con 0x7fa2f4071d30 2024-04-23T18:23:00.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.924+0000 7fa2fa600640 1 -- 172.21.15.28:0/2838839660 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f40ca100 con 0x7fa2f4071d30 2024-04-23T18:23:00.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.924+0000 7fa2f0c00640 1 -- 172.21.15.28:0/2838839660 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa2e801a070 con 0x7fa2f4071d30 2024-04-23T18:23:00.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.924+0000 7fa2fa600640 1 -- 172.21.15.28:0/2838839660 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f4074290 con 0x7fa2f4071d30 2024-04-23T18:23:00.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.928+0000 7fa2f0c00640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa2d40683d0 0x7fa2d406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:00.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.928+0000 7fa2f0c00640 1 -- 172.21.15.28:0/2838839660 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa2e80869e0 con 0x7fa2f4071d30 2024-04-23T18:23:00.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.928+0000 7fa2f3e00640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa2d40683d0 0x7fa2d406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:00.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.928+0000 7fa2f3e00640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa2d40683d0 0x7fa2d406a890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4158d90 tx=0x7fa2e0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:00.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.936+0000 7fc911600640 1 -- 172.21.15.28:0/306417215 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc900007720 con 0x7fc9140cc630 2024-04-23T18:23:00.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:00.936+0000 7fa2f0c00640 1 -- 172.21.15.28:0/2838839660 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa2f415ae20 con 0x7fa2f4071d30 2024-04-23T18:23:01.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.216+0000 7fe45de00640 1 -- 172.21.15.28:0/2028565704 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe4500d3530 con 0x7fe4500347a0 2024-04-23T18:23:01.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.220+0000 7fe44f400640 1 -- 172.21.15.28:0/2028565704 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe458171650 con 0x7fe4500347a0 2024-04-23T18:23:01.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.220+0000 7f3963600640 1 -- 172.21.15.28:0/2434107976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f395c0c8590 con 0x7f395c0c87b0 2024-04-23T18:23:01.297 INFO:teuthology.orchestra.run.smithi028.stdout:55834574857 2024-04-23T18:23:01.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.220+0000 7f3958c00640 1 -- 172.21.15.28:0/2434107976 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f39480c6020 con 0x7f395c0c87b0 2024-04-23T18:23:01.297 INFO:teuthology.orchestra.run.smithi028.stdout:55834574857 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.220+0000 7fe45de00640 1 -- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4380683d0 msgr2=0x7fe43806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.220+0000 7fe45de00640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4380683d0 0x7fe43806a890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe448007fd0 tx=0x7fe448009040 comp rx=0 tx=0).stop 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.220+0000 7fe45de00640 1 -- 172.21.15.28:0/2028565704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4500347a0 msgr2=0x7fe4500d7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.220+0000 7fe45de00640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4500347a0 0x7fe4500d7ad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe458051690 tx=0x7fe458099ea0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7fe45de00640 1 -- 172.21.15.28:0/2028565704 shutdown_connections 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7fe45de00640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe4380683d0 0x7fe43806a890 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7fe45de00640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4500db440 0x7fe450175100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7fe45de00640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4500d5000 0x7fe450174bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7fe45de00640 1 --2- 172.21.15.28:0/2028565704 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe4500347a0 0x7fe4500d7ad0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7fe45de00640 1 -- 172.21.15.28:0/2028565704 >> 172.21.15.28:0/2028565704 conn(0x7fe450050190 msgr2=0x7fe450035950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7fe45de00640 1 -- 172.21.15.28:0/2028565704 shutdown_connections 2024-04-23T18:23:01.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7fe45de00640 1 -- 172.21.15.28:0/2028565704 wait complete. 2024-04-23T18:23:01.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 -- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f393c068480 msgr2=0x7f393c06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f393c068480 0x7f393c06a940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3950005890 tx=0x7f3950009040 comp rx=0 tx=0).stop 2024-04-23T18:23:01.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 -- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f395c0c87b0 msgr2=0x7f395c152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f395c0c87b0 0x7f395c152430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f39480ae000 tx=0x7f394801ce70 comp rx=0 tx=0).stop 2024-04-23T18:23:01.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 -- 172.21.15.28:0/2434107976 shutdown_connections 2024-04-23T18:23:01.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f393c068480 0x7f393c06a940 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f395c151480 0x7f395c15a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f395c0c87b0 0x7f395c152430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 --2- 172.21.15.28:0/2434107976 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f395c0c39e0 0x7f395c153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 -- 172.21.15.28:0/2434107976 >> 172.21.15.28:0/2434107976 conn(0x7f395c0676e0 msgr2=0x7f395c0734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:01.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 -- 172.21.15.28:0/2434107976 shutdown_connections 2024-04-23T18:23:01.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.224+0000 7f3963600640 1 -- 172.21.15.28:0/2434107976 wait complete. 2024-04-23T18:23:01.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.236+0000 7f05c9800640 1 -- 172.21.15.28:0/2397558104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f05c4156af0 con 0x7f05c4159770 2024-04-23T18:23:01.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.236+0000 7f05baa00640 1 -- 172.21.15.28:0/2397558104 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f05b0056e90 con 0x7f05c4159770 2024-04-23T18:23:01.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.236+0000 7fabbf000640 1 -- 172.21.15.28:0/1106579010 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fabb80c5c70 con 0x7faba0004810 2024-04-23T18:23:01.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.236+0000 7fabb5600640 1 -- 172.21.15.28:0/1106579010 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faba405ab40 con 0x7faba0004810 2024-04-23T18:23:01.301 INFO:teuthology.orchestra.run.smithi028.stdout:55834574857 2024-04-23T18:23:01.302 INFO:teuthology.orchestra.run.smithi028.stdout:55834574857 2024-04-23T18:23:01.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 -- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fab980685b0 msgr2=0x7fab9806aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fab980685b0 0x7fab9806aa70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fabb00ae000 tx=0x7fabb00aa070 comp rx=0 tx=0).stop 2024-04-23T18:23:01.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 -- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba0004810 msgr2=0x7fabb80cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba0004810 0x7fabb80cf770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faba4011930 tx=0x7faba4011df0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7f05c9800640 1 -- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05a40683d0 msgr2=0x7f05a406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7f05c9800640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05a40683d0 0x7f05a406a890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f05b40098e0 tx=0x7f05b4009060 comp rx=0 tx=0).stop 2024-04-23T18:23:01.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7f05c9800640 1 -- 172.21.15.28:0/2397558104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05c4159770 msgr2=0x7f05c406e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7f05c9800640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05c4159770 0x7f05c406e880 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f05b000c7f0 tx=0x7f05b000ccb0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 -- 172.21.15.28:0/1106579010 shutdown_connections 2024-04-23T18:23:01.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fab980685b0 0x7fab9806aa70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fabb80712e0 0x7fabb8159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb815a2b0 0x7fabb8070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 --2- 172.21.15.28:0/1106579010 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba0004810 0x7fabb80cf770 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 -- 172.21.15.28:0/1106579010 >> 172.21.15.28:0/1106579010 conn(0x7fabb8072dd0 msgr2=0x7fabb8161e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:01.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 -- 172.21.15.28:0/1106579010 shutdown_connections 2024-04-23T18:23:01.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7fabbf000640 1 -- 172.21.15.28:0/1106579010 wait complete. 2024-04-23T18:23:01.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7f05c9800640 1 -- 172.21.15.28:0/2397558104 shutdown_connections 2024-04-23T18:23:01.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7f05c9800640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05a40683d0 0x7f05a406a890 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f05b40098e0 tx=0x7f05b4009060 comp rx=0 tx=0).stop 2024-04-23T18:23:01.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7f05c9800640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05c40c75c0 0x7f05c4152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7f05c9800640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05c4159770 0x7f05c406e880 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7f05c9800640 1 --2- 172.21.15.28:0/2397558104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05c40c3d70 0x7f05c4073680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.240+0000 7f05c9800640 1 -- 172.21.15.28:0/2397558104 >> 172.21.15.28:0/2397558104 conn(0x7f05c4075e30 msgr2=0x7f05c41589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:01.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.244+0000 7f05c9800640 1 -- 172.21.15.28:0/2397558104 shutdown_connections 2024-04-23T18:23:01.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.244+0000 7f05c9800640 1 -- 172.21.15.28:0/2397558104 wait complete. 2024-04-23T18:23:01.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.252+0000 7f9f71400640 1 -- 172.21.15.28:0/395801585 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9f6c0b3630 con 0x7f9f6c1521f0 2024-04-23T18:23:01.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.252+0000 7f9f62a00640 1 -- 172.21.15.28:0/395801585 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f5c016090 con 0x7f9f6c1521f0 2024-04-23T18:23:01.307 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:01.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.2 2024-04-23T18:23:01.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 -- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9f480683d0 msgr2=0x7f9f4806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9f480683d0 0x7f9f4806a890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9f54000f70 tx=0x7f9f54007df0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 -- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c1521f0 msgr2=0x7f9f6c14bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c1521f0 0x7f9f6c14bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0ae040 tx=0x7f9f5c019240 comp rx=0 tx=0).stop 2024-04-23T18:23:01.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 -- 172.21.15.28:0/395801585 shutdown_connections 2024-04-23T18:23:01.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9f480683d0 0x7f9f4806a890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9f6c1521f0 0x7f9f6c14bbf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f6c15b1b0 0x7f9f6c1f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 --2- 172.21.15.28:0/395801585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f6c0c6690 0x7f9f6c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 -- 172.21.15.28:0/395801585 >> 172.21.15.28:0/395801585 conn(0x7f9f6c075dd0 msgr2=0x7f9f6c150130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:01.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 -- 172.21.15.28:0/395801585 shutdown_connections 2024-04-23T18:23:01.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.260+0000 7f9f5be00640 1 -- 172.21.15.28:0/395801585 wait complete. 2024-04-23T18:23:01.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.264+0000 7fb6bb200640 1 -- 172.21.15.28:0/602271209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb6b40c3730 con 0x7fb6b40cc7a0 2024-04-23T18:23:01.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.0 2024-04-23T18:23:01.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.264+0000 7fb6abe00640 1 -- 172.21.15.28:0/602271209 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb6ac056b60 con 0x7fb6b40cc7a0 2024-04-23T18:23:01.311 INFO:teuthology.orchestra.run.smithi028.stdout:55834574857 2024-04-23T18:23:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 -- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb694068480 msgr2=0x7fb69406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb694068480 0x7fb69406a940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40b2000 tx=0x7fb6a4008040 comp rx=0 tx=0).stop 2024-04-23T18:23:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 -- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6b40cc7a0 msgr2=0x7fb6b42048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6b40cc7a0 0x7fb6b42048a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009fc0 tx=0x7fb6ac00d560 comp rx=0 tx=0).stop 2024-04-23T18:23:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 -- 172.21.15.28:0/602271209 shutdown_connections 2024-04-23T18:23:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb694068480 0x7fb69406a940 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40b2000 tx=0x7fb6a4008040 comp rx=0 tx=0).stop 2024-04-23T18:23:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb6b4155610 0x7fb6b4201d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb6b40ccb80 0x7fb6b4154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 --2- 172.21.15.28:0/602271209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6b40cc7a0 0x7fb6b42048a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 -- 172.21.15.28:0/602271209 >> 172.21.15.28:0/602271209 conn(0x7fb6b4075e30 msgr2=0x7fb6b40ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:01.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 -- 172.21.15.28:0/602271209 shutdown_connections 2024-04-23T18:23:01.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.268+0000 7fb6bb200640 1 -- 172.21.15.28:0/602271209 wait complete. 2024-04-23T18:23:01.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.276+0000 7fc906a00640 1 -- 172.21.15.28:0/306417215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc914072560 con 0x7fc9140cc630 2024-04-23T18:23:01.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc911600640 1 -- 172.21.15.28:0/306417215 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc900056ba0 con 0x7fc9140cc630 2024-04-23T18:23:01.313 INFO:teuthology.orchestra.run.smithi028.stdout:55834574857 2024-04-23T18:23:01.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.1 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 -- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc8f4068400 msgr2=0x7fc8f406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc8f4068400 0x7fc8f406a8c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc90c0b2000 tx=0x7fc90c0aa070 comp rx=0 tx=0).stop 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 -- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9140cc630 msgr2=0x7fc9141f8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9140cc630 0x7fc9141f8f60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc90000c6d0 tx=0x7fc90000cb90 comp rx=0 tx=0).stop 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 -- 172.21.15.28:0/306417215 shutdown_connections 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc8f4068400 0x7fc8f406a8c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9140cc630 0x7fc9141f8f60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc9140cc250 0x7fc9141f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 --2- 172.21.15.28:0/306417215 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc9140c81a0 0x7fc91415da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 -- 172.21.15.28:0/306417215 >> 172.21.15.28:0/306417215 conn(0x7fc914072dd0 msgr2=0x7fc9140cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 -- 172.21.15.28:0/306417215 shutdown_connections 2024-04-23T18:23:01.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.280+0000 7fc906a00640 1 -- 172.21.15.28:0/306417215 wait complete. 2024-04-23T18:23:01.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.4 2024-04-23T18:23:01.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.284+0000 7fa2fa600640 1 -- 172.21.15.28:0/2838839660 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa2f4160b80 con 0x7fa2f4071d30 2024-04-23T18:23:01.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.284+0000 7fa2f0c00640 1 -- 172.21.15.28:0/2838839660 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa2e8056680 con 0x7fa2f4071d30 2024-04-23T18:23:01.317 INFO:teuthology.orchestra.run.smithi028.stdout:55834574856 2024-04-23T18:23:01.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.6 2024-04-23T18:23:01.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 -- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa2d40683d0 msgr2=0x7fa2d406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa2d40683d0 0x7fa2d406a890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4158d90 tx=0x7fa2e0009040 comp rx=0 tx=0).stop 2024-04-23T18:23:01.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 -- 172.21.15.28:0/2838839660 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f4071d30 msgr2=0x7fa2f415a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:01.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f4071d30 0x7fa2f415a530 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800e870 tx=0x7fa2e800ed30 comp rx=0 tx=0).stop 2024-04-23T18:23:01.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 -- 172.21.15.28:0/2838839660 shutdown_connections 2024-04-23T18:23:01.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa2d40683d0 0x7fa2d406a890 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa2f40728c0 0x7fa2f4158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2f4159570 0x7fa2f4151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 --2- 172.21.15.28:0/2838839660 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2f4071d30 0x7fa2f415a530 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:01.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 -- 172.21.15.28:0/2838839660 >> 172.21.15.28:0/2838839660 conn(0x7fa2f406b9e0 msgr2=0x7fa2f4156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:01.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 -- 172.21.15.28:0/2838839660 shutdown_connections 2024-04-23T18:23:01.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:01.288+0000 7fa2fa600640 1 -- 172.21.15.28:0/2838839660 wait complete. 2024-04-23T18:23:01.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.3 2024-04-23T18:23:01.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.5 2024-04-23T18:23:01.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2024-04-23T18:23:02.309 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T18:23:02.311 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T18:23:02.315 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T18:23:02.318 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T18:23:02.319 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T18:23:02.321 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T18:23:02.322 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T18:23:02.322 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T18:23:02.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.536+0000 7fcd3ac00640 1 Processor -- start 2024-04-23T18:23:02.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.536+0000 7fcd3ac00640 1 -- start start 2024-04-23T18:23:02.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fafbb600640 1 Processor -- start 2024-04-23T18:23:02.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fafbb600640 1 -- start start 2024-04-23T18:23:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd3ac00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcd34159690 0x7fcd3406ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd3ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 0x7fcd340c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd39800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcd34159690 0x7fcd3406ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd3ac00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd340c6ff0 con 0x7fcd340c8ad0 2024-04-23T18:23:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd3ac00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcd340c7e50 con 0x7fcd34159690 2024-04-23T18:23:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd3ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3415f750 con 0x7fcd340c74a0 2024-04-23T18:23:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fafbb600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fafb4159590 0x7fafb40cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fafbb600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fafb40c39e0 0x7fafb40ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fafbb600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb415f950 con 0x7fafb415f410 2024-04-23T18:23:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fafbb600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fafb40c4aa0 con 0x7fafb4159590 2024-04-23T18:23:02.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fafbb600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fafb415fc30 con 0x7fafb40c39e0 2024-04-23T18:23:02.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd39800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcd34159690 0x7fcd3406ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42946/0 (socket says 172.21.15.28:42946) 2024-04-23T18:23:02.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd39800640 1 -- 172.21.15.28:0/2617537383 learned_addr learned my addr 172.21.15.28:0/2617537383 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fafb9600640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fafb415f410 0x7fafb40c4f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40334/0 (socket says 172.21.15.28:40334) 2024-04-23T18:23:02.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fafb9600640 1 -- 172.21.15.28:0/1406870668 learned_addr learned my addr 172.21.15.28:0/1406870668 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:02.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd3a200640 1 --2- 172.21.15.28:0/2617537383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 0x7fcd340c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd3a200640 1 -- 172.21.15.28:0/2617537383 >> v2:172.21.15.137:3300/0 conn(0x7fcd34159690 msgr2=0x7fcd3406ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:02.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fafb8c00640 1 --2- 172.21.15.28:0/1406870668 >> v2:172.21.15.28:3300/0 conn(0x7fafb4159590 0x7fafb40cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd3a200640 1 --2- 172.21.15.28:0/2617537383 >> v2:172.21.15.137:3300/0 conn(0x7fcd34159690 0x7fcd3406ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd3a200640 1 -- 172.21.15.28:0/2617537383 >> v1:172.21.15.28:6789/0 conn(0x7fcd340c8ad0 legacy=0x7fcd3406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:02.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.540+0000 7fcd3a200640 1 -- 172.21.15.28:0/2617537383 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3415fa10 con 0x7fcd340c74a0 2024-04-23T18:23:02.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.544+0000 7fafb3400640 1 -- 172.21.15.28:0/1406870668 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1867150365 0 0) 0x7fafb415f950 con 0x7fafb415f410 2024-04-23T18:23:02.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.544+0000 7fafb3400640 1 -- 172.21.15.28:0/1406870668 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf9c003530 con 0x7fafb415f410 2024-04-23T18:23:02.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.544+0000 7fafb3e00640 1 --2- 172.21.15.28:0/1406870668 >> v2:172.21.15.137:3300/0 conn(0x7fafb40c39e0 0x7fafb40ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.544+0000 7fafb8c00640 1 -- 172.21.15.28:0/1406870668 >> v2:172.21.15.137:3300/0 conn(0x7fafb40c39e0 msgr2=0x7fafb40ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:02.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.544+0000 7fafb8c00640 1 --2- 172.21.15.28:0/1406870668 >> v2:172.21.15.137:3300/0 conn(0x7fafb40c39e0 0x7fafb40ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.544+0000 7fafb8c00640 1 -- 172.21.15.28:0/1406870668 >> v1:172.21.15.137:6789/0 conn(0x7fafb415f410 legacy=0x7fafb40c4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.544+0000 7fafb8c00640 1 -- 172.21.15.28:0/1406870668 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb415ff10 con 0x7fafb4159590 2024-04-23T18:23:02.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.544+0000 7fafb3e00640 1 --2- 172.21.15.28:0/1406870668 >> v2:172.21.15.137:3300/0 conn(0x7fafb40c39e0 0x7fafb40ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:02.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.548+0000 7fcd3a200640 1 --2- 172.21.15.28:0/2617537383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 0x7fcd340c7910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd200097c0 tx=0x7fcd2001ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30ac7357d0e014aa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.548+0000 7fcd33e00640 1 -- 172.21.15.28:0/2617537383 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd200b5070 con 0x7fcd340c74a0 2024-04-23T18:23:02.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.548+0000 7fcd33e00640 1 -- 172.21.15.28:0/2617537383 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd200a8910 con 0x7fcd340c74a0 2024-04-23T18:23:02.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.548+0000 7fcd33e00640 1 -- 172.21.15.28:0/2617537383 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd200b5070 con 0x7fcd340c74a0 2024-04-23T18:23:02.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.548+0000 7fafb8c00640 1 --2- 172.21.15.28:0/1406870668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafb4159590 0x7fafb40cc6b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fafb40cd5a0 tx=0x7fafa401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49520ecbaf4bbb21 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fafb3400640 1 -- 172.21.15.28:0/1406870668 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa40b5070 con 0x7fafb4159590 2024-04-23T18:23:02.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fafb3400640 1 -- 172.21.15.28:0/1406870668 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa40a8970 con 0x7fafb4159590 2024-04-23T18:23:02.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fafb3400640 1 -- 172.21.15.28:0/1406870668 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa40a8d40 con 0x7fafb4159590 2024-04-23T18:23:02.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fcd3ac00640 1 -- 172.21.15.28:0/2617537383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 msgr2=0x7fcd340c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fcd3ac00640 1 --2- 172.21.15.28:0/2617537383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 0x7fcd340c7910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd200097c0 tx=0x7fcd2001ec50 comp rx=0 tx=0).stop 2024-04-23T18:23:02.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fafbb600640 1 -- 172.21.15.28:0/1406870668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafb4159590 msgr2=0x7fafb40cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fafbb600640 1 --2- 172.21.15.28:0/1406870668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafb4159590 0x7fafb40cc6b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fafb40cd5a0 tx=0x7fafa401ec70 comp rx=0 tx=0).stop 2024-04-23T18:23:02.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fcd3ac00640 1 -- 172.21.15.28:0/2617537383 shutdown_connections 2024-04-23T18:23:02.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fcd3ac00640 1 --2- 172.21.15.28:0/2617537383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 0x7fcd340c7910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fcd3ac00640 1 --2- 172.21.15.28:0/2617537383 >> v2:172.21.15.137:3300/0 conn(0x7fcd34159690 0x7fcd3406ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fcd3ac00640 1 -- 172.21.15.28:0/2617537383 >> 172.21.15.28:0/2617537383 conn(0x7fcd340cc550 msgr2=0x7fcd340cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fafbb600640 1 -- 172.21.15.28:0/1406870668 shutdown_connections 2024-04-23T18:23:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fafbb600640 1 --2- 172.21.15.28:0/1406870668 >> v2:172.21.15.137:3300/0 conn(0x7fafb40c39e0 0x7fafb40ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fafbb600640 1 --2- 172.21.15.28:0/1406870668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafb4159590 0x7fafb40cc6b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fafbb600640 1 -- 172.21.15.28:0/1406870668 >> 172.21.15.28:0/1406870668 conn(0x7fafb40676e0 msgr2=0x7fafb4067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fcd3ac00640 1 -- 172.21.15.28:0/2617537383 shutdown_connections 2024-04-23T18:23:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fcd3ac00640 1 -- 172.21.15.28:0/2617537383 wait complete. 2024-04-23T18:23:02.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fafbb600640 1 -- 172.21.15.28:0/1406870668 shutdown_connections 2024-04-23T18:23:02.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.552+0000 7fafbb600640 1 -- 172.21.15.28:0/1406870668 wait complete. 2024-04-23T18:23:02.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.556+0000 7fcd3ac00640 1 Processor -- start 2024-04-23T18:23:02.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.556+0000 7fafbb600640 1 Processor -- start 2024-04-23T18:23:02.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.556+0000 7fcd3ac00640 1 -- start start 2024-04-23T18:23:02.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.556+0000 7fafbb600640 1 -- start start 2024-04-23T18:23:02.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.556+0000 7fafbb600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb40c39e0 0x7fafb414faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.556+0000 7fafbb600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafb4159590 0x7fafb4155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.556+0000 7fafbb600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb415f410 0x7fafb4156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.556+0000 7fcd3ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 0x7fcd341f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd3ac00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd340c8ad0 0x7fcd3415ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd3ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd34159690 0x7fcd341f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd3ac00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcd34159a70 con 0x7fcd340c8ad0 2024-04-23T18:23:02.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd39800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 0x7fcd341f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd3ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3415ffd0 con 0x7fcd34159690 2024-04-23T18:23:02.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb9600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb415f410 0x7fafb4156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb9600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb415f410 0x7fafb4156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42970/0 (socket says 172.21.15.28:42970) 2024-04-23T18:23:02.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb9600640 1 -- 172.21.15.28:0/1819454864 learned_addr learned my addr 172.21.15.28:0/1819454864 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4159970 con 0x7fafb4159590 2024-04-23T18:23:02.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafb40c4500 con 0x7fafb415f410 2024-04-23T18:23:02.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fafb4159af0 con 0x7fafb40c39e0 2024-04-23T18:23:02.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb8c00640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb40c39e0 0x7fafb414faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd3ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcd340c44f0 con 0x7fcd340c74a0 2024-04-23T18:23:02.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd39800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 0x7fcd341f8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:42974/0 (socket says 172.21.15.28:42974) 2024-04-23T18:23:02.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd38e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd340c8ad0 0x7fcd3415ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd39800640 1 -- 172.21.15.28:0/2947299165 learned_addr learned my addr 172.21.15.28:0/2947299165 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd3a200640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd34159690 0x7fcd341f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd39800640 1 -- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd34159690 msgr2=0x7fcd341f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd39800640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd34159690 0x7fcd341f54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd39800640 1 -- 172.21.15.28:0/2947299165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd340c8ad0 msgr2=0x7fcd3415ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd39800640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd340c8ad0 0x7fcd3415ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd39800640 1 -- 172.21.15.28:0/2947299165 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd341f4cd0 con 0x7fcd340c74a0 2024-04-23T18:23:02.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd39800640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 0x7fcd341f8c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800e900 tx=0x7fcd2800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb3e00640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafb4159590 0x7fafb4155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd31600640 1 -- 172.21.15.28:0/2947299165 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd28017070 con 0x7fcd340c74a0 2024-04-23T18:23:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd31600640 1 -- 172.21.15.28:0/2947299165 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2800ca00 con 0x7fcd340c74a0 2024-04-23T18:23:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd31600640 1 -- 172.21.15.28:0/2947299165 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800cdf0 con 0x7fcd340c74a0 2024-04-23T18:23:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd3ac00640 1 -- 172.21.15.28:0/2947299165 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd341ea2c0 con 0x7fcd340c74a0 2024-04-23T18:23:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb8c00640 1 -- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb415f410 msgr2=0x7fafb4156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fcd3ac00640 1 -- 172.21.15.28:0/2947299165 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd341570a0 con 0x7fcd340c74a0 2024-04-23T18:23:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb8c00640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb415f410 0x7fafb4156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb8c00640 1 -- 172.21.15.28:0/1819454864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafb4159590 msgr2=0x7fafb4155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb8c00640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafb4159590 0x7fafb4155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb8c00640 1 -- 172.21.15.28:0/1819454864 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb4153300 con 0x7fafb40c39e0 2024-04-23T18:23:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb3e00640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafb4159590 0x7fafb4155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.560+0000 7fafb9600640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb415f410 0x7fafb4156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:02.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.564+0000 7fcd26a00640 1 -- 172.21.15.28:0/2947299165 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd34068cd0 con 0x7fcd340c74a0 2024-04-23T18:23:02.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.564+0000 7fafb8c00640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb40c39e0 0x7fafb414faf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fafa40af000 tx=0x7fafa401ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.564+0000 7fafb0c00640 1 -- 172.21.15.28:0/1819454864 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa40b5040 con 0x7fafb40c39e0 2024-04-23T18:23:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.564+0000 7fafb0c00640 1 -- 172.21.15.28:0/1819454864 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa40bf070 con 0x7fafb40c39e0 2024-04-23T18:23:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.564+0000 7fafb0c00640 1 -- 172.21.15.28:0/1819454864 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa40b19f0 con 0x7fafb40c39e0 2024-04-23T18:23:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.564+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb4152b80 con 0x7fafb40c39e0 2024-04-23T18:23:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.564+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb4073ce0 con 0x7fafb40c39e0 2024-04-23T18:23:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.564+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb4068cd0 con 0x7fafb40c39e0 2024-04-23T18:23:02.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.564+0000 7fcd31600640 1 -- 172.21.15.28:0/2947299165 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd2801a070 con 0x7fcd340c74a0 2024-04-23T18:23:02.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.568+0000 7fcd31600640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcd140683b0 0x7fcd1406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.568+0000 7fafb0c00640 1 -- 172.21.15.28:0/1819454864 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fafa40b1b90 con 0x7fafb40c39e0 2024-04-23T18:23:02.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.568+0000 7fafb0c00640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faf98068380 0x7faf9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.568+0000 7fafb0c00640 1 -- 172.21.15.28:0/1819454864 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fafa4124880 con 0x7fafb40c39e0 2024-04-23T18:23:02.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.568+0000 7fcd38e00640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcd140683b0 0x7fcd1406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.568+0000 7fcd31600640 1 -- 172.21.15.28:0/2947299165 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcd28054900 con 0x7fcd340c74a0 2024-04-23T18:23:02.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.572+0000 7fcd38e00640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcd140683b0 0x7fcd1406a870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd340c92a0 tx=0x7fcd2c00d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.572+0000 7fafb3e00640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faf98068380 0x7faf9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.572+0000 7fafb3e00640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faf98068380 0x7faf9806a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fafb40c7200 tx=0x7fafa8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.580+0000 7fafb0c00640 1 -- 172.21.15.28:0/1819454864 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fafa40187d0 con 0x7fafb40c39e0 2024-04-23T18:23:02.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.592+0000 7fcd31600640 1 -- 172.21.15.28:0/2947299165 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd28056860 con 0x7fcd340c74a0 2024-04-23T18:23:02.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.612+0000 7f9eaec00640 1 Processor -- start 2024-04-23T18:23:02.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.612+0000 7f9eaec00640 1 -- start start 2024-04-23T18:23:02.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eaec00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9ea80c8ad0 0x7f9ea806ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eaec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ea80c74a0 0x7f9ea80c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eaec00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea80c6ff0 con 0x7f9ea8159690 2024-04-23T18:23:02.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eaec00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea80c7e50 con 0x7f9ea80c8ad0 2024-04-23T18:23:02.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eaec00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea815f750 con 0x7f9ea80c74a0 2024-04-23T18:23:02.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eace00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9ea80c8ad0 0x7f9ea806ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eace00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9ea80c8ad0 0x7f9ea806ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42980/0 (socket says 172.21.15.28:42980) 2024-04-23T18:23:02.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eace00640 1 -- 172.21.15.28:0/2121904287 learned_addr learned my addr 172.21.15.28:0/2121904287 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eae200640 1 --2- 172.21.15.28:0/2121904287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ea80c74a0 0x7f9ea80c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9ea7e00640 1 -- 172.21.15.28:0/2121904287 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430022531 0 0) 0x7f9ea80c6ff0 con 0x7f9ea8159690 2024-04-23T18:23:02.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9ea7e00640 1 -- 172.21.15.28:0/2121904287 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e90003530 con 0x7f9ea8159690 2024-04-23T18:23:02.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eae200640 1 -- 172.21.15.28:0/2121904287 >> v2:172.21.15.137:3300/0 conn(0x7f9ea80c8ad0 msgr2=0x7f9ea806ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:02.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eae200640 1 --2- 172.21.15.28:0/2121904287 >> v2:172.21.15.137:3300/0 conn(0x7f9ea80c8ad0 0x7f9ea806ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eae200640 1 -- 172.21.15.28:0/2121904287 >> v1:172.21.15.137:6789/0 conn(0x7f9ea8159690 legacy=0x7f9ea806e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.616+0000 7f9eae200640 1 -- 172.21.15.28:0/2121904287 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea815fa10 con 0x7f9ea80c74a0 2024-04-23T18:23:02.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.620+0000 7f9eae200640 1 --2- 172.21.15.28:0/2121904287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ea80c74a0 0x7f9ea80c7910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9e940097c0 tx=0x7f9e9401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f68da3b5bfd4239 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.624+0000 7f9ea7e00640 1 -- 172.21.15.28:0/2121904287 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e940b5070 con 0x7f9ea80c74a0 2024-04-23T18:23:02.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.624+0000 7f9ea7e00640 1 -- 172.21.15.28:0/2121904287 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e940a8990 con 0x7f9ea80c74a0 2024-04-23T18:23:02.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.624+0000 7f9eaec00640 1 -- 172.21.15.28:0/2121904287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ea80c74a0 msgr2=0x7f9ea80c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.624+0000 7f9ea7e00640 1 -- 172.21.15.28:0/2121904287 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e940b5070 con 0x7f9ea80c74a0 2024-04-23T18:23:02.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.624+0000 7f9eaec00640 1 --2- 172.21.15.28:0/2121904287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ea80c74a0 0x7f9ea80c7910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9e940097c0 tx=0x7f9e9401ecb0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.624+0000 7f9eaec00640 1 -- 172.21.15.28:0/2121904287 shutdown_connections 2024-04-23T18:23:02.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.624+0000 7f9eaec00640 1 --2- 172.21.15.28:0/2121904287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ea80c74a0 0x7f9ea80c7910 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.624+0000 7f9eaec00640 1 --2- 172.21.15.28:0/2121904287 >> v2:172.21.15.137:3300/0 conn(0x7f9ea80c8ad0 0x7f9ea806ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.624+0000 7f9eaec00640 1 -- 172.21.15.28:0/2121904287 >> 172.21.15.28:0/2121904287 conn(0x7f9ea80cc550 msgr2=0x7f9ea80cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.628+0000 7f6bc9000640 1 Processor -- start 2024-04-23T18:23:02.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.628+0000 7f6bc9000640 1 -- start start 2024-04-23T18:23:02.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.628+0000 7f902c600640 1 Processor -- start 2024-04-23T18:23:02.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.628+0000 7f902c600640 1 -- start start 2024-04-23T18:23:02.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.628+0000 7f6bc9000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6bc41550e0 0x7f6bc415c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.628+0000 7f6bc9000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6bc40c8310 0x7f6bc415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.628+0000 7f9eaec00640 1 -- 172.21.15.28:0/2121904287 shutdown_connections 2024-04-23T18:23:02.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.628+0000 7f9eaec00640 1 -- 172.21.15.28:0/2121904287 wait complete. 2024-04-23T18:23:02.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f902c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 0x7f90240cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f902c600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f90240cbe90 0x7f90240cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f902c600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90240c6c80 con 0x7f902415d210 2024-04-23T18:23:02.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f902c600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f902415c580 con 0x7f90240cbe90 2024-04-23T18:23:02.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f902c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f90240c6100 con 0x7f9024073b00 2024-04-23T18:23:02.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f9029c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f902415d210 0x7f90241596c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40362/0 (socket says 172.21.15.28:40362) 2024-04-23T18:23:02.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f9029c00640 1 -- 172.21.15.28:0/1493054334 learned_addr learned my addr 172.21.15.28:0/1493054334 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:02.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f902a600640 1 --2- 172.21.15.28:0/1493054334 >> v2:172.21.15.137:3300/0 conn(0x7f90240cbe90 0x7f90240cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6bc41550e0 0x7f6bc415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc9000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bc415ba20 0x7f6bc406e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6bc41550e0 0x7f6bc415c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42996/0 (socket says 172.21.15.28:42996) 2024-04-23T18:23:02.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f9029200640 1 --2- 172.21.15.28:0/1493054334 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 0x7f90240cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc9000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc4155640 con 0x7f6bc40c8310 2024-04-23T18:23:02.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc9000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc40c70d0 con 0x7f6bc41550e0 2024-04-23T18:23:02.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc9000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc40c73b0 con 0x7f6bc415ba20 2024-04-23T18:23:02.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc3400640 1 -- 172.21.15.28:0/2018018097 learned_addr learned my addr 172.21.15.28:0/2018018097 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc3e00640 1 --2- 172.21.15.28:0/2018018097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bc415ba20 0x7f6bc406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc2a00640 1 --2- 172.21.15.28:0/2018018097 >> v2:172.21.15.28:3300/0 conn(0x7f6bc40c8310 0x7f6bc415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc3400640 1 -- 172.21.15.28:0/2018018097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bc415ba20 msgr2=0x7f6bc406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:02.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc3400640 1 --2- 172.21.15.28:0/2018018097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bc415ba20 0x7f6bc406e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc3400640 1 -- 172.21.15.28:0/2018018097 >> v2:172.21.15.28:3300/0 conn(0x7f6bc40c8310 msgr2=0x7f6bc415c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:02.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc3400640 1 --2- 172.21.15.28:0/2018018097 >> v2:172.21.15.28:3300/0 conn(0x7f6bc40c8310 0x7f6bc415c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc3400640 1 -- 172.21.15.28:0/2018018097 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc40c7690 con 0x7f6bc41550e0 2024-04-23T18:23:02.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f6bc2a00640 1 --2- 172.21.15.28:0/2018018097 >> v2:172.21.15.28:3300/0 conn(0x7f6bc40c8310 0x7f6bc415c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:02.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f9023e00640 1 -- 172.21.15.28:0/1493054334 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2905500288 0 0) 0x7f90240c6c80 con 0x7f902415d210 2024-04-23T18:23:02.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f9023e00640 1 -- 172.21.15.28:0/1493054334 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f900c003530 con 0x7f902415d210 2024-04-23T18:23:02.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f902a600640 1 -- 172.21.15.28:0/1493054334 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 msgr2=0x7f90240cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:02.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f902a600640 1 --2- 172.21.15.28:0/1493054334 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 0x7f90240cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f902a600640 1 -- 172.21.15.28:0/1493054334 >> v1:172.21.15.137:6789/0 conn(0x7f902415d210 legacy=0x7f90241596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f902a600640 1 -- 172.21.15.28:0/1493054334 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90240c63e0 con 0x7f90240cbe90 2024-04-23T18:23:02.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f9eaec00640 1 Processor -- start 2024-04-23T18:23:02.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7ff918a00640 1 Processor -- start 2024-04-23T18:23:02.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7ff918a00640 1 -- start start 2024-04-23T18:23:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f9eaec00640 1 -- start start 2024-04-23T18:23:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.632+0000 7f9eaec00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ea80c74a0 0x7f9ea8071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eaec00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea80c8ad0 0x7f9ea813c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff918a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff9141554f0 0x7ff91415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff918a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 0x7ff9140cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eace00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea80c8ad0 0x7f9ea813c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff918a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91415b570 con 0x7ff9140cca20 2024-04-23T18:23:02.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff918a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff91415f6e0 con 0x7ff9141554f0 2024-04-23T18:23:02.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff918a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff91415b850 con 0x7ff9140c77e0 2024-04-23T18:23:02.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eace00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea80c8ad0 0x7f9ea813c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41160/0 (socket says 172.21.15.28:41160) 2024-04-23T18:23:02.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eace00640 1 -- 172.21.15.28:0/1862260765 learned_addr learned my addr 172.21.15.28:0/1862260765 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eaec00640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ea8159690 0x7f9ea8073330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea8159a70 con 0x7f9ea80c8ad0 2024-04-23T18:23:02.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea815ffd0 con 0x7f9ea8159690 2024-04-23T18:23:02.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea80c44f0 con 0x7f9ea80c74a0 2024-04-23T18:23:02.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff911400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 0x7ff9140cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff911400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 0x7ff9140cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:43016/0 (socket says 172.21.15.28:43016) 2024-04-23T18:23:02.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff911400640 1 -- 172.21.15.28:0/2291247624 learned_addr learned my addr 172.21.15.28:0/2291247624 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff911e00640 1 --2- 172.21.15.28:0/2291247624 >> v2:172.21.15.137:3300/0 conn(0x7ff9141554f0 0x7ff91415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eae200640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ea8159690 0x7f9ea8073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff911400640 1 -- 172.21.15.28:0/2291247624 >> v2:172.21.15.137:3300/0 conn(0x7ff9141554f0 msgr2=0x7ff91415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff911400640 1 --2- 172.21.15.28:0/2291247624 >> v2:172.21.15.137:3300/0 conn(0x7ff9141554f0 0x7ff91415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff911400640 1 -- 172.21.15.28:0/2291247624 >> v1:172.21.15.137:6789/0 conn(0x7ff9140cca20 legacy=0x7ff9140c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7ff911400640 1 -- 172.21.15.28:0/2291247624 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91415bb30 con 0x7ff9140c77e0 2024-04-23T18:23:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f5ccce00640 1 Processor -- start 2024-04-23T18:23:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f2cb4a00640 1 Processor -- start 2024-04-23T18:23:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f5ccce00640 1 -- start start 2024-04-23T18:23:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9ead800640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ea80c74a0 0x7f9ea8071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f2cb4a00640 1 -- start start 2024-04-23T18:23:02.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eae200640 1 -- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ea80c74a0 msgr2=0x7f9ea8071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eae200640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ea80c74a0 0x7f9ea8071a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eae200640 1 -- 172.21.15.28:0/1862260765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea80c8ad0 msgr2=0x7f9ea813c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eae200640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea80c8ad0 0x7f9ea813c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eae200640 1 -- 172.21.15.28:0/1862260765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea813e130 con 0x7f9ea8159690 2024-04-23T18:23:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eace00640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea80c8ad0 0x7f9ea813c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eae200640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ea8159690 0x7f9ea8073330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9e940af000 tx=0x7f9e9401ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9ea5600640 1 -- 172.21.15.28:0/1862260765 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e940b5040 con 0x7f9ea8159690 2024-04-23T18:23:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9ea5600640 1 -- 172.21.15.28:0/1862260765 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e940bf070 con 0x7f9ea8159690 2024-04-23T18:23:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9ea5600640 1 -- 172.21.15.28:0/1862260765 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e940044a0 con 0x7f9ea8159690 2024-04-23T18:23:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea814ff10 con 0x7f9ea8159690 2024-04-23T18:23:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f6bc3400640 1 --2- 172.21.15.28:0/2018018097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bc41550e0 0x7f6bc415c490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6bc406a0a0 tx=0x7f6bb001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e40a866b4de77fe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea8153d70 con 0x7f9ea8159690 2024-04-23T18:23:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cb4a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2cb0155460 0x7f2cb015b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cb4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c3ac0 0x7f2cb00c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cb4a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb0155840 con 0x7f2cb00c4110 2024-04-23T18:23:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cb4a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb015b960 con 0x7f2cb0155460 2024-04-23T18:23:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cb4a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb015bc20 con 0x7f2cb00c3ac0 2024-04-23T18:23:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.636+0000 7f902a600640 1 --2- 172.21.15.28:0/1493054334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90240cbe90 0x7f90240cb820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f901c009d90 tx=0x7f901c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b1d4d0994e6296c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f9023e00640 1 -- 172.21.15.28:0/1493054334 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c0b2070 con 0x7f90240cbe90 2024-04-23T18:23:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f9023e00640 1 -- 172.21.15.28:0/1493054334 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901c0a57a0 con 0x7f90240cbe90 2024-04-23T18:23:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5ccce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5cc80d11d0 0x7f5cc815f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5ccce00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5cc815b1d0 0x7f5cc80cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5ccce00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc80c7de0 con 0x7f5cc8155490 2024-04-23T18:23:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5ccce00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc815ee30 con 0x7f5cc815b1d0 2024-04-23T18:23:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5ccce00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc80c80c0 con 0x7f5cc80d11d0 2024-04-23T18:23:02.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5cc7400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5cc8155490 0x7f5cc80cba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:40380/0 (socket says 172.21.15.28:40380) 2024-04-23T18:23:02.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5cc7400640 1 -- 172.21.15.28:0/40220935 learned_addr learned my addr 172.21.15.28:0/40220935 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:02.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5cc7e00640 1 --2- 172.21.15.28:0/40220935 >> v2:172.21.15.28:3300/0 conn(0x7f5cc815b1d0 0x7f5cc80cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cad400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c3ac0 0x7f2cb00c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cad400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c3ac0 0x7f2cb00c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:43038/0 (socket says 172.21.15.28:43038) 2024-04-23T18:23:02.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cad400640 1 -- 172.21.15.28:0/1527821960 learned_addr learned my addr 172.21.15.28:0/1527821960 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cade00640 1 --2- 172.21.15.28:0/1527821960 >> v2:172.21.15.137:3300/0 conn(0x7f2cb0155460 0x7f2cb015b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5cc7e00640 1 -- 172.21.15.28:0/40220935 >> v2:172.21.15.137:3300/0 conn(0x7f5cc80d11d0 msgr2=0x7f5cc815f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:02.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5cc7e00640 1 --2- 172.21.15.28:0/40220935 >> v2:172.21.15.137:3300/0 conn(0x7f5cc80d11d0 0x7f5cc815f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5cc7e00640 1 -- 172.21.15.28:0/40220935 >> v1:172.21.15.137:6789/0 conn(0x7f5cc8155490 legacy=0x7f5cc80cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f5cc7e00640 1 -- 172.21.15.28:0/40220935 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc80c83a0 con 0x7f5cc815b1d0 2024-04-23T18:23:02.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cad400640 1 -- 172.21.15.28:0/1527821960 >> v2:172.21.15.137:3300/0 conn(0x7f2cb0155460 msgr2=0x7f2cb015b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f6bc2000640 1 -- 172.21.15.28:0/2018018097 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00b5070 con 0x7f6bc41550e0 2024-04-23T18:23:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f902c600640 1 -- 172.21.15.28:0/1493054334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90240cbe90 msgr2=0x7f90240cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f9023e00640 1 -- 172.21.15.28:0/1493054334 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c0b2070 con 0x7f90240cbe90 2024-04-23T18:23:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cad400640 1 --2- 172.21.15.28:0/1527821960 >> v2:172.21.15.137:3300/0 conn(0x7f2cb0155460 0x7f2cb015b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f902c600640 1 --2- 172.21.15.28:0/1493054334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90240cbe90 0x7f90240cb820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f901c009d90 tx=0x7f901c01c8e0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f6bc2000640 1 -- 172.21.15.28:0/2018018097 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb00a89d0 con 0x7f6bc41550e0 2024-04-23T18:23:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f6bc2000640 1 -- 172.21.15.28:0/2018018097 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00a8da0 con 0x7f6bc41550e0 2024-04-23T18:23:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cad400640 1 -- 172.21.15.28:0/1527821960 >> v1:172.21.15.137:6789/0 conn(0x7f2cb00c4110 legacy=0x7f2cb00cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f902c600640 1 -- 172.21.15.28:0/1493054334 shutdown_connections 2024-04-23T18:23:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f902c600640 1 --2- 172.21.15.28:0/1493054334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90240cbe90 0x7f90240cb820 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f902c600640 1 --2- 172.21.15.28:0/1493054334 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 0x7f90240cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f902c600640 1 -- 172.21.15.28:0/1493054334 >> 172.21.15.28:0/1493054334 conn(0x7f9024072f30 msgr2=0x7f9024073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f902c600640 1 -- 172.21.15.28:0/1493054334 shutdown_connections 2024-04-23T18:23:02.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f2cad400640 1 -- 172.21.15.28:0/1527821960 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb015bf00 con 0x7f2cb00c3ac0 2024-04-23T18:23:02.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f902c600640 1 -- 172.21.15.28:0/1493054334 wait complete. 2024-04-23T18:23:02.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f6bc9000640 1 -- 172.21.15.28:0/2018018097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bc41550e0 msgr2=0x7f6bc415c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7f6bc9000640 1 --2- 172.21.15.28:0/2018018097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bc41550e0 0x7f6bc415c490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6bc406a0a0 tx=0x7f6bb001ed10 comp rx=0 tx=0).stop 2024-04-23T18:23:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7ff911400640 1 --2- 172.21.15.28:0/2291247624 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 0x7ff9140cc4e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff904009870 tx=0x7ff90401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45c3e99d6b2e6e30 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.640+0000 7ff910a00640 1 -- 172.21.15.28:0/2291247624 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9040b5070 con 0x7ff9140c77e0 2024-04-23T18:23:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7ff910a00640 1 -- 172.21.15.28:0/2291247624 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9040a8a50 con 0x7ff9140c77e0 2024-04-23T18:23:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7ff910a00640 1 -- 172.21.15.28:0/2291247624 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9040b5070 con 0x7ff9140c77e0 2024-04-23T18:23:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f6bc9000640 1 -- 172.21.15.28:0/2018018097 shutdown_connections 2024-04-23T18:23:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f6bc9000640 1 --2- 172.21.15.28:0/2018018097 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bc415ba20 0x7f6bc406e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f6bc9000640 1 --2- 172.21.15.28:0/2018018097 >> v2:172.21.15.28:3300/0 conn(0x7f6bc40c8310 0x7f6bc415c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f6bc9000640 1 --2- 172.21.15.28:0/2018018097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bc41550e0 0x7f6bc415c490 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f9ea5600640 1 -- 172.21.15.28:0/1862260765 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e94003620 con 0x7f9ea8159690 2024-04-23T18:23:02.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e840052a0 con 0x7f9ea8159690 2024-04-23T18:23:02.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f6bc9000640 1 -- 172.21.15.28:0/2018018097 >> 172.21.15.28:0/2018018097 conn(0x7f6bc40cc550 msgr2=0x7f6bc40cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7ff918a00640 1 -- 172.21.15.28:0/2291247624 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 msgr2=0x7ff9140cc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7ff918a00640 1 --2- 172.21.15.28:0/2291247624 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 0x7ff9140cc4e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff904009870 tx=0x7ff90401ed50 comp rx=0 tx=0).stop 2024-04-23T18:23:02.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f9ea5600640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e88068380 0x7f9e8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f9ea5600640 1 -- 172.21.15.28:0/1862260765 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e94123d90 con 0x7f9ea8159690 2024-04-23T18:23:02.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f5cc7e00640 1 --2- 172.21.15.28:0/40220935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc815b1d0 0x7f5cc80cc3d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80cae60 tx=0x7f5cc0025500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77dde21b30d931a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f6bc9000640 1 -- 172.21.15.28:0/2018018097 shutdown_connections 2024-04-23T18:23:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f9ead800640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e88068380 0x7f9e8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f6bc9000640 1 -- 172.21.15.28:0/2018018097 wait complete. 2024-04-23T18:23:02.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7ff918a00640 1 -- 172.21.15.28:0/2291247624 shutdown_connections 2024-04-23T18:23:02.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7ff918a00640 1 --2- 172.21.15.28:0/2291247624 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 0x7ff9140cc4e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7ff918a00640 1 --2- 172.21.15.28:0/2291247624 >> v2:172.21.15.137:3300/0 conn(0x7ff9141554f0 0x7ff91415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7ff918a00640 1 -- 172.21.15.28:0/2291247624 >> 172.21.15.28:0/2291247624 conn(0x7ff914075e30 msgr2=0x7ff9140676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f5cc6000640 1 -- 172.21.15.28:0/40220935 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc000fd40 con 0x7f5cc815b1d0 2024-04-23T18:23:02.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f902c600640 1 Processor -- start 2024-04-23T18:23:02.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7ff918a00640 1 -- 172.21.15.28:0/2291247624 shutdown_connections 2024-04-23T18:23:02.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7ff918a00640 1 -- 172.21.15.28:0/2291247624 wait complete. 2024-04-23T18:23:02.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f5cc6000640 1 -- 172.21.15.28:0/40220935 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc00b7070 con 0x7f5cc815b1d0 2024-04-23T18:23:02.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f2cad400640 1 --2- 172.21.15.28:0/1527821960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c3ac0 0x7f2cb00c97b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009e50 tx=0x7f2ca801c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=972376f356216376 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f9ead800640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e88068380 0x7f9e8806a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0011f0 tx=0x7f9e9c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f902c600640 1 -- start start 2024-04-23T18:23:02.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f5cc6000640 1 -- 172.21.15.28:0/40220935 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00112f0 con 0x7f5cc815b1d0 2024-04-23T18:23:02.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f5ccce00640 1 -- 172.21.15.28:0/40220935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc815b1d0 msgr2=0x7f5cc80cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f5ccce00640 1 --2- 172.21.15.28:0/40220935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc815b1d0 0x7f5cc80cc3d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80cae60 tx=0x7f5cc0025500 comp rx=0 tx=0).stop 2024-04-23T18:23:02.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f5ccce00640 1 -- 172.21.15.28:0/40220935 shutdown_connections 2024-04-23T18:23:02.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f5ccce00640 1 --2- 172.21.15.28:0/40220935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc815b1d0 0x7f5cc80cc3d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f5ccce00640 1 --2- 172.21.15.28:0/40220935 >> v2:172.21.15.137:3300/0 conn(0x7f5cc80d11d0 0x7f5cc815f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f5ccce00640 1 -- 172.21.15.28:0/40220935 >> 172.21.15.28:0/40220935 conn(0x7f5cc806d050 msgr2=0x7f5cc8072bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f2caca00640 1 -- 172.21.15.28:0/1527821960 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80a5780 con 0x7f2cb00c3ac0 2024-04-23T18:23:02.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc9000640 1 Processor -- start 2024-04-23T18:23:02.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc9000640 1 -- start start 2024-04-23T18:23:02.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc9000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bc40c8310 0x7f6bc40cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bc41550e0 0x7f6bc4156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc9000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bc415ba20 0x7f6bc4157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bc40c8310 0x7f6bc40cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc9000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc406ef00 con 0x7f6bc40c8310 2024-04-23T18:23:02.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bc40c8310 0x7f6bc40cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41190/0 (socket says 172.21.15.28:41190) 2024-04-23T18:23:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f902c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 0x7f90240c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f902c600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90240cbe90 0x7f90241fc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f902c600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902415d210 0x7f9024147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f9029c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 0x7f90240c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f9029c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 0x7f90240c3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:43050/0 (socket says 172.21.15.28:43050) 2024-04-23T18:23:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f9029c00640 1 -- 172.21.15.28:0/2788891837 learned_addr learned my addr 172.21.15.28:0/2788891837 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f90240c5d50 con 0x7f90240cbe90 2024-04-23T18:23:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f902a600640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902415d210 0x7f9024147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9024159dd0 con 0x7f902415d210 2024-04-23T18:23:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f902414d0c0 con 0x7f9024073b00 2024-04-23T18:23:02.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f9029200640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90240cbe90 0x7f90241fc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7ff918a00640 1 Processor -- start 2024-04-23T18:23:02.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7ff918a00640 1 -- start start 2024-04-23T18:23:02.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f5ccce00640 1 -- 172.21.15.28:0/40220935 shutdown_connections 2024-04-23T18:23:02.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f5ccce00640 1 -- 172.21.15.28:0/40220935 wait complete. 2024-04-23T18:23:02.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f5ccce00640 1 Processor -- start 2024-04-23T18:23:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f2caca00640 1 -- 172.21.15.28:0/1527821960 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca80a5920 con 0x7f2cb00c3ac0 2024-04-23T18:23:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.644+0000 7f2caca00640 1 -- 172.21.15.28:0/1527821960 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80a5cf0 con 0x7f2cb00c3ac0 2024-04-23T18:23:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f2cb4a00640 1 -- 172.21.15.28:0/1527821960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c3ac0 msgr2=0x7f2cb00c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f2cb4a00640 1 --2- 172.21.15.28:0/1527821960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c3ac0 0x7f2cb00c97b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009e50 tx=0x7f2ca801c9f0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f2cb4a00640 1 -- 172.21.15.28:0/1527821960 shutdown_connections 2024-04-23T18:23:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f2cb4a00640 1 --2- 172.21.15.28:0/1527821960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c3ac0 0x7f2cb00c97b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f2cb4a00640 1 --2- 172.21.15.28:0/1527821960 >> v2:172.21.15.137:3300/0 conn(0x7f2cb0155460 0x7f2cb015b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f2cb4a00640 1 -- 172.21.15.28:0/1527821960 >> 172.21.15.28:0/1527821960 conn(0x7f2cb0075e30 msgr2=0x7f2cb00676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f2cb4a00640 1 -- 172.21.15.28:0/1527821960 shutdown_connections 2024-04-23T18:23:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f2cb4a00640 1 -- 172.21.15.28:0/1527821960 wait complete. 2024-04-23T18:23:02.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f2cb4a00640 1 Processor -- start 2024-04-23T18:23:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f2cb4a00640 1 -- start start 2024-04-23T18:23:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc3400640 1 -- 172.21.15.28:0/241112703 learned_addr learned my addr 172.21.15.28:0/241112703 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc9000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc40c7c50 con 0x7f6bc41550e0 2024-04-23T18:23:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc9000640 1 -- 172.21.15.28:0/241112703 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc406f080 con 0x7f6bc415ba20 2024-04-23T18:23:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc2a00640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bc41550e0 0x7f6bc4156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.648+0000 7f6bc3e00640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bc415ba20 0x7f6bc4157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cb4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cb00c3ac0 0x7f2cb01594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f902a600640 1 -- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 msgr2=0x7f90240c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f902a600640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 0x7f90240c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f5ccce00640 1 -- start start 2024-04-23T18:23:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cb4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c4110 0x7f2cb015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cb4a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb0155460 0x7f2cb01449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cb4a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb00c9cf0 con 0x7f2cb0155460 2024-04-23T18:23:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cb4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb00c4660 con 0x7f2cb00c3ac0 2024-04-23T18:23:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cb4a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb00c9e70 con 0x7f2cb00c4110 2024-04-23T18:23:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cade00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cb00c3ac0 0x7f2cb01594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cade00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cb00c3ac0 0x7f2cb01594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:43068/0 (socket says 172.21.15.28:43068) 2024-04-23T18:23:02.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cade00640 1 -- 172.21.15.28:0/2165452376 learned_addr learned my addr 172.21.15.28:0/2165452376 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cae800640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb0155460 0x7f2cb01449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cad400640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c4110 0x7f2cb015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f902a600640 1 -- 172.21.15.28:0/2788891837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90240cbe90 msgr2=0x7f90241fc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f902a600640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90240cbe90 0x7f90241fc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f902a600640 1 -- 172.21.15.28:0/2788891837 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902415b910 con 0x7f902415d210 2024-04-23T18:23:02.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f9029c00640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 0x7f90240c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:02.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f9029200640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90240cbe90 0x7f90241fc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:02.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bc3e00640 1 -- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bc41550e0 msgr2=0x7f6bc4156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bc3e00640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bc41550e0 0x7f6bc4156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bc3e00640 1 -- 172.21.15.28:0/241112703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bc40c8310 msgr2=0x7f6bc40cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bc3e00640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bc40c8310 0x7f6bc40cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bc3e00640 1 -- 172.21.15.28:0/241112703 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc40c5c80 con 0x7f6bc415ba20 2024-04-23T18:23:02.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f902a600640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902415d210 0x7f9024147bd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9024071ae0 tx=0x7f901c019680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bc3e00640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bc415ba20 0x7f6bc4157970 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc007cf0 tx=0x7f6bbc00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cad400640 1 -- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cb00c3ac0 msgr2=0x7f2cb01594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cad400640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cb00c3ac0 0x7f2cb01594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cad400640 1 -- 172.21.15.28:0/2165452376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb0155460 msgr2=0x7f2cb01449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cad400640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb0155460 0x7f2cb01449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cad400640 1 -- 172.21.15.28:0/2165452376 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb015ab50 con 0x7f2cb00c4110 2024-04-23T18:23:02.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bbb400640 1 -- 172.21.15.28:0/241112703 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00edd0 con 0x7f6bc415ba20 2024-04-23T18:23:02.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bbb400640 1 -- 172.21.15.28:0/241112703 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bbc0039a0 con 0x7f6bc415ba20 2024-04-23T18:23:02.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bbb400640 1 -- 172.21.15.28:0/241112703 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc003d90 con 0x7f6bc415ba20 2024-04-23T18:23:02.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cad400640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c4110 0x7f2cb015a250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00741e0 tx=0x7f2ca8019790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bc9000640 1 -- 172.21.15.28:0/241112703 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc4155bd0 con 0x7f6bc415ba20 2024-04-23T18:23:02.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bc9000640 1 -- 172.21.15.28:0/241112703 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc4157150 con 0x7f6bc415ba20 2024-04-23T18:23:02.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7ff918a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 0x7ff9141fe390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2ca6000640 1 -- 172.21.15.28:0/2165452376 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80bc020 con 0x7f2cb00c4110 2024-04-23T18:23:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cb4a00640 1 -- 172.21.15.28:0/2165452376 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb015ae30 con 0x7f2cb00c4110 2024-04-23T18:23:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2cb4a00640 1 -- 172.21.15.28:0/2165452376 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb01441b0 con 0x7f2cb00c4110 2024-04-23T18:23:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2ca6000640 1 -- 172.21.15.28:0/2165452376 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca80b8670 con 0x7f2cb00c4110 2024-04-23T18:23:02.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f2ca6000640 1 -- 172.21.15.28:0/2165452376 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80b8a40 con 0x7f2cb00c4110 2024-04-23T18:23:02.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7ff918a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9140cca20 0x7ff91415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f6bc9000640 1 -- 172.21.15.28:0/241112703 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc4068cd0 con 0x7f6bc415ba20 2024-04-23T18:23:02.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7ff911e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 0x7ff9141fe390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7ff918a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9141554f0 0x7ff91415d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7ff918a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff91415b220 con 0x7ff9141554f0 2024-04-23T18:23:02.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7ff918a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff91415c0f0 con 0x7ff9140cca20 2024-04-23T18:23:02.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7ff918a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff9141558d0 con 0x7ff9140c77e0 2024-04-23T18:23:02.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f5ccce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cc80d11d0 0x7f5cc81e6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f5ccce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc8155490 0x7f5cc81e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f5ccce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc815b1d0 0x7f5cc81502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f5ccce00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc80cced0 con 0x7f5cc8155490 2024-04-23T18:23:02.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f5ccce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc8155870 con 0x7f5cc815b1d0 2024-04-23T18:23:02.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f5ccce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc80cd050 con 0x7f5cc80d11d0 2024-04-23T18:23:02.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.652+0000 7f5cc7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cc80d11d0 0x7f5cc81e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff911e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 0x7ff9141fe390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:43074/0 (socket says 172.21.15.28:43074) 2024-04-23T18:23:02.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff911e00640 1 -- 172.21.15.28:0/3543162705 learned_addr learned my addr 172.21.15.28:0/3543162705 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff912800640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9141554f0 0x7ff91415d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f5cc7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cc80d11d0 0x7f5cc81e6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:43086/0 (socket says 172.21.15.28:43086) 2024-04-23T18:23:02.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f5cc7400640 1 -- 172.21.15.28:0/3756405445 learned_addr learned my addr 172.21.15.28:0/3756405445 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:02.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f5cc6a00640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc8155490 0x7f5cc81e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f5cc7e00640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc815b1d0 0x7f5cc81502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff911400640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9140cca20 0x7ff91415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f2cb4a00640 1 -- 172.21.15.28:0/2165452376 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c880052a0 con 0x7f2cb00c4110 2024-04-23T18:23:02.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff912800640 1 -- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 msgr2=0x7ff9141fe390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff912800640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 0x7ff9141fe390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff912800640 1 -- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9140cca20 msgr2=0x7ff91415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff912800640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9140cca20 0x7ff91415cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff912800640 1 -- 172.21.15.28:0/3543162705 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9140c6ce0 con 0x7ff9141554f0 2024-04-23T18:23:02.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff912800640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9141554f0 0x7ff91415d470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c3f0 tx=0x7ff8fc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f5cc7e00640 1 -- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cc80d11d0 msgr2=0x7f5cc81e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f5cc7e00640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cc80d11d0 0x7f5cc81e6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f5cc7e00640 1 -- 172.21.15.28:0/3756405445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc8155490 msgr2=0x7f5cc81e69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f5cc7e00640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc8155490 0x7f5cc81e69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff90a000640 1 -- 172.21.15.28:0/3543162705 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0052d0 con 0x7ff9141554f0 2024-04-23T18:23:02.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff90a000640 1 -- 172.21.15.28:0/3543162705 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8fc005470 con 0x7ff9141554f0 2024-04-23T18:23:02.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff90a000640 1 -- 172.21.15.28:0/3543162705 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc007260 con 0x7ff9141554f0 2024-04-23T18:23:02.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f6bbb400640 1 -- 172.21.15.28:0/241112703 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6bbc01b020 con 0x7f6bc415ba20 2024-04-23T18:23:02.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f5cc7e00640 1 -- 172.21.15.28:0/3756405445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc81f0030 con 0x7f5cc815b1d0 2024-04-23T18:23:02.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f2ca6000640 1 -- 172.21.15.28:0/2165452376 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2ca80bf020 con 0x7f2cb00c4110 2024-04-23T18:23:02.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff918a00640 1 -- 172.21.15.28:0/3543162705 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91415c380 con 0x7ff9141554f0 2024-04-23T18:23:02.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7ff918a00640 1 -- 172.21.15.28:0/3543162705 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff91414f0c0 con 0x7ff9141554f0 2024-04-23T18:23:02.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f6bbb400640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6ba4068400 0x7f6ba406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f6bbb400640 1 -- 172.21.15.28:0/241112703 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6bbc087ca0 con 0x7f6bc415ba20 2024-04-23T18:23:02.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f5cc7e00640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc815b1d0 0x7f5cc81502e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00b3000 tx=0x7f5cc00222a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.656+0000 7f6bc3400640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6ba4068400 0x7f6ba406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f9021600640 1 -- 172.21.15.28:0/2788891837 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c0bb030 con 0x7f902415d210 2024-04-23T18:23:02.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f5cbf400640 1 -- 172.21.15.28:0/3756405445 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00c1070 con 0x7f5cc815b1d0 2024-04-23T18:23:02.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f9021600640 1 -- 172.21.15.28:0/2788891837 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901c0a55a0 con 0x7f902415d210 2024-04-23T18:23:02.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f5cbf400640 1 -- 172.21.15.28:0/3756405445 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc00114e0 con 0x7f5cc815b1d0 2024-04-23T18:23:02.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f5cbf400640 1 -- 172.21.15.28:0/3756405445 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0011890 con 0x7f5cc815b1d0 2024-04-23T18:23:02.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f9021600640 1 -- 172.21.15.28:0/2788891837 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c0b2040 con 0x7f902415d210 2024-04-23T18:23:02.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f9ea5600640 1 -- 172.21.15.28:0/1862260765 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e940c9020 con 0x7f9ea8159690 2024-04-23T18:23:02.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f2ca6000640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2c900683b0 0x7f2c9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902415bbf0 con 0x7f902415d210 2024-04-23T18:23:02.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90241fb9e0 con 0x7f902415d210 2024-04-23T18:23:02.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f5ccce00640 1 -- 172.21.15.28:0/3756405445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc81f02f0 con 0x7f5cc815b1d0 2024-04-23T18:23:02.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f5ccce00640 1 -- 172.21.15.28:0/3756405445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc81e4710 con 0x7f5cc815b1d0 2024-04-23T18:23:02.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f2ca6000640 1 -- 172.21.15.28:0/2165452376 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2ca8121b90 con 0x7f2cb00c4110 2024-04-23T18:23:02.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f2cade00640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2c900683b0 0x7f2c9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f6bc3400640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6ba4068400 0x7f6ba406a8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0000c10 tx=0x7f6bb00aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90000052a0 con 0x7f902415d210 2024-04-23T18:23:02.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f5cbcc00640 1 -- 172.21.15.28:0/3756405445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc8074290 con 0x7f5cc815b1d0 2024-04-23T18:23:02.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7ff918a00640 1 -- 172.21.15.28:0/3543162705 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff914068db0 con 0x7ff9141554f0 2024-04-23T18:23:02.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7ff90a000640 1 -- 172.21.15.28:0/3543162705 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8fc007400 con 0x7ff9141554f0 2024-04-23T18:23:02.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.660+0000 7f2cade00640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2c900683b0 0x7f2c9006a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00b9f0 tx=0x7f2c9c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.664+0000 7ff90a000640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff8f0068380 0x7ff8f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.664+0000 7ff90a000640 1 -- 172.21.15.28:0/3543162705 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff8fc0860c0 con 0x7ff9141554f0 2024-04-23T18:23:02.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.664+0000 7f9021600640 1 -- 172.21.15.28:0/2788891837 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f901c0be070 con 0x7f902415d210 2024-04-23T18:23:02.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.664+0000 7ff911e00640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff8f0068380 0x7ff8f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.664+0000 7ff911e00640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff8f0068380 0x7ff8f006a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff90c003b90 tx=0x7ff90c0098d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.664+0000 7f5cbf400640 1 -- 172.21.15.28:0/3756405445 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5cc00bb3f0 con 0x7f5cc815b1d0 2024-04-23T18:23:02.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.664+0000 7f9021600640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90040683b0 0x7f900406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.664+0000 7f9021600640 1 -- 172.21.15.28:0/2788891837 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f901c121600 con 0x7f902415d210 2024-04-23T18:23:02.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.664+0000 7f9029c00640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90040683b0 0x7f900406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.668+0000 7f9029c00640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90040683b0 0x7f900406a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9018007fd0 tx=0x7f9018009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.668+0000 7f5cbf400640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5ca8068380 0x7f5ca806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:02.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.668+0000 7f5cbf400640 1 -- 172.21.15.28:0/3756405445 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5cc0129e50 con 0x7f5cc815b1d0 2024-04-23T18:23:02.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.668+0000 7f5cc7400640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5ca8068380 0x7f5ca806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:02.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.668+0000 7f5cc7400640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5ca8068380 0x7f5ca806a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8007fd0 tx=0x7f5cb8007f20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:02.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.668+0000 7ff90a000640 1 -- 172.21.15.28:0/3543162705 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff8fc055c50 con 0x7ff9141554f0 2024-04-23T18:23:02.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.672+0000 7f6bbb400640 1 -- 172.21.15.28:0/241112703 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6bbc057f00 con 0x7f6bc415ba20 2024-04-23T18:23:02.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.676+0000 7f9021600640 1 -- 172.21.15.28:0/2788891837 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f901c016560 con 0x7f902415d210 2024-04-23T18:23:02.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.688+0000 7f2ca6000640 1 -- 172.21.15.28:0/2165452376 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2ca80c6030 con 0x7f2cb00c4110 2024-04-23T18:23:02.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.692+0000 7f5cbf400640 1 -- 172.21.15.28:0/3756405445 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5cc001f120 con 0x7f5cc815b1d0 2024-04-23T18:23:02.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.912+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fafb415cfa0 con 0x7fafb40c39e0 2024-04-23T18:23:02.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.912+0000 7fafb0c00640 1 -- 172.21.15.28:0/1819454864 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fafa40f4b30 con 0x7fafb40c39e0 2024-04-23T18:23:02.905 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faf98068380 msgr2=0x7faf9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faf98068380 0x7faf9806a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fafb40c7200 tx=0x7fafa8008040 comp rx=0 tx=0).stop 2024-04-23T18:23:02.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb40c39e0 msgr2=0x7fafb414faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb40c39e0 0x7fafb414faf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fafa40af000 tx=0x7fafa401ba10 comp rx=0 tx=0).stop 2024-04-23T18:23:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 shutdown_connections 2024-04-23T18:23:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faf98068380 0x7faf9806a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafb415f410 0x7fafb4156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fafb4159590 0x7fafb4155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 --2- 172.21.15.28:0/1819454864 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fafb40c39e0 0x7fafb414faf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 >> 172.21.15.28:0/1819454864 conn(0x7fafb40676e0 msgr2=0x7fafb40c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 shutdown_connections 2024-04-23T18:23:02.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.916+0000 7fafbb600640 1 -- 172.21.15.28:0/1819454864 wait complete. 2024-04-23T18:23:02.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.928+0000 7fcd26a00640 1 -- 172.21.15.28:0/2947299165 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcd340cd280 con 0x7fcd340c74a0 2024-04-23T18:23:02.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.940+0000 7fcd31600640 1 -- 172.21.15.28:0/2947299165 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcd2805ab60 con 0x7fcd340c74a0 2024-04-23T18:23:02.934 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:02.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 -- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcd140683b0 msgr2=0x7fcd1406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcd140683b0 0x7fcd1406a870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcd340c92a0 tx=0x7fcd2c00d040 comp rx=0 tx=0).stop 2024-04-23T18:23:02.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 -- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 msgr2=0x7fcd341f8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 0x7fcd341f8c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800e900 tx=0x7fcd2800edc0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 -- 172.21.15.28:0/2947299165 shutdown_connections 2024-04-23T18:23:02.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcd140683b0 0x7fcd1406a870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd34159690 0x7fcd341f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcd340c8ad0 0x7fcd3415ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 --2- 172.21.15.28:0/2947299165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcd340c74a0 0x7fcd341f8c70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 -- 172.21.15.28:0/2947299165 >> 172.21.15.28:0/2947299165 conn(0x7fcd340cc550 msgr2=0x7fcd340c97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 -- 172.21.15.28:0/2947299165 shutdown_connections 2024-04-23T18:23:02.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.944+0000 7fcd26a00640 1 -- 172.21.15.28:0/2947299165 wait complete. 2024-04-23T18:23:02.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-04-23T18:23:02.943 DEBUG:teuthology.parallel:result is None 2024-04-23T18:23:02.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-04-23T18:23:02.971 DEBUG:teuthology.parallel:result is None 2024-04-23T18:23:02.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.992+0000 7f2cb4a00640 1 -- 172.21.15.28:0/2165452376 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2c88005590 con 0x7f2cb00c4110 2024-04-23T18:23:02.985 INFO:teuthology.orchestra.run.smithi028.stdout:55834574858 2024-04-23T18:23:02.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.992+0000 7f2ca6000640 1 -- 172.21.15.28:0/2165452376 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ca80165e0 con 0x7f2cb00c4110 2024-04-23T18:23:02.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.992+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9000005860 con 0x7f902415d210 2024-04-23T18:23:02.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 -- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2c900683b0 msgr2=0x7f2c9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2c900683b0 0x7f2c9006a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00b9f0 tx=0x7f2c9c008040 comp rx=0 tx=0).stop 2024-04-23T18:23:02.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 -- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c4110 msgr2=0x7f2cb015a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c4110 0x7f2cb015a250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00741e0 tx=0x7f2ca8019790 comp rx=0 tx=0).stop 2024-04-23T18:23:02.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f9021600640 1 -- 172.21.15.28:0/2788891837 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f901c0f1330 con 0x7f902415d210 2024-04-23T18:23:02.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 -- 172.21.15.28:0/2165452376 shutdown_connections 2024-04-23T18:23:02.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2c900683b0 0x7f2c9006a870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cb00c4110 0x7f2cb015a250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb0155460 0x7f2cb01449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 --2- 172.21.15.28:0/2165452376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cb00c3ac0 0x7f2cb01594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 -- 172.21.15.28:0/2165452376 >> 172.21.15.28:0/2165452376 conn(0x7f2cb0075e30 msgr2=0x7f2cb006e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.989 INFO:teuthology.orchestra.run.smithi028.stdout:55834574861 2024-04-23T18:23:02.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 -- 172.21.15.28:0/2165452376 shutdown_connections 2024-04-23T18:23:02.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f2cb4a00640 1 -- 172.21.15.28:0/2165452376 wait complete. 2024-04-23T18:23:02.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90040683b0 msgr2=0x7f900406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90040683b0 0x7f900406a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9018007fd0 tx=0x7f9018009040 comp rx=0 tx=0).stop 2024-04-23T18:23:02.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902415d210 msgr2=0x7f9024147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:02.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902415d210 0x7f9024147bd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9024071ae0 tx=0x7f901c019680 comp rx=0 tx=0).stop 2024-04-23T18:23:02.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 shutdown_connections 2024-04-23T18:23:02.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f90040683b0 0x7f900406a870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902415d210 0x7f9024147bd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f90240cbe90 0x7f90241fc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 --2- 172.21.15.28:0/2788891837 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9024073b00 0x7f90240c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:02.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 >> 172.21.15.28:0/2788891837 conn(0x7f9024072f30 msgr2=0x7f9024075060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:02.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 shutdown_connections 2024-04-23T18:23:02.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:02.996+0000 7f902c600640 1 -- 172.21.15.28:0/2788891837 wait complete. 2024-04-23T18:23:02.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.004+0000 7ff918a00640 1 -- 172.21.15.28:0/3543162705 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff9140c75c0 con 0x7ff9141554f0 2024-04-23T18:23:02.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.004+0000 7ff90a000640 1 -- 172.21.15.28:0/3543162705 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8fc059f50 con 0x7ff9141554f0 2024-04-23T18:23:02.998 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:03.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9e84005590 con 0x7f9ea8159690 2024-04-23T18:23:03.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7f9ea5600640 1 -- 172.21.15.28:0/1862260765 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ea814ff10 con 0x7f9ea8159690 2024-04-23T18:23:03.001 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:03.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 -- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff8f0068380 msgr2=0x7ff8f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff8f0068380 0x7ff8f006a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff90c003b90 tx=0x7ff90c0098d0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 -- 172.21.15.28:0/3543162705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9141554f0 msgr2=0x7ff91415d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9141554f0 0x7ff91415d470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c3f0 tx=0x7ff8fc00c8b0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 -- 172.21.15.28:0/3543162705 shutdown_connections 2024-04-23T18:23:03.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff8f0068380 0x7ff8f006a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9141554f0 0x7ff91415d470 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9140cca20 0x7ff91415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 --2- 172.21.15.28:0/3543162705 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff9140c77e0 0x7ff9141fe390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 -- 172.21.15.28:0/3543162705 >> 172.21.15.28:0/3543162705 conn(0x7ff914075e30 msgr2=0x7ff914152110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:03.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 -- 172.21.15.28:0/3543162705 shutdown_connections 2024-04-23T18:23:03.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.008+0000 7ff918a00640 1 -- 172.21.15.28:0/3543162705 wait complete. 2024-04-23T18:23:03.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e88068380 msgr2=0x7f9e8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e88068380 0x7f9e8806a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0011f0 tx=0x7f9e9c009040 comp rx=0 tx=0).stop 2024-04-23T18:23:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ea8159690 msgr2=0x7f9ea8073330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ea8159690 0x7f9ea8073330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9e940af000 tx=0x7f9e9401ba50 comp rx=0 tx=0).stop 2024-04-23T18:23:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 shutdown_connections 2024-04-23T18:23:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e88068380 0x7f9e8806a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ea8159690 0x7f9ea8073330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ea80c8ad0 0x7f9ea813c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 --2- 172.21.15.28:0/1862260765 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ea80c74a0 0x7f9ea8071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 >> 172.21.15.28:0/1862260765 conn(0x7f9ea80cc550 msgr2=0x7f9ea8158410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 shutdown_connections 2024-04-23T18:23:03.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.012+0000 7f9eaec00640 1 -- 172.21.15.28:0/1862260765 wait complete. 2024-04-23T18:23:03.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.020+0000 7f6bc9000640 1 -- 172.21.15.28:0/241112703 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6bc40c8ad0 con 0x7f6bc415ba20 2024-04-23T18:23:03.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.020+0000 7f6bbb400640 1 -- 172.21.15.28:0/241112703 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6bbc05e0d0 con 0x7f6bc415ba20 2024-04-23T18:23:03.013 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:03.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 -- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6ba4068400 msgr2=0x7f6ba406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6ba4068400 0x7f6ba406a8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0000c10 tx=0x7f6bb00aa070 comp rx=0 tx=0).stop 2024-04-23T18:23:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 -- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bc415ba20 msgr2=0x7f6bc4157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bc415ba20 0x7f6bc4157970 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc007cf0 tx=0x7f6bbc00e4b0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 -- 172.21.15.28:0/241112703 shutdown_connections 2024-04-23T18:23:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6ba4068400 0x7f6ba406a8c0 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0000c10 tx=0x7f6bb00aa070 comp rx=0 tx=0).stop 2024-04-23T18:23:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bc415ba20 0x7f6bc4157970 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bc41550e0 0x7f6bc4156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 --2- 172.21.15.28:0/241112703 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bc40c8310 0x7f6bc40cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 -- 172.21.15.28:0/241112703 >> 172.21.15.28:0/241112703 conn(0x7f6bc40cc550 msgr2=0x7f6bc4152cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 -- 172.21.15.28:0/241112703 shutdown_connections 2024-04-23T18:23:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.024+0000 7f6bc9000640 1 -- 172.21.15.28:0/241112703 wait complete. 2024-04-23T18:23:03.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-23T18:23:03.024 DEBUG:teuthology.parallel:result is None 2024-04-23T18:23:03.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.6 2024-04-23T18:23:03.027 DEBUG:teuthology.parallel:result is None 2024-04-23T18:23:03.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.040+0000 7f5cbcc00640 1 -- 172.21.15.28:0/3756405445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5cc80cb130 con 0x7f5cc815b1d0 2024-04-23T18:23:03.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.040+0000 7f5cbf400640 1 -- 172.21.15.28:0/3756405445 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5cc00f9a60 con 0x7f5cc815b1d0 2024-04-23T18:23:03.032 INFO:teuthology.orchestra.run.smithi028.stdout:55834574859 2024-04-23T18:23:03.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-04-23T18:23:03.034 DEBUG:teuthology.parallel:result is None 2024-04-23T18:23:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 -- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5ca8068380 msgr2=0x7f5ca806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5ca8068380 0x7f5ca806a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8007fd0 tx=0x7f5cb8007f20 comp rx=0 tx=0).stop 2024-04-23T18:23:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 -- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc815b1d0 msgr2=0x7f5cc81502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc815b1d0 0x7f5cc81502e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00b3000 tx=0x7f5cc00222a0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 -- 172.21.15.28:0/3756405445 shutdown_connections 2024-04-23T18:23:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5ca8068380 0x7f5ca806a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc815b1d0 0x7f5cc81502e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc8155490 0x7f5cc81e69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 --2- 172.21.15.28:0/3756405445 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cc80d11d0 0x7f5cc81e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 -- 172.21.15.28:0/3756405445 >> 172.21.15.28:0/3756405445 conn(0x7f5cc806d050 msgr2=0x7f5cc8072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:03.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 -- 172.21.15.28:0/3756405445 shutdown_connections 2024-04-23T18:23:03.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.044+0000 7f5cbcc00640 1 -- 172.21.15.28:0/3756405445 wait complete. 2024-04-23T18:23:03.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-04-23T18:23:03.038 DEBUG:teuthology.parallel:result is None 2024-04-23T18:23:03.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-04-23T18:23:03.044 DEBUG:teuthology.parallel:result is None 2024-04-23T18:23:03.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-04-23T18:23:03.057 DEBUG:teuthology.parallel:result is None 2024-04-23T18:23:03.057 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T18:23:03.057 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:23:03.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.248+0000 7fc0e1a00640 1 Processor -- start 2024-04-23T18:23:03.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.248+0000 7fc0e1a00640 1 -- start start 2024-04-23T18:23:03.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0e1a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc0dc0b5240 0x7fc0dc0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0e1a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0dc0cd230 0x7fc0dc0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0e1a00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0dc0b5c10 con 0x7fc0dc155290 2024-04-23T18:23:03.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0e1a00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fc0dc0b4db0 con 0x7fc0dc0b5240 2024-04-23T18:23:03.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0e1a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc0dc15e810 con 0x7fc0dc0cd230 2024-04-23T18:23:03.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0d3e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc0dc0b5240 0x7fc0dc0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0d3e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc0dc0b5240 0x7fc0dc0b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41238/0 (socket says 172.21.15.28:41238) 2024-04-23T18:23:03.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0d3e00640 1 -- 172.21.15.28:0/1287520221 learned_addr learned my addr 172.21.15.28:0/1287520221 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:03.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0daa00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc0dc155290 0x7fc0dc0cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58666/0 (socket says 172.21.15.28:58666) 2024-04-23T18:23:03.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0db400640 1 --2- 172.21.15.28:0/1287520221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0dc0cd230 0x7fc0dc0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0d3e00640 1 -- 172.21.15.28:0/1287520221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0dc0cd230 msgr2=0x7fc0dc0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:03.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0d3e00640 1 --2- 172.21.15.28:0/1287520221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0dc0cd230 0x7fc0dc0cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0d3e00640 1 -- 172.21.15.28:0/1287520221 >> v1:172.21.15.28:6789/0 conn(0x7fc0dc155290 legacy=0x7fc0dc0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0d3e00640 1 -- 172.21.15.28:0/1287520221 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc15eab0 con 0x7fc0dc0b5240 2024-04-23T18:23:03.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.252+0000 7fc0db400640 1 --2- 172.21.15.28:0/1287520221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0dc0cd230 0x7fc0dc0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:03.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0d3e00640 1 --2- 172.21.15.28:0/1287520221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0dc0b5240 0x7fc0dc0b56d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009870 tx=0x7fc0c401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560dd04071909303 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:03.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0da000640 1 -- 172.21.15.28:0/1287520221 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40a95f0 con 0x7fc0dc0b5240 2024-04-23T18:23:03.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0da000640 1 -- 172.21.15.28:0/1287520221 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c40a9790 con 0x7fc0dc0b5240 2024-04-23T18:23:03.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0da000640 1 -- 172.21.15.28:0/1287520221 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40a9b60 con 0x7fc0dc0b5240 2024-04-23T18:23:03.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1287520221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0dc0b5240 msgr2=0x7fc0dc0b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0e1a00640 1 --2- 172.21.15.28:0/1287520221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0dc0b5240 0x7fc0dc0b56d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009870 tx=0x7fc0c401c530 comp rx=0 tx=0).stop 2024-04-23T18:23:03.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1287520221 shutdown_connections 2024-04-23T18:23:03.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0e1a00640 1 --2- 172.21.15.28:0/1287520221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0dc0cd230 0x7fc0dc0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0e1a00640 1 --2- 172.21.15.28:0/1287520221 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0dc0b5240 0x7fc0dc0b56d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1287520221 >> 172.21.15.28:0/1287520221 conn(0x7fc0dc075dd0 msgr2=0x7fc0dc0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:03.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1287520221 shutdown_connections 2024-04-23T18:23:03.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1287520221 wait complete. 2024-04-23T18:23:03.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0e1a00640 1 Processor -- start 2024-04-23T18:23:03.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.256+0000 7fc0e1a00640 1 -- start start 2024-04-23T18:23:03.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0e1a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0dc0b5240 0x7fc0dc151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0e1a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0dc0cd230 0x7fc0dc14cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0e1a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0dc155290 0x7fc0dc14a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0e1a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc155670 con 0x7fc0dc155290 2024-04-23T18:23:03.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0e1a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc15f630 con 0x7fc0dc0b5240 2024-04-23T18:23:03.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0e1a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc0dc0cdbc0 con 0x7fc0dc0cd230 2024-04-23T18:23:03.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0db400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0dc155290 0x7fc0dc14a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0db400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0dc155290 0x7fc0dc14a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41252/0 (socket says 172.21.15.28:41252) 2024-04-23T18:23:03.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0db400640 1 -- 172.21.15.28:0/1127654237 learned_addr learned my addr 172.21.15.28:0/1127654237 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:03.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0daa00640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0dc0b5240 0x7fc0dc151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0d3e00640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0dc0cd230 0x7fc0dc14cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0db400640 1 -- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0dc0cd230 msgr2=0x7fc0dc14cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0db400640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0dc0cd230 0x7fc0dc14cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0db400640 1 -- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0dc0b5240 msgr2=0x7fc0dc151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0db400640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0dc0b5240 0x7fc0dc151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0db400640 1 -- 172.21.15.28:0/1127654237 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc0c7940 con 0x7fc0dc155290 2024-04-23T18:23:03.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0db400640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0dc155290 0x7fc0dc14a680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009fd0 tx=0x7fc0d400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:03.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0d2a00640 1 -- 172.21.15.28:0/1127654237 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d401a070 con 0x7fc0dc155290 2024-04-23T18:23:03.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0d2a00640 1 -- 172.21.15.28:0/1127654237 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d4003bc0 con 0x7fc0dc155290 2024-04-23T18:23:03.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0d2a00640 1 -- 172.21.15.28:0/1127654237 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4004030 con 0x7fc0dc155290 2024-04-23T18:23:03.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1127654237 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0dc0c59e0 con 0x7fc0dc155290 2024-04-23T18:23:03.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1127654237 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0dc14a290 con 0x7fc0dc155290 2024-04-23T18:23:03.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1127654237 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0dc068cd0 con 0x7fc0dc155290 2024-04-23T18:23:03.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.260+0000 7fc0d2a00640 1 -- 172.21.15.28:0/1127654237 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc0d401d070 con 0x7fc0dc155290 2024-04-23T18:23:03.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.264+0000 7fc0d2a00640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc0b8068380 0x7fc0b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.264+0000 7fc0d2a00640 1 -- 172.21.15.28:0/1127654237 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc0d4087080 con 0x7fc0dc155290 2024-04-23T18:23:03.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.264+0000 7fc0daa00640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc0b8068380 0x7fc0b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.264+0000 7fc0daa00640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc0b8068380 0x7fc0b806a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc007fd0 tx=0x7fc0cc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:03.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.268+0000 7fc0d2a00640 1 -- 172.21.15.28:0/1127654237 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0dc0c59e0 con 0x7fc0dc155290 2024-04-23T18:23:03.314 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-23T18:23:03.319+0000 7f925011a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-23T18:23:03.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.428+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1127654237 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0dc0c7490 con 0x7fc0b8068380 2024-04-23T18:23:03.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.452+0000 7fc0d2a00640 1 -- 172.21.15.28:0/1127654237 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332684 (secure 0 0 0) 0x7fc0dc0c7490 con 0x7fc0b8068380 2024-04-23T18:23:03.449 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:03.452 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc0b8068380 msgr2=0x7fc0b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc0b8068380 0x7fc0b806a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc007fd0 tx=0x7fc0cc009040 comp rx=0 tx=0).stop 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1127654237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0dc155290 msgr2=0x7fc0dc14a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0dc155290 0x7fc0dc14a680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009fd0 tx=0x7fc0d400d560 comp rx=0 tx=0).stop 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1127654237 shutdown_connections 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc0b8068380 0x7fc0b806a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0dc0cd230 0x7fc0dc14cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0dc155290 0x7fc0dc14a680 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 --2- 172.21.15.28:0/1127654237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0dc0b5240 0x7fc0dc151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1127654237 >> 172.21.15.28:0/1127654237 conn(0x7fc0dc075dd0 msgr2=0x7fc0dc0729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1127654237 shutdown_connections 2024-04-23T18:23:03.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.456+0000 7fc0e1a00640 1 -- 172.21.15.28:0/1127654237 wait complete. 2024-04-23T18:23:03.469 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-23T18:23:03.331038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":246,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227684,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747036,"statfs":{"total":773094113280,"available":772860964864,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1547,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005452"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876377+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:22:38.876377+0000","last_peered":"2024-04-23T18:22:38.876377+0000","last_clean":"2024-04-23T18:22:38.876377+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:22:38.876377+0000","last_undegraded":"2024-04-23T18:22:38.876377+0000","last_fullsized":"2024-04-23T18:22:38.876377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512435+0000","last_change":"2024-04-23T18:22:33.374920+0000","last_active":"2024-04-23T18:22:38.512435+0000","last_peered":"2024-04-23T18:22:38.512435+0000","last_clean":"2024-04-23T18:22:38.512435+0000","last_became_active":"2024-04-23T18:22:33.374636+0000","last_became_peered":"2024-04-23T18:22:33.374636+0000","last_unstale":"2024-04-23T18:22:38.512435+0000","last_undegraded":"2024-04-23T18:22:38.512435+0000","last_fullsized":"2024-04-23T18:22:38.512435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:15.638456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511738+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:22:38.511738+0000","last_peered":"2024-04-23T18:22:38.511738+0000","last_clean":"2024-04-23T18:22:38.511738+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:22:38.511738+0000","last_undegraded":"2024-04-23T18:22:38.511738+0000","last_fullsized":"2024-04-23T18:22:38.511738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512559+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:22:38.512559+0000","last_peered":"2024-04-23T18:22:38.512559+0000","last_clean":"2024-04-23T18:22:38.512559+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:22:38.512559+0000","last_undegraded":"2024-04-23T18:22:38.512559+0000","last_fullsized":"2024-04-23T18:22:38.512559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876263+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:22:38.876263+0000","last_peered":"2024-04-23T18:22:38.876263+0000","last_clean":"2024-04-23T18:22:38.876263+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:22:38.876263+0000","last_undegraded":"2024-04-23T18:22:38.876263+0000","last_fullsized":"2024-04-23T18:22:38.876263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398723+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:22:38.398723+0000","last_peered":"2024-04-23T18:22:38.398723+0000","last_clean":"2024-04-23T18:22:38.398723+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:22:38.398723+0000","last_undegraded":"2024-04-23T18:22:38.398723+0000","last_fullsized":"2024-04-23T18:22:38.398723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877548+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:22:38.877548+0000","last_peered":"2024-04-23T18:22:38.877548+0000","last_clean":"2024-04-23T18:22:38.877548+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:22:38.877548+0000","last_undegraded":"2024-04-23T18:22:38.877548+0000","last_fullsized":"2024-04-23T18:22:38.877548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520160+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:22:38.520160+0000","last_peered":"2024-04-23T18:22:38.520160+0000","last_clean":"2024-04-23T18:22:38.520160+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:22:38.520160+0000","last_undegraded":"2024-04-23T18:22:38.520160+0000","last_fullsized":"2024-04-23T18:22:38.520160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399105+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:22:38.399105+0000","last_peered":"2024-04-23T18:22:38.399105+0000","last_clean":"2024-04-23T18:22:38.399105+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:22:38.399105+0000","last_undegraded":"2024-04-23T18:22:38.399105+0000","last_fullsized":"2024-04-23T18:22:38.399105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876812+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:22:38.876812+0000","last_peered":"2024-04-23T18:22:38.876812+0000","last_clean":"2024-04-23T18:22:38.876812+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:22:38.876812+0000","last_undegraded":"2024-04-23T18:22:38.876812+0000","last_fullsized":"2024-04-23T18:22:38.876812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520391+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:22:38.520391+0000","last_peered":"2024-04-23T18:22:38.520391+0000","last_clean":"2024-04-23T18:22:38.520391+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:22:38.520391+0000","last_undegraded":"2024-04-23T18:22:38.520391+0000","last_fullsized":"2024-04-23T18:22:38.520391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399129+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:22:38.399129+0000","last_peered":"2024-04-23T18:22:38.399129+0000","last_clean":"2024-04-23T18:22:38.399129+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:22:38.399129+0000","last_undegraded":"2024-04-23T18:22:38.399129+0000","last_fullsized":"2024-04-23T18:22:38.399129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395366+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:22:38.395366+0000","last_peered":"2024-04-23T18:22:38.395366+0000","last_clean":"2024-04-23T18:22:38.395366+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:22:38.395366+0000","last_undegraded":"2024-04-23T18:22:38.395366+0000","last_fullsized":"2024-04-23T18:22:38.395366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.502651+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:23:00.502651+0000","last_peered":"2024-04-23T18:23:00.502651+0000","last_clean":"2024-04-23T18:23:00.502651+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:23:00.502651+0000","last_undegraded":"2024-04-23T18:23:00.502651+0000","last_fullsized":"2024-04-23T18:23:00.502651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400086+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:22:38.400086+0000","last_peered":"2024-04-23T18:22:38.400086+0000","last_clean":"2024-04-23T18:22:38.400086+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:22:38.400086+0000","last_undegraded":"2024-04-23T18:22:38.400086+0000","last_fullsized":"2024-04-23T18:22:38.400086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511999+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:22:38.511999+0000","last_peered":"2024-04-23T18:22:38.511999+0000","last_clean":"2024-04-23T18:22:38.511999+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:22:38.511999+0000","last_undegraded":"2024-04-23T18:22:38.511999+0000","last_fullsized":"2024-04-23T18:22:38.511999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772083+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:22:38.772083+0000","last_peered":"2024-04-23T18:22:38.772083+0000","last_clean":"2024-04-23T18:22:38.772083+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:22:38.772083+0000","last_undegraded":"2024-04-23T18:22:38.772083+0000","last_fullsized":"2024-04-23T18:22:38.772083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399812+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:22:38.399812+0000","last_peered":"2024-04-23T18:22:38.399812+0000","last_clean":"2024-04-23T18:22:38.399812+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:22:38.399812+0000","last_undegraded":"2024-04-23T18:22:38.399812+0000","last_fullsized":"2024-04-23T18:22:38.399812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511898+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:22:38.511898+0000","last_peered":"2024-04-23T18:22:38.511898+0000","last_clean":"2024-04-23T18:22:38.511898+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:22:38.511898+0000","last_undegraded":"2024-04-23T18:22:38.511898+0000","last_fullsized":"2024-04-23T18:22:38.511898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.512259+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:23:00.512259+0000","last_peered":"2024-04-23T18:23:00.512259+0000","last_clean":"2024-04-23T18:23:00.512259+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:23:00.512259+0000","last_undegraded":"2024-04-23T18:23:00.512259+0000","last_fullsized":"2024-04-23T18:23:00.512259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772456+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:22:38.772456+0000","last_peered":"2024-04-23T18:22:38.772456+0000","last_clean":"2024-04-23T18:22:38.772456+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:22:38.772456+0000","last_undegraded":"2024-04-23T18:22:38.772456+0000","last_fullsized":"2024-04-23T18:22:38.772456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399139+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:22:38.399139+0000","last_peered":"2024-04-23T18:22:38.399139+0000","last_clean":"2024-04-23T18:22:38.399139+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:22:38.399139+0000","last_undegraded":"2024-04-23T18:22:38.399139+0000","last_fullsized":"2024-04-23T18:22:38.399139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.505258+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:23:00.505258+0000","last_peered":"2024-04-23T18:23:00.505258+0000","last_clean":"2024-04-23T18:23:00.505258+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:23:00.505258+0000","last_undegraded":"2024-04-23T18:23:00.505258+0000","last_fullsized":"2024-04-23T18:23:00.505258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400185+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:22:38.400185+0000","last_peered":"2024-04-23T18:22:38.400185+0000","last_clean":"2024-04-23T18:22:38.400185+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:22:38.400185+0000","last_undegraded":"2024-04-23T18:22:38.400185+0000","last_fullsized":"2024-04-23T18:22:38.400185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876309+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:22:38.876309+0000","last_peered":"2024-04-23T18:22:38.876309+0000","last_clean":"2024-04-23T18:22:38.876309+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:22:38.876309+0000","last_undegraded":"2024-04-23T18:22:38.876309+0000","last_fullsized":"2024-04-23T18:22:38.876309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.502371+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:23:00.502371+0000","last_peered":"2024-04-23T18:23:00.502371+0000","last_clean":"2024-04-23T18:23:00.502371+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:23:00.502371+0000","last_undegraded":"2024-04-23T18:23:00.502371+0000","last_fullsized":"2024-04-23T18:23:00.502371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399544+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:22:38.399544+0000","last_peered":"2024-04-23T18:22:38.399544+0000","last_clean":"2024-04-23T18:22:38.399544+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:22:38.399544+0000","last_undegraded":"2024-04-23T18:22:38.399544+0000","last_fullsized":"2024-04-23T18:22:38.399544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512524+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:22:38.512524+0000","last_peered":"2024-04-23T18:22:38.512524+0000","last_clean":"2024-04-23T18:22:38.512524+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:22:38.512524+0000","last_undegraded":"2024-04-23T18:22:38.512524+0000","last_fullsized":"2024-04-23T18:22:38.512524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772582+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:22:38.772582+0000","last_peered":"2024-04-23T18:22:38.772582+0000","last_clean":"2024-04-23T18:22:38.772582+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:22:38.772582+0000","last_undegraded":"2024-04-23T18:22:38.772582+0000","last_fullsized":"2024-04-23T18:22:38.772582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511607+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:22:38.511607+0000","last_peered":"2024-04-23T18:22:38.511607+0000","last_clean":"2024-04-23T18:22:38.511607+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:22:38.511607+0000","last_undegraded":"2024-04-23T18:22:38.511607+0000","last_fullsized":"2024-04-23T18:22:38.511607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772268+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:22:38.772268+0000","last_peered":"2024-04-23T18:22:38.772268+0000","last_clean":"2024-04-23T18:22:38.772268+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:22:38.772268+0000","last_undegraded":"2024-04-23T18:22:38.772268+0000","last_fullsized":"2024-04-23T18:22:38.772268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877746+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:22:38.877746+0000","last_peered":"2024-04-23T18:22:38.877746+0000","last_clean":"2024-04-23T18:22:38.877746+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:22:38.877746+0000","last_undegraded":"2024-04-23T18:22:38.877746+0000","last_fullsized":"2024-04-23T18:22:38.877746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875996+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:22:38.875996+0000","last_peered":"2024-04-23T18:22:38.875996+0000","last_clean":"2024-04-23T18:22:38.875996+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:22:38.875996+0000","last_undegraded":"2024-04-23T18:22:38.875996+0000","last_fullsized":"2024-04-23T18:22:38.875996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520638+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:22:38.520638+0000","last_peered":"2024-04-23T18:22:38.520638+0000","last_clean":"2024-04-23T18:22:38.520638+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:22:38.520638+0000","last_undegraded":"2024-04-23T18:22:38.520638+0000","last_fullsized":"2024-04-23T18:22:38.520638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772367+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:22:38.772367+0000","last_peered":"2024-04-23T18:22:38.772367+0000","last_clean":"2024-04-23T18:22:38.772367+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:22:38.772367+0000","last_undegraded":"2024-04-23T18:22:38.772367+0000","last_fullsized":"2024-04-23T18:22:38.772367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771877+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:22:38.771877+0000","last_peered":"2024-04-23T18:22:38.771877+0000","last_clean":"2024-04-23T18:22:38.771877+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:22:38.771877+0000","last_undegraded":"2024-04-23T18:22:38.771877+0000","last_fullsized":"2024-04-23T18:22:38.771877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399411+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:22:38.399411+0000","last_peered":"2024-04-23T18:22:38.399411+0000","last_clean":"2024-04-23T18:22:38.399411+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:22:38.399411+0000","last_undegraded":"2024-04-23T18:22:38.399411+0000","last_fullsized":"2024-04-23T18:22:38.399411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520001+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:22:38.520001+0000","last_peered":"2024-04-23T18:22:38.520001+0000","last_clean":"2024-04-23T18:22:38.520001+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:22:38.520001+0000","last_undegraded":"2024-04-23T18:22:38.520001+0000","last_fullsized":"2024-04-23T18:22:38.520001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772519+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:22:38.772519+0000","last_peered":"2024-04-23T18:22:38.772519+0000","last_clean":"2024-04-23T18:22:38.772519+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:22:38.772519+0000","last_undegraded":"2024-04-23T18:22:38.772519+0000","last_fullsized":"2024-04-23T18:22:38.772519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771764+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:22:38.771764+0000","last_peered":"2024-04-23T18:22:38.771764+0000","last_clean":"2024-04-23T18:22:38.771764+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:22:38.771764+0000","last_undegraded":"2024-04-23T18:22:38.771764+0000","last_fullsized":"2024-04-23T18:22:38.771764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394033+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:22:38.394033+0000","last_peered":"2024-04-23T18:22:38.394033+0000","last_clean":"2024-04-23T18:22:38.394033+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:22:38.394033+0000","last_undegraded":"2024-04-23T18:22:38.394033+0000","last_fullsized":"2024-04-23T18:22:38.394033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772489+0000","last_change":"2024-04-23T18:22:37.434423+0000","last_active":"2024-04-23T18:22:38.772489+0000","last_peered":"2024-04-23T18:22:38.772489+0000","last_clean":"2024-04-23T18:22:38.772489+0000","last_became_active":"2024-04-23T18:22:37.434030+0000","last_became_peered":"2024-04-23T18:22:37.434030+0000","last_unstale":"2024-04-23T18:22:38.772489+0000","last_undegraded":"2024-04-23T18:22:38.772489+0000","last_fullsized":"2024-04-23T18:22:38.772489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:38:05.642960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875593+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:22:38.875593+0000","last_peered":"2024-04-23T18:22:38.875593+0000","last_clean":"2024-04-23T18:22:38.875593+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:22:38.875593+0000","last_undegraded":"2024-04-23T18:22:38.875593+0000","last_fullsized":"2024-04-23T18:22:38.875593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876395+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:22:38.876395+0000","last_peered":"2024-04-23T18:22:38.876395+0000","last_clean":"2024-04-23T18:22:38.876395+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:22:38.876395+0000","last_undegraded":"2024-04-23T18:22:38.876395+0000","last_fullsized":"2024-04-23T18:22:38.876395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876336+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:22:38.876336+0000","last_peered":"2024-04-23T18:22:38.876336+0000","last_clean":"2024-04-23T18:22:38.876336+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:22:38.876336+0000","last_undegraded":"2024-04-23T18:22:38.876336+0000","last_fullsized":"2024-04-23T18:22:38.876336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511913+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:22:38.511913+0000","last_peered":"2024-04-23T18:22:38.511913+0000","last_clean":"2024-04-23T18:22:38.511913+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:22:38.511913+0000","last_undegraded":"2024-04-23T18:22:38.511913+0000","last_fullsized":"2024-04-23T18:22:38.511913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.506210+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:23:00.506210+0000","last_peered":"2024-04-23T18:23:00.506210+0000","last_clean":"2024-04-23T18:23:00.506210+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:23:00.506210+0000","last_undegraded":"2024-04-23T18:23:00.506210+0000","last_fullsized":"2024-04-23T18:23:00.506210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876556+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:22:38.876556+0000","last_peered":"2024-04-23T18:22:38.876556+0000","last_clean":"2024-04-23T18:22:38.876556+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:22:38.876556+0000","last_undegraded":"2024-04-23T18:22:38.876556+0000","last_fullsized":"2024-04-23T18:22:38.876556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396052+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:22:38.396052+0000","last_peered":"2024-04-23T18:22:38.396052+0000","last_clean":"2024-04-23T18:22:38.396052+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:22:38.396052+0000","last_undegraded":"2024-04-23T18:22:38.396052+0000","last_fullsized":"2024-04-23T18:22:38.396052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877306+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:22:38.877306+0000","last_peered":"2024-04-23T18:22:38.877306+0000","last_clean":"2024-04-23T18:22:38.877306+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:22:38.877306+0000","last_undegraded":"2024-04-23T18:22:38.877306+0000","last_fullsized":"2024-04-23T18:22:38.877306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394450+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:22:38.394450+0000","last_peered":"2024-04-23T18:22:38.394450+0000","last_clean":"2024-04-23T18:22:38.394450+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:22:38.394450+0000","last_undegraded":"2024-04-23T18:22:38.394450+0000","last_fullsized":"2024-04-23T18:22:38.394450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395296+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:22:38.395296+0000","last_peered":"2024-04-23T18:22:38.395296+0000","last_clean":"2024-04-23T18:22:38.395296+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:22:38.395296+0000","last_undegraded":"2024-04-23T18:22:38.395296+0000","last_fullsized":"2024-04-23T18:22:38.395296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520463+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:22:38.520463+0000","last_peered":"2024-04-23T18:22:38.520463+0000","last_clean":"2024-04-23T18:22:38.520463+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:22:38.520463+0000","last_undegraded":"2024-04-23T18:22:38.520463+0000","last_fullsized":"2024-04-23T18:22:38.520463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772482+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:22:38.772482+0000","last_peered":"2024-04-23T18:22:38.772482+0000","last_clean":"2024-04-23T18:22:38.772482+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:22:38.772482+0000","last_undegraded":"2024-04-23T18:22:38.772482+0000","last_fullsized":"2024-04-23T18:22:38.772482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876108+0000","last_change":"2024-04-23T18:22:37.422351+0000","last_active":"2024-04-23T18:22:38.876108+0000","last_peered":"2024-04-23T18:22:38.876108+0000","last_clean":"2024-04-23T18:22:38.876108+0000","last_became_active":"2024-04-23T18:22:37.421745+0000","last_became_peered":"2024-04-23T18:22:37.421745+0000","last_unstale":"2024-04-23T18:22:38.876108+0000","last_undegraded":"2024-04-23T18:22:38.876108+0000","last_fullsized":"2024-04-23T18:22:38.876108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:43.074101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.878109+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:22:38.878109+0000","last_peered":"2024-04-23T18:22:38.878109+0000","last_clean":"2024-04-23T18:22:38.878109+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:22:38.878109+0000","last_undegraded":"2024-04-23T18:22:38.878109+0000","last_fullsized":"2024-04-23T18:22:38.878109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394651+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:22:38.394651+0000","last_peered":"2024-04-23T18:22:38.394651+0000","last_clean":"2024-04-23T18:22:38.394651+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:22:38.394651+0000","last_undegraded":"2024-04-23T18:22:38.394651+0000","last_fullsized":"2024-04-23T18:22:38.394651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519385+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:22:38.519385+0000","last_peered":"2024-04-23T18:22:38.519385+0000","last_clean":"2024-04-23T18:22:38.519385+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:22:38.519385+0000","last_undegraded":"2024-04-23T18:22:38.519385+0000","last_fullsized":"2024-04-23T18:22:38.519385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877267+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:22:38.877267+0000","last_peered":"2024-04-23T18:22:38.877267+0000","last_clean":"2024-04-23T18:22:38.877267+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:22:38.877267+0000","last_undegraded":"2024-04-23T18:22:38.877267+0000","last_fullsized":"2024-04-23T18:22:38.877267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400190+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:22:38.400190+0000","last_peered":"2024-04-23T18:22:38.400190+0000","last_clean":"2024-04-23T18:22:38.400190+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:22:38.400190+0000","last_undegraded":"2024-04-23T18:22:38.400190+0000","last_fullsized":"2024-04-23T18:22:38.400190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398668+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:22:38.398668+0000","last_peered":"2024-04-23T18:22:38.398668+0000","last_clean":"2024-04-23T18:22:38.398668+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:22:38.398668+0000","last_undegraded":"2024-04-23T18:22:38.398668+0000","last_fullsized":"2024-04-23T18:22:38.398668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876669+0000","last_change":"2024-04-23T18:22:33.407067+0000","last_active":"2024-04-23T18:22:38.876669+0000","last_peered":"2024-04-23T18:22:38.876669+0000","last_clean":"2024-04-23T18:22:38.876669+0000","last_became_active":"2024-04-23T18:22:33.406727+0000","last_became_peered":"2024-04-23T18:22:33.406727+0000","last_unstale":"2024-04-23T18:22:38.876669+0000","last_undegraded":"2024-04-23T18:22:38.876669+0000","last_fullsized":"2024-04-23T18:22:38.876669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:21:04.444047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.510349+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:23:00.510349+0000","last_peered":"2024-04-23T18:23:00.510349+0000","last_clean":"2024-04-23T18:23:00.510349+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:23:00.510349+0000","last_undegraded":"2024-04-23T18:23:00.510349+0000","last_fullsized":"2024-04-23T18:23:00.510349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876191+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:22:38.876191+0000","last_peered":"2024-04-23T18:22:38.876191+0000","last_clean":"2024-04-23T18:22:38.876191+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:22:38.876191+0000","last_undegraded":"2024-04-23T18:22:38.876191+0000","last_fullsized":"2024-04-23T18:22:38.876191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395264+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:22:38.395264+0000","last_peered":"2024-04-23T18:22:38.395264+0000","last_clean":"2024-04-23T18:22:38.395264+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:22:38.395264+0000","last_undegraded":"2024-04-23T18:22:38.395264+0000","last_fullsized":"2024-04-23T18:22:38.395264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395402+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:22:38.395402+0000","last_peered":"2024-04-23T18:22:38.395402+0000","last_clean":"2024-04-23T18:22:38.395402+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:22:38.395402+0000","last_undegraded":"2024-04-23T18:22:38.395402+0000","last_fullsized":"2024-04-23T18:22:38.395402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512523+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:22:38.512523+0000","last_peered":"2024-04-23T18:22:38.512523+0000","last_clean":"2024-04-23T18:22:38.512523+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:22:38.512523+0000","last_undegraded":"2024-04-23T18:22:38.512523+0000","last_fullsized":"2024-04-23T18:22:38.512523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877129+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:22:38.877129+0000","last_peered":"2024-04-23T18:22:38.877129+0000","last_clean":"2024-04-23T18:22:38.877129+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:22:38.877129+0000","last_undegraded":"2024-04-23T18:22:38.877129+0000","last_fullsized":"2024-04-23T18:22:38.877129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.511072+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:23:00.511072+0000","last_peered":"2024-04-23T18:23:00.511072+0000","last_clean":"2024-04-23T18:23:00.511072+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:23:00.511072+0000","last_undegraded":"2024-04-23T18:23:00.511072+0000","last_fullsized":"2024-04-23T18:23:00.511072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512108+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:22:38.512108+0000","last_peered":"2024-04-23T18:22:38.512108+0000","last_clean":"2024-04-23T18:22:38.512108+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:22:38.512108+0000","last_undegraded":"2024-04-23T18:22:38.512108+0000","last_fullsized":"2024-04-23T18:22:38.512108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875754+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:22:38.875754+0000","last_peered":"2024-04-23T18:22:38.875754+0000","last_clean":"2024-04-23T18:22:38.875754+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:22:38.875754+0000","last_undegraded":"2024-04-23T18:22:38.875754+0000","last_fullsized":"2024-04-23T18:22:38.875754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.499797+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:23:00.499797+0000","last_peered":"2024-04-23T18:23:00.499797+0000","last_clean":"2024-04-23T18:23:00.499797+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:23:00.499797+0000","last_undegraded":"2024-04-23T18:23:00.499797+0000","last_fullsized":"2024-04-23T18:23:00.499797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520575+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:22:38.520575+0000","last_peered":"2024-04-23T18:22:38.520575+0000","last_clean":"2024-04-23T18:22:38.520575+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:22:38.520575+0000","last_undegraded":"2024-04-23T18:22:38.520575+0000","last_fullsized":"2024-04-23T18:22:38.520575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877083+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:22:38.877083+0000","last_peered":"2024-04-23T18:22:38.877083+0000","last_clean":"2024-04-23T18:22:38.877083+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:22:38.877083+0000","last_undegraded":"2024-04-23T18:22:38.877083+0000","last_fullsized":"2024-04-23T18:22:38.877083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.510932+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:23:00.510932+0000","last_peered":"2024-04-23T18:23:00.510932+0000","last_clean":"2024-04-23T18:23:00.510932+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:23:00.510932+0000","last_undegraded":"2024-04-23T18:23:00.510932+0000","last_fullsized":"2024-04-23T18:23:00.510932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772018+0000","last_change":"2024-04-23T18:22:37.423270+0000","last_active":"2024-04-23T18:22:38.772018+0000","last_peered":"2024-04-23T18:22:38.772018+0000","last_clean":"2024-04-23T18:22:38.772018+0000","last_became_active":"2024-04-23T18:22:37.422847+0000","last_became_peered":"2024-04-23T18:22:37.422847+0000","last_unstale":"2024-04-23T18:22:38.772018+0000","last_undegraded":"2024-04-23T18:22:38.772018+0000","last_fullsized":"2024-04-23T18:22:38.772018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:42.248011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399891+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:22:38.399891+0000","last_peered":"2024-04-23T18:22:38.399891+0000","last_clean":"2024-04-23T18:22:38.399891+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:22:38.399891+0000","last_undegraded":"2024-04-23T18:22:38.399891+0000","last_fullsized":"2024-04-23T18:22:38.399891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772425+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:22:38.772425+0000","last_peered":"2024-04-23T18:22:38.772425+0000","last_clean":"2024-04-23T18:22:38.772425+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:22:38.772425+0000","last_undegraded":"2024-04-23T18:22:38.772425+0000","last_fullsized":"2024-04-23T18:22:38.772425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399340+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:22:38.399340+0000","last_peered":"2024-04-23T18:22:38.399340+0000","last_clean":"2024-04-23T18:22:38.399340+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:22:38.399340+0000","last_undegraded":"2024-04-23T18:22:38.399340+0000","last_fullsized":"2024-04-23T18:22:38.399340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876364+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:22:38.876364+0000","last_peered":"2024-04-23T18:22:38.876364+0000","last_clean":"2024-04-23T18:22:38.876364+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:22:38.876364+0000","last_undegraded":"2024-04-23T18:22:38.876364+0000","last_fullsized":"2024-04-23T18:22:38.876364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.503962+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:23:00.503962+0000","last_peered":"2024-04-23T18:23:00.503962+0000","last_clean":"2024-04-23T18:23:00.503962+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:23:00.503962+0000","last_undegraded":"2024-04-23T18:23:00.503962+0000","last_fullsized":"2024-04-23T18:23:00.503962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511802+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:22:38.511802+0000","last_peered":"2024-04-23T18:22:38.511802+0000","last_clean":"2024-04-23T18:22:38.511802+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:22:38.511802+0000","last_undegraded":"2024-04-23T18:22:38.511802+0000","last_fullsized":"2024-04-23T18:22:38.511802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520447+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:22:38.520447+0000","last_peered":"2024-04-23T18:22:38.520447+0000","last_clean":"2024-04-23T18:22:38.520447+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:22:38.520447+0000","last_undegraded":"2024-04-23T18:22:38.520447+0000","last_fullsized":"2024-04-23T18:22:38.520447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.505519+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:23:00.505519+0000","last_peered":"2024-04-23T18:23:00.505519+0000","last_clean":"2024-04-23T18:23:00.505519+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:23:00.505519+0000","last_undegraded":"2024-04-23T18:23:00.505519+0000","last_fullsized":"2024-04-23T18:23:00.505519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511805+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:22:38.511805+0000","last_peered":"2024-04-23T18:22:38.511805+0000","last_clean":"2024-04-23T18:22:38.511805+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:22:38.511805+0000","last_undegraded":"2024-04-23T18:22:38.511805+0000","last_fullsized":"2024-04-23T18:22:38.511805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876162+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:22:38.876162+0000","last_peered":"2024-04-23T18:22:38.876162+0000","last_clean":"2024-04-23T18:22:38.876162+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:22:38.876162+0000","last_undegraded":"2024-04-23T18:22:38.876162+0000","last_fullsized":"2024-04-23T18:22:38.876162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771668+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:22:38.771668+0000","last_peered":"2024-04-23T18:22:38.771668+0000","last_clean":"2024-04-23T18:22:38.771668+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:22:38.771668+0000","last_undegraded":"2024-04-23T18:22:38.771668+0000","last_fullsized":"2024-04-23T18:22:38.771668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519727+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:22:38.519727+0000","last_peered":"2024-04-23T18:22:38.519727+0000","last_clean":"2024-04-23T18:22:38.519727+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:22:38.519727+0000","last_undegraded":"2024-04-23T18:22:38.519727+0000","last_fullsized":"2024-04-23T18:22:38.519727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396141+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:22:38.396141+0000","last_peered":"2024-04-23T18:22:38.396141+0000","last_clean":"2024-04-23T18:22:38.396141+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:22:38.396141+0000","last_undegraded":"2024-04-23T18:22:38.396141+0000","last_fullsized":"2024-04-23T18:22:38.396141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511775+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:22:38.511775+0000","last_peered":"2024-04-23T18:22:38.511775+0000","last_clean":"2024-04-23T18:22:38.511775+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:22:38.511775+0000","last_undegraded":"2024-04-23T18:22:38.511775+0000","last_fullsized":"2024-04-23T18:22:38.511775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511945+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:22:38.511945+0000","last_peered":"2024-04-23T18:22:38.511945+0000","last_clean":"2024-04-23T18:22:38.511945+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:22:38.511945+0000","last_undegraded":"2024-04-23T18:22:38.511945+0000","last_fullsized":"2024-04-23T18:22:38.511945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395587+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:22:38.395587+0000","last_peered":"2024-04-23T18:22:38.395587+0000","last_clean":"2024-04-23T18:22:38.395587+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:22:38.395587+0000","last_undegraded":"2024-04-23T18:22:38.395587+0000","last_fullsized":"2024-04-23T18:22:38.395587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876159+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:22:38.876159+0000","last_peered":"2024-04-23T18:22:38.876159+0000","last_clean":"2024-04-23T18:22:38.876159+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:22:38.876159+0000","last_undegraded":"2024-04-23T18:22:38.876159+0000","last_fullsized":"2024-04-23T18:22:38.876159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394359+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:22:38.394359+0000","last_peered":"2024-04-23T18:22:38.394359+0000","last_clean":"2024-04-23T18:22:38.394359+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:22:38.394359+0000","last_undegraded":"2024-04-23T18:22:38.394359+0000","last_fullsized":"2024-04-23T18:22:38.394359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.511922+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:23:00.511922+0000","last_peered":"2024-04-23T18:23:00.511922+0000","last_clean":"2024-04-23T18:23:00.511922+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:23:00.511922+0000","last_undegraded":"2024-04-23T18:23:00.511922+0000","last_fullsized":"2024-04-23T18:23:00.511922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398922+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:22:38.398922+0000","last_peered":"2024-04-23T18:22:38.398922+0000","last_clean":"2024-04-23T18:22:38.398922+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:22:38.398922+0000","last_undegraded":"2024-04-23T18:22:38.398922+0000","last_fullsized":"2024-04-23T18:22:38.398922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512357+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:22:38.512357+0000","last_peered":"2024-04-23T18:22:38.512357+0000","last_clean":"2024-04-23T18:22:38.512357+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:22:38.512357+0000","last_undegraded":"2024-04-23T18:22:38.512357+0000","last_fullsized":"2024-04-23T18:22:38.512357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395074+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:22:38.395074+0000","last_peered":"2024-04-23T18:22:38.395074+0000","last_clean":"2024-04-23T18:22:38.395074+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:22:38.395074+0000","last_undegraded":"2024-04-23T18:22:38.395074+0000","last_fullsized":"2024-04-23T18:22:38.395074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.393976+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:22:38.393976+0000","last_peered":"2024-04-23T18:22:38.393976+0000","last_clean":"2024-04-23T18:22:38.393976+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:22:38.393976+0000","last_undegraded":"2024-04-23T18:22:38.393976+0000","last_fullsized":"2024-04-23T18:22:38.393976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519749+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:22:38.519749+0000","last_peered":"2024-04-23T18:22:38.519749+0000","last_clean":"2024-04-23T18:22:38.519749+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:22:38.519749+0000","last_undegraded":"2024-04-23T18:22:38.519749+0000","last_fullsized":"2024-04-23T18:22:38.519749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876029+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:22:38.876029+0000","last_peered":"2024-04-23T18:22:38.876029+0000","last_clean":"2024-04-23T18:22:38.876029+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:22:38.876029+0000","last_undegraded":"2024-04-23T18:22:38.876029+0000","last_fullsized":"2024-04-23T18:22:38.876029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512257+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:22:38.512257+0000","last_peered":"2024-04-23T18:22:38.512257+0000","last_clean":"2024-04-23T18:22:38.512257+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:22:38.512257+0000","last_undegraded":"2024-04-23T18:22:38.512257+0000","last_fullsized":"2024-04-23T18:22:38.512257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772250+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:22:38.772250+0000","last_peered":"2024-04-23T18:22:38.772250+0000","last_clean":"2024-04-23T18:22:38.772250+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:22:38.772250+0000","last_undegraded":"2024-04-23T18:22:38.772250+0000","last_fullsized":"2024-04-23T18:22:38.772250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396520+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:22:38.396520+0000","last_peered":"2024-04-23T18:22:38.396520+0000","last_clean":"2024-04-23T18:22:38.396520+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:22:38.396520+0000","last_undegraded":"2024-04-23T18:22:38.396520+0000","last_fullsized":"2024-04-23T18:22:38.396520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512421+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:22:38.512421+0000","last_peered":"2024-04-23T18:22:38.512421+0000","last_clean":"2024-04-23T18:22:38.512421+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:22:38.512421+0000","last_undegraded":"2024-04-23T18:22:38.512421+0000","last_fullsized":"2024-04-23T18:22:38.512421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519528+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:22:38.519528+0000","last_peered":"2024-04-23T18:22:38.519528+0000","last_clean":"2024-04-23T18:22:38.519528+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:22:38.519528+0000","last_undegraded":"2024-04-23T18:22:38.519528+0000","last_fullsized":"2024-04-23T18:22:38.519528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512054+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:22:38.512054+0000","last_peered":"2024-04-23T18:22:38.512054+0000","last_clean":"2024-04-23T18:22:38.512054+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:22:38.512054+0000","last_undegraded":"2024-04-23T18:22:38.512054+0000","last_fullsized":"2024-04-23T18:22:38.512054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519675+0000","last_change":"2024-04-23T18:22:33.397675+0000","last_active":"2024-04-23T18:22:38.519675+0000","last_peered":"2024-04-23T18:22:38.519675+0000","last_clean":"2024-04-23T18:22:38.519675+0000","last_became_active":"2024-04-23T18:22:33.396752+0000","last_became_peered":"2024-04-23T18:22:33.396752+0000","last_unstale":"2024-04-23T18:22:38.519675+0000","last_undegraded":"2024-04-23T18:22:38.519675+0000","last_fullsized":"2024-04-23T18:22:38.519675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:26.022097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875901+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:22:38.875901+0000","last_peered":"2024-04-23T18:22:38.875901+0000","last_clean":"2024-04-23T18:22:38.875901+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:22:38.875901+0000","last_undegraded":"2024-04-23T18:22:38.875901+0000","last_fullsized":"2024-04-23T18:22:38.875901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395896+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:22:38.395896+0000","last_peered":"2024-04-23T18:22:38.395896+0000","last_clean":"2024-04-23T18:22:38.395896+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:22:38.395896+0000","last_undegraded":"2024-04-23T18:22:38.395896+0000","last_fullsized":"2024-04-23T18:22:38.395896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877641+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:22:38.877641+0000","last_peered":"2024-04-23T18:22:38.877641+0000","last_clean":"2024-04-23T18:22:38.877641+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:22:38.877641+0000","last_undegraded":"2024-04-23T18:22:38.877641+0000","last_fullsized":"2024-04-23T18:22:38.877641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394629+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:22:38.394629+0000","last_peered":"2024-04-23T18:22:38.394629+0000","last_clean":"2024-04-23T18:22:38.394629+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:22:38.394629+0000","last_undegraded":"2024-04-23T18:22:38.394629+0000","last_fullsized":"2024-04-23T18:22:38.394629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.521048+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:22:38.521048+0000","last_peered":"2024-04-23T18:22:38.521048+0000","last_clean":"2024-04-23T18:22:38.521048+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:22:38.521048+0000","last_undegraded":"2024-04-23T18:22:38.521048+0000","last_fullsized":"2024-04-23T18:22:38.521048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519224+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:22:38.519224+0000","last_peered":"2024-04-23T18:22:38.519224+0000","last_clean":"2024-04-23T18:22:38.519224+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:22:38.519224+0000","last_undegraded":"2024-04-23T18:22:38.519224+0000","last_fullsized":"2024-04-23T18:22:38.519224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771738+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:22:38.771738+0000","last_peered":"2024-04-23T18:22:38.771738+0000","last_clean":"2024-04-23T18:22:38.771738+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:22:38.771738+0000","last_undegraded":"2024-04-23T18:22:38.771738+0000","last_fullsized":"2024-04-23T18:22:38.771738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875743+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:22:38.875743+0000","last_peered":"2024-04-23T18:22:38.875743+0000","last_clean":"2024-04-23T18:22:38.875743+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:22:38.875743+0000","last_undegraded":"2024-04-23T18:22:38.875743+0000","last_fullsized":"2024-04-23T18:22:38.875743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511902+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:22:38.511902+0000","last_peered":"2024-04-23T18:22:38.511902+0000","last_clean":"2024-04-23T18:22:38.511902+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:22:38.511902+0000","last_undegraded":"2024-04-23T18:22:38.511902+0000","last_fullsized":"2024-04-23T18:22:38.511902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399785+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:22:38.399785+0000","last_peered":"2024-04-23T18:22:38.399785+0000","last_clean":"2024-04-23T18:22:38.399785+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:22:38.399785+0000","last_undegraded":"2024-04-23T18:22:38.399785+0000","last_fullsized":"2024-04-23T18:22:38.399785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396466+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:22:38.396466+0000","last_peered":"2024-04-23T18:22:38.396466+0000","last_clean":"2024-04-23T18:22:38.396466+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:22:38.396466+0000","last_undegraded":"2024-04-23T18:22:38.396466+0000","last_fullsized":"2024-04-23T18:22:38.396466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396387+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:22:38.396387+0000","last_peered":"2024-04-23T18:22:38.396387+0000","last_clean":"2024-04-23T18:22:38.396387+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:22:38.396387+0000","last_undegraded":"2024-04-23T18:22:38.396387+0000","last_fullsized":"2024-04-23T18:22:38.396387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.878029+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:22:38.878029+0000","last_peered":"2024-04-23T18:22:38.878029+0000","last_clean":"2024-04-23T18:22:38.878029+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:22:38.878029+0000","last_undegraded":"2024-04-23T18:22:38.878029+0000","last_fullsized":"2024-04-23T18:22:38.878029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511665+0000","last_change":"2024-04-23T18:22:33.397779+0000","last_active":"2024-04-23T18:22:38.511665+0000","last_peered":"2024-04-23T18:22:38.511665+0000","last_clean":"2024-04-23T18:22:38.511665+0000","last_became_active":"2024-04-23T18:22:33.397476+0000","last_became_peered":"2024-04-23T18:22:33.397476+0000","last_unstale":"2024-04-23T18:22:38.511665+0000","last_undegraded":"2024-04-23T18:22:38.511665+0000","last_fullsized":"2024-04-23T18:22:38.511665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:07.442252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876554+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:22:38.876554+0000","last_peered":"2024-04-23T18:22:38.876554+0000","last_clean":"2024-04-23T18:22:38.876554+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:22:38.876554+0000","last_undegraded":"2024-04-23T18:22:38.876554+0000","last_fullsized":"2024-04-23T18:22:38.876554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519455+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:22:38.519455+0000","last_peered":"2024-04-23T18:22:38.519455+0000","last_clean":"2024-04-23T18:22:38.519455+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:22:38.519455+0000","last_undegraded":"2024-04-23T18:22:38.519455+0000","last_fullsized":"2024-04-23T18:22:38.519455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876554+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:22:38.876554+0000","last_peered":"2024-04-23T18:22:38.876554+0000","last_clean":"2024-04-23T18:22:38.876554+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:22:38.876554+0000","last_undegraded":"2024-04-23T18:22:38.876554+0000","last_fullsized":"2024-04-23T18:22:38.876554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520171+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:22:38.520171+0000","last_peered":"2024-04-23T18:22:38.520171+0000","last_clean":"2024-04-23T18:22:38.520171+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:22:38.520171+0000","last_undegraded":"2024-04-23T18:22:38.520171+0000","last_fullsized":"2024-04-23T18:22:38.520171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876012+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:22:38.876012+0000","last_peered":"2024-04-23T18:22:38.876012+0000","last_clean":"2024-04-23T18:22:38.876012+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:22:38.876012+0000","last_undegraded":"2024-04-23T18:22:38.876012+0000","last_fullsized":"2024-04-23T18:22:38.876012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772513+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:22:38.772513+0000","last_peered":"2024-04-23T18:22:38.772513+0000","last_clean":"2024-04-23T18:22:38.772513+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:22:38.772513+0000","last_undegraded":"2024-04-23T18:22:38.772513+0000","last_fullsized":"2024-04-23T18:22:38.772513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877857+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:22:38.877857+0000","last_peered":"2024-04-23T18:22:38.877857+0000","last_clean":"2024-04-23T18:22:38.877857+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:22:38.877857+0000","last_undegraded":"2024-04-23T18:22:38.877857+0000","last_fullsized":"2024-04-23T18:22:38.877857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:23:03.474 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:23:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e8e800640 1 Processor -- start 2024-04-23T18:23:03.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e8e800640 1 -- start start 2024-04-23T18:23:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e8e800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1e88073020 0x7f1e88070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e8e800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1e880c5750 0x7f1e88142010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e8e800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e880714f0 con 0x7f1e880c8980 2024-04-23T18:23:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e8e800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f1e880c5c50 con 0x7f1e880c5750 2024-04-23T18:23:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e8e800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1e880c5f30 con 0x7f1e88073020 2024-04-23T18:23:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e86a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1e880c5750 0x7f1e88142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e86a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1e880c5750 0x7f1e88142010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41254/0 (socket says 172.21.15.28:41254) 2024-04-23T18:23:03.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e87e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1e880c8980 0x7f1e88159470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58672/0 (socket says 172.21.15.28:58672) 2024-04-23T18:23:03.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e86a00640 1 -- 172.21.15.28:0/2045828253 learned_addr learned my addr 172.21.15.28:0/2045828253 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:03.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e87400640 1 --2- 172.21.15.28:0/2045828253 >> v2:172.21.15.137:3300/0 conn(0x7f1e88073020 0x7f1e88070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e86a00640 1 -- 172.21.15.28:0/2045828253 >> v2:172.21.15.137:3300/0 conn(0x7f1e88073020 msgr2=0x7f1e88070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:03.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e86a00640 1 --2- 172.21.15.28:0/2045828253 >> v2:172.21.15.137:3300/0 conn(0x7f1e88073020 0x7f1e88070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e86a00640 1 -- 172.21.15.28:0/2045828253 >> v1:172.21.15.28:6789/0 conn(0x7f1e880c8980 legacy=0x7f1e88159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e86000640 1 -- 172.21.15.28:0/2045828253 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703103158 0 0) 0x7f1e880714f0 con 0x7f1e880c8980 2024-04-23T18:23:03.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.664+0000 7f1e86a00640 1 -- 172.21.15.28:0/2045828253 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e880c6210 con 0x7f1e880c5750 2024-04-23T18:23:03.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e86a00640 1 --2- 172.21.15.28:0/2045828253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e880c5750 0x7f1e88142010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1e880cc360 tx=0x7f1e7401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cb80c3afbb52eb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:03.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e86000640 1 -- 172.21.15.28:0/2045828253 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e740b5070 con 0x7f1e880c5750 2024-04-23T18:23:03.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e86000640 1 -- 172.21.15.28:0/2045828253 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e740a8a10 con 0x7f1e880c5750 2024-04-23T18:23:03.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e86000640 1 -- 172.21.15.28:0/2045828253 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e740a8de0 con 0x7f1e880c5750 2024-04-23T18:23:03.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e8e800640 1 -- 172.21.15.28:0/2045828253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e880c5750 msgr2=0x7f1e88142010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e8e800640 1 --2- 172.21.15.28:0/2045828253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e880c5750 0x7f1e88142010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1e880cc360 tx=0x7f1e7401ed10 comp rx=0 tx=0).stop 2024-04-23T18:23:03.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e8e800640 1 -- 172.21.15.28:0/2045828253 shutdown_connections 2024-04-23T18:23:03.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e8e800640 1 --2- 172.21.15.28:0/2045828253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e880c5750 0x7f1e88142010 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e8e800640 1 --2- 172.21.15.28:0/2045828253 >> v2:172.21.15.137:3300/0 conn(0x7f1e88073020 0x7f1e88070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e8e800640 1 -- 172.21.15.28:0/2045828253 >> 172.21.15.28:0/2045828253 conn(0x7f1e880676e0 msgr2=0x7f1e88067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:03.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e8e800640 1 -- 172.21.15.28:0/2045828253 shutdown_connections 2024-04-23T18:23:03.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e8e800640 1 -- 172.21.15.28:0/2045828253 wait complete. 2024-04-23T18:23:03.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e8e800640 1 Processor -- start 2024-04-23T18:23:03.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.668+0000 7f1e8e800640 1 -- start start 2024-04-23T18:23:03.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e8e800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e88073020 0x7f1e8806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e8e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e880c5750 0x7f1e880c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e8e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e880c8980 0x7f1e8813e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e8e800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1e88073400 con 0x7f1e88073020 2024-04-23T18:23:03.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e8e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e880c67d0 con 0x7f1e880c5750 2024-04-23T18:23:03.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e8e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1e88073580 con 0x7f1e880c8980 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e87400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e88073020 0x7f1e8806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e87400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e88073020 0x7f1e8806c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41264/0 (socket says 172.21.15.28:41264) 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e87400640 1 -- 172.21.15.28:0/1519803673 learned_addr learned my addr 172.21.15.28:0/1519803673 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e86a00640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e880c5750 0x7f1e880c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e87e00640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e880c8980 0x7f1e8813e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e87400640 1 -- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e880c8980 msgr2=0x7f1e8813e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e87400640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e880c8980 0x7f1e8813e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e87400640 1 -- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e880c5750 msgr2=0x7f1e880c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e87400640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e880c5750 0x7f1e880c4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e87400640 1 -- 172.21.15.28:0/1519803673 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8815d220 con 0x7f1e88073020 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e86a00640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e880c5750 0x7f1e880c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e87400640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e88073020 0x7f1e8806c3a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800e960 tx=0x7f1e7800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e7f400640 1 -- 172.21.15.28:0/1519803673 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e78017070 con 0x7f1e88073020 2024-04-23T18:23:03.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e7f400640 1 -- 172.21.15.28:0/1519803673 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e7800ca00 con 0x7f1e88073020 2024-04-23T18:23:03.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e7f400640 1 -- 172.21.15.28:0/1519803673 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7800cdb0 con 0x7f1e88073020 2024-04-23T18:23:03.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e8e800640 1 -- 172.21.15.28:0/1519803673 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e8813f290 con 0x7f1e88073020 2024-04-23T18:23:03.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e8e800640 1 -- 172.21.15.28:0/1519803673 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e8815cee0 con 0x7f1e88073020 2024-04-23T18:23:03.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e8e800640 1 -- 172.21.15.28:0/1519803673 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e88068cd0 con 0x7f1e88073020 2024-04-23T18:23:03.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.672+0000 7f1e7f400640 1 -- 172.21.15.28:0/1519803673 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1e7801a070 con 0x7f1e88073020 2024-04-23T18:23:03.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.676+0000 7f1e7f400640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1e680683b0 0x7f1e6806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:03.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.676+0000 7f1e7f400640 1 -- 172.21.15.28:0/1519803673 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1e78086ce0 con 0x7f1e88073020 2024-04-23T18:23:03.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.676+0000 7f1e86a00640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1e680683b0 0x7f1e6806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:03.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.676+0000 7f1e86a00640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1e680683b0 0x7f1e6806a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1e740b2000 tx=0x7f1e74008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:03.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.680+0000 7f1e7f400640 1 -- 172.21.15.28:0/1519803673 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1e78056f60 con 0x7f1e88073020 2024-04-23T18:23:03.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.840+0000 7f1e8e800640 1 -- 172.21.15.28:0/1519803673 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e8813bd80 con 0x7f1e680683b0 2024-04-23T18:23:03.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.864+0000 7f1e7f400640 1 -- 172.21.15.28:0/1519803673 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332684 (secure 0 0 0) 0x7f1e8813bd80 con 0x7f1e680683b0 2024-04-23T18:23:03.860 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:03.862 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 -- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1e680683b0 msgr2=0x7f1e6806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1e680683b0 0x7f1e6806a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1e740b2000 tx=0x7f1e74008040 comp rx=0 tx=0).stop 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 -- 172.21.15.28:0/1519803673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e88073020 msgr2=0x7f1e8806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e88073020 0x7f1e8806c3a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800e960 tx=0x7f1e7800ee20 comp rx=0 tx=0).stop 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 -- 172.21.15.28:0/1519803673 shutdown_connections 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1e680683b0 0x7f1e6806a870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e880c8980 0x7f1e8813e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e880c5750 0x7f1e880c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 --2- 172.21.15.28:0/1519803673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e88073020 0x7f1e8806c3a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 -- 172.21.15.28:0/1519803673 >> 172.21.15.28:0/1519803673 conn(0x7f1e880676e0 msgr2=0x7f1e88159470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 -- 172.21.15.28:0/1519803673 shutdown_connections 2024-04-23T18:23:03.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:03.868+0000 7f1e8e800640 1 -- 172.21.15.28:0/1519803673 wait complete. 2024-04-23T18:23:03.879 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-23T18:23:03.331038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":246,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227684,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747036,"statfs":{"total":773094113280,"available":772860964864,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1547,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005452"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876377+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:22:38.876377+0000","last_peered":"2024-04-23T18:22:38.876377+0000","last_clean":"2024-04-23T18:22:38.876377+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:22:38.876377+0000","last_undegraded":"2024-04-23T18:22:38.876377+0000","last_fullsized":"2024-04-23T18:22:38.876377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512435+0000","last_change":"2024-04-23T18:22:33.374920+0000","last_active":"2024-04-23T18:22:38.512435+0000","last_peered":"2024-04-23T18:22:38.512435+0000","last_clean":"2024-04-23T18:22:38.512435+0000","last_became_active":"2024-04-23T18:22:33.374636+0000","last_became_peered":"2024-04-23T18:22:33.374636+0000","last_unstale":"2024-04-23T18:22:38.512435+0000","last_undegraded":"2024-04-23T18:22:38.512435+0000","last_fullsized":"2024-04-23T18:22:38.512435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:51:15.638456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511738+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:22:38.511738+0000","last_peered":"2024-04-23T18:22:38.511738+0000","last_clean":"2024-04-23T18:22:38.511738+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:22:38.511738+0000","last_undegraded":"2024-04-23T18:22:38.511738+0000","last_fullsized":"2024-04-23T18:22:38.511738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512559+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:22:38.512559+0000","last_peered":"2024-04-23T18:22:38.512559+0000","last_clean":"2024-04-23T18:22:38.512559+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:22:38.512559+0000","last_undegraded":"2024-04-23T18:22:38.512559+0000","last_fullsized":"2024-04-23T18:22:38.512559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876263+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:22:38.876263+0000","last_peered":"2024-04-23T18:22:38.876263+0000","last_clean":"2024-04-23T18:22:38.876263+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:22:38.876263+0000","last_undegraded":"2024-04-23T18:22:38.876263+0000","last_fullsized":"2024-04-23T18:22:38.876263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398723+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:22:38.398723+0000","last_peered":"2024-04-23T18:22:38.398723+0000","last_clean":"2024-04-23T18:22:38.398723+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:22:38.398723+0000","last_undegraded":"2024-04-23T18:22:38.398723+0000","last_fullsized":"2024-04-23T18:22:38.398723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877548+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:22:38.877548+0000","last_peered":"2024-04-23T18:22:38.877548+0000","last_clean":"2024-04-23T18:22:38.877548+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:22:38.877548+0000","last_undegraded":"2024-04-23T18:22:38.877548+0000","last_fullsized":"2024-04-23T18:22:38.877548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520160+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:22:38.520160+0000","last_peered":"2024-04-23T18:22:38.520160+0000","last_clean":"2024-04-23T18:22:38.520160+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:22:38.520160+0000","last_undegraded":"2024-04-23T18:22:38.520160+0000","last_fullsized":"2024-04-23T18:22:38.520160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399105+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:22:38.399105+0000","last_peered":"2024-04-23T18:22:38.399105+0000","last_clean":"2024-04-23T18:22:38.399105+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:22:38.399105+0000","last_undegraded":"2024-04-23T18:22:38.399105+0000","last_fullsized":"2024-04-23T18:22:38.399105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876812+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:22:38.876812+0000","last_peered":"2024-04-23T18:22:38.876812+0000","last_clean":"2024-04-23T18:22:38.876812+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:22:38.876812+0000","last_undegraded":"2024-04-23T18:22:38.876812+0000","last_fullsized":"2024-04-23T18:22:38.876812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520391+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:22:38.520391+0000","last_peered":"2024-04-23T18:22:38.520391+0000","last_clean":"2024-04-23T18:22:38.520391+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:22:38.520391+0000","last_undegraded":"2024-04-23T18:22:38.520391+0000","last_fullsized":"2024-04-23T18:22:38.520391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399129+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:22:38.399129+0000","last_peered":"2024-04-23T18:22:38.399129+0000","last_clean":"2024-04-23T18:22:38.399129+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:22:38.399129+0000","last_undegraded":"2024-04-23T18:22:38.399129+0000","last_fullsized":"2024-04-23T18:22:38.399129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395366+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:22:38.395366+0000","last_peered":"2024-04-23T18:22:38.395366+0000","last_clean":"2024-04-23T18:22:38.395366+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:22:38.395366+0000","last_undegraded":"2024-04-23T18:22:38.395366+0000","last_fullsized":"2024-04-23T18:22:38.395366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.502651+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:23:00.502651+0000","last_peered":"2024-04-23T18:23:00.502651+0000","last_clean":"2024-04-23T18:23:00.502651+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:23:00.502651+0000","last_undegraded":"2024-04-23T18:23:00.502651+0000","last_fullsized":"2024-04-23T18:23:00.502651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400086+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:22:38.400086+0000","last_peered":"2024-04-23T18:22:38.400086+0000","last_clean":"2024-04-23T18:22:38.400086+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:22:38.400086+0000","last_undegraded":"2024-04-23T18:22:38.400086+0000","last_fullsized":"2024-04-23T18:22:38.400086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511999+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:22:38.511999+0000","last_peered":"2024-04-23T18:22:38.511999+0000","last_clean":"2024-04-23T18:22:38.511999+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:22:38.511999+0000","last_undegraded":"2024-04-23T18:22:38.511999+0000","last_fullsized":"2024-04-23T18:22:38.511999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772083+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:22:38.772083+0000","last_peered":"2024-04-23T18:22:38.772083+0000","last_clean":"2024-04-23T18:22:38.772083+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:22:38.772083+0000","last_undegraded":"2024-04-23T18:22:38.772083+0000","last_fullsized":"2024-04-23T18:22:38.772083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399812+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:22:38.399812+0000","last_peered":"2024-04-23T18:22:38.399812+0000","last_clean":"2024-04-23T18:22:38.399812+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:22:38.399812+0000","last_undegraded":"2024-04-23T18:22:38.399812+0000","last_fullsized":"2024-04-23T18:22:38.399812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511898+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:22:38.511898+0000","last_peered":"2024-04-23T18:22:38.511898+0000","last_clean":"2024-04-23T18:22:38.511898+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:22:38.511898+0000","last_undegraded":"2024-04-23T18:22:38.511898+0000","last_fullsized":"2024-04-23T18:22:38.511898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.512259+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:23:00.512259+0000","last_peered":"2024-04-23T18:23:00.512259+0000","last_clean":"2024-04-23T18:23:00.512259+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:23:00.512259+0000","last_undegraded":"2024-04-23T18:23:00.512259+0000","last_fullsized":"2024-04-23T18:23:00.512259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772456+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:22:38.772456+0000","last_peered":"2024-04-23T18:22:38.772456+0000","last_clean":"2024-04-23T18:22:38.772456+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:22:38.772456+0000","last_undegraded":"2024-04-23T18:22:38.772456+0000","last_fullsized":"2024-04-23T18:22:38.772456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399139+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:22:38.399139+0000","last_peered":"2024-04-23T18:22:38.399139+0000","last_clean":"2024-04-23T18:22:38.399139+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:22:38.399139+0000","last_undegraded":"2024-04-23T18:22:38.399139+0000","last_fullsized":"2024-04-23T18:22:38.399139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.505258+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:23:00.505258+0000","last_peered":"2024-04-23T18:23:00.505258+0000","last_clean":"2024-04-23T18:23:00.505258+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:23:00.505258+0000","last_undegraded":"2024-04-23T18:23:00.505258+0000","last_fullsized":"2024-04-23T18:23:00.505258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400185+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:22:38.400185+0000","last_peered":"2024-04-23T18:22:38.400185+0000","last_clean":"2024-04-23T18:22:38.400185+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:22:38.400185+0000","last_undegraded":"2024-04-23T18:22:38.400185+0000","last_fullsized":"2024-04-23T18:22:38.400185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876309+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:22:38.876309+0000","last_peered":"2024-04-23T18:22:38.876309+0000","last_clean":"2024-04-23T18:22:38.876309+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:22:38.876309+0000","last_undegraded":"2024-04-23T18:22:38.876309+0000","last_fullsized":"2024-04-23T18:22:38.876309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.502371+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:23:00.502371+0000","last_peered":"2024-04-23T18:23:00.502371+0000","last_clean":"2024-04-23T18:23:00.502371+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:23:00.502371+0000","last_undegraded":"2024-04-23T18:23:00.502371+0000","last_fullsized":"2024-04-23T18:23:00.502371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399544+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:22:38.399544+0000","last_peered":"2024-04-23T18:22:38.399544+0000","last_clean":"2024-04-23T18:22:38.399544+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:22:38.399544+0000","last_undegraded":"2024-04-23T18:22:38.399544+0000","last_fullsized":"2024-04-23T18:22:38.399544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512524+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:22:38.512524+0000","last_peered":"2024-04-23T18:22:38.512524+0000","last_clean":"2024-04-23T18:22:38.512524+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:22:38.512524+0000","last_undegraded":"2024-04-23T18:22:38.512524+0000","last_fullsized":"2024-04-23T18:22:38.512524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772582+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:22:38.772582+0000","last_peered":"2024-04-23T18:22:38.772582+0000","last_clean":"2024-04-23T18:22:38.772582+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:22:38.772582+0000","last_undegraded":"2024-04-23T18:22:38.772582+0000","last_fullsized":"2024-04-23T18:22:38.772582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511607+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:22:38.511607+0000","last_peered":"2024-04-23T18:22:38.511607+0000","last_clean":"2024-04-23T18:22:38.511607+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:22:38.511607+0000","last_undegraded":"2024-04-23T18:22:38.511607+0000","last_fullsized":"2024-04-23T18:22:38.511607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772268+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:22:38.772268+0000","last_peered":"2024-04-23T18:22:38.772268+0000","last_clean":"2024-04-23T18:22:38.772268+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:22:38.772268+0000","last_undegraded":"2024-04-23T18:22:38.772268+0000","last_fullsized":"2024-04-23T18:22:38.772268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877746+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:22:38.877746+0000","last_peered":"2024-04-23T18:22:38.877746+0000","last_clean":"2024-04-23T18:22:38.877746+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:22:38.877746+0000","last_undegraded":"2024-04-23T18:22:38.877746+0000","last_fullsized":"2024-04-23T18:22:38.877746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875996+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:22:38.875996+0000","last_peered":"2024-04-23T18:22:38.875996+0000","last_clean":"2024-04-23T18:22:38.875996+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:22:38.875996+0000","last_undegraded":"2024-04-23T18:22:38.875996+0000","last_fullsized":"2024-04-23T18:22:38.875996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520638+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:22:38.520638+0000","last_peered":"2024-04-23T18:22:38.520638+0000","last_clean":"2024-04-23T18:22:38.520638+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:22:38.520638+0000","last_undegraded":"2024-04-23T18:22:38.520638+0000","last_fullsized":"2024-04-23T18:22:38.520638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772367+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:22:38.772367+0000","last_peered":"2024-04-23T18:22:38.772367+0000","last_clean":"2024-04-23T18:22:38.772367+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:22:38.772367+0000","last_undegraded":"2024-04-23T18:22:38.772367+0000","last_fullsized":"2024-04-23T18:22:38.772367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771877+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:22:38.771877+0000","last_peered":"2024-04-23T18:22:38.771877+0000","last_clean":"2024-04-23T18:22:38.771877+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:22:38.771877+0000","last_undegraded":"2024-04-23T18:22:38.771877+0000","last_fullsized":"2024-04-23T18:22:38.771877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399411+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:22:38.399411+0000","last_peered":"2024-04-23T18:22:38.399411+0000","last_clean":"2024-04-23T18:22:38.399411+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:22:38.399411+0000","last_undegraded":"2024-04-23T18:22:38.399411+0000","last_fullsized":"2024-04-23T18:22:38.399411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520001+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:22:38.520001+0000","last_peered":"2024-04-23T18:22:38.520001+0000","last_clean":"2024-04-23T18:22:38.520001+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:22:38.520001+0000","last_undegraded":"2024-04-23T18:22:38.520001+0000","last_fullsized":"2024-04-23T18:22:38.520001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772519+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:22:38.772519+0000","last_peered":"2024-04-23T18:22:38.772519+0000","last_clean":"2024-04-23T18:22:38.772519+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:22:38.772519+0000","last_undegraded":"2024-04-23T18:22:38.772519+0000","last_fullsized":"2024-04-23T18:22:38.772519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771764+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:22:38.771764+0000","last_peered":"2024-04-23T18:22:38.771764+0000","last_clean":"2024-04-23T18:22:38.771764+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:22:38.771764+0000","last_undegraded":"2024-04-23T18:22:38.771764+0000","last_fullsized":"2024-04-23T18:22:38.771764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394033+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:22:38.394033+0000","last_peered":"2024-04-23T18:22:38.394033+0000","last_clean":"2024-04-23T18:22:38.394033+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:22:38.394033+0000","last_undegraded":"2024-04-23T18:22:38.394033+0000","last_fullsized":"2024-04-23T18:22:38.394033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772489+0000","last_change":"2024-04-23T18:22:37.434423+0000","last_active":"2024-04-23T18:22:38.772489+0000","last_peered":"2024-04-23T18:22:38.772489+0000","last_clean":"2024-04-23T18:22:38.772489+0000","last_became_active":"2024-04-23T18:22:37.434030+0000","last_became_peered":"2024-04-23T18:22:37.434030+0000","last_unstale":"2024-04-23T18:22:38.772489+0000","last_undegraded":"2024-04-23T18:22:38.772489+0000","last_fullsized":"2024-04-23T18:22:38.772489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:38:05.642960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875593+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:22:38.875593+0000","last_peered":"2024-04-23T18:22:38.875593+0000","last_clean":"2024-04-23T18:22:38.875593+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:22:38.875593+0000","last_undegraded":"2024-04-23T18:22:38.875593+0000","last_fullsized":"2024-04-23T18:22:38.875593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876395+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:22:38.876395+0000","last_peered":"2024-04-23T18:22:38.876395+0000","last_clean":"2024-04-23T18:22:38.876395+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:22:38.876395+0000","last_undegraded":"2024-04-23T18:22:38.876395+0000","last_fullsized":"2024-04-23T18:22:38.876395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876336+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:22:38.876336+0000","last_peered":"2024-04-23T18:22:38.876336+0000","last_clean":"2024-04-23T18:22:38.876336+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:22:38.876336+0000","last_undegraded":"2024-04-23T18:22:38.876336+0000","last_fullsized":"2024-04-23T18:22:38.876336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511913+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:22:38.511913+0000","last_peered":"2024-04-23T18:22:38.511913+0000","last_clean":"2024-04-23T18:22:38.511913+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:22:38.511913+0000","last_undegraded":"2024-04-23T18:22:38.511913+0000","last_fullsized":"2024-04-23T18:22:38.511913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.506210+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:23:00.506210+0000","last_peered":"2024-04-23T18:23:00.506210+0000","last_clean":"2024-04-23T18:23:00.506210+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:23:00.506210+0000","last_undegraded":"2024-04-23T18:23:00.506210+0000","last_fullsized":"2024-04-23T18:23:00.506210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876556+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:22:38.876556+0000","last_peered":"2024-04-23T18:22:38.876556+0000","last_clean":"2024-04-23T18:22:38.876556+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:22:38.876556+0000","last_undegraded":"2024-04-23T18:22:38.876556+0000","last_fullsized":"2024-04-23T18:22:38.876556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396052+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:22:38.396052+0000","last_peered":"2024-04-23T18:22:38.396052+0000","last_clean":"2024-04-23T18:22:38.396052+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:22:38.396052+0000","last_undegraded":"2024-04-23T18:22:38.396052+0000","last_fullsized":"2024-04-23T18:22:38.396052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877306+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:22:38.877306+0000","last_peered":"2024-04-23T18:22:38.877306+0000","last_clean":"2024-04-23T18:22:38.877306+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:22:38.877306+0000","last_undegraded":"2024-04-23T18:22:38.877306+0000","last_fullsized":"2024-04-23T18:22:38.877306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394450+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:22:38.394450+0000","last_peered":"2024-04-23T18:22:38.394450+0000","last_clean":"2024-04-23T18:22:38.394450+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:22:38.394450+0000","last_undegraded":"2024-04-23T18:22:38.394450+0000","last_fullsized":"2024-04-23T18:22:38.394450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395296+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:22:38.395296+0000","last_peered":"2024-04-23T18:22:38.395296+0000","last_clean":"2024-04-23T18:22:38.395296+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:22:38.395296+0000","last_undegraded":"2024-04-23T18:22:38.395296+0000","last_fullsized":"2024-04-23T18:22:38.395296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520463+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:22:38.520463+0000","last_peered":"2024-04-23T18:22:38.520463+0000","last_clean":"2024-04-23T18:22:38.520463+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:22:38.520463+0000","last_undegraded":"2024-04-23T18:22:38.520463+0000","last_fullsized":"2024-04-23T18:22:38.520463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772482+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:22:38.772482+0000","last_peered":"2024-04-23T18:22:38.772482+0000","last_clean":"2024-04-23T18:22:38.772482+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:22:38.772482+0000","last_undegraded":"2024-04-23T18:22:38.772482+0000","last_fullsized":"2024-04-23T18:22:38.772482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876108+0000","last_change":"2024-04-23T18:22:37.422351+0000","last_active":"2024-04-23T18:22:38.876108+0000","last_peered":"2024-04-23T18:22:38.876108+0000","last_clean":"2024-04-23T18:22:38.876108+0000","last_became_active":"2024-04-23T18:22:37.421745+0000","last_became_peered":"2024-04-23T18:22:37.421745+0000","last_unstale":"2024-04-23T18:22:38.876108+0000","last_undegraded":"2024-04-23T18:22:38.876108+0000","last_fullsized":"2024-04-23T18:22:38.876108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:43.074101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.878109+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:22:38.878109+0000","last_peered":"2024-04-23T18:22:38.878109+0000","last_clean":"2024-04-23T18:22:38.878109+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:22:38.878109+0000","last_undegraded":"2024-04-23T18:22:38.878109+0000","last_fullsized":"2024-04-23T18:22:38.878109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394651+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:22:38.394651+0000","last_peered":"2024-04-23T18:22:38.394651+0000","last_clean":"2024-04-23T18:22:38.394651+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:22:38.394651+0000","last_undegraded":"2024-04-23T18:22:38.394651+0000","last_fullsized":"2024-04-23T18:22:38.394651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519385+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:22:38.519385+0000","last_peered":"2024-04-23T18:22:38.519385+0000","last_clean":"2024-04-23T18:22:38.519385+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:22:38.519385+0000","last_undegraded":"2024-04-23T18:22:38.519385+0000","last_fullsized":"2024-04-23T18:22:38.519385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877267+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:22:38.877267+0000","last_peered":"2024-04-23T18:22:38.877267+0000","last_clean":"2024-04-23T18:22:38.877267+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:22:38.877267+0000","last_undegraded":"2024-04-23T18:22:38.877267+0000","last_fullsized":"2024-04-23T18:22:38.877267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.400190+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:22:38.400190+0000","last_peered":"2024-04-23T18:22:38.400190+0000","last_clean":"2024-04-23T18:22:38.400190+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:22:38.400190+0000","last_undegraded":"2024-04-23T18:22:38.400190+0000","last_fullsized":"2024-04-23T18:22:38.400190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398668+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:22:38.398668+0000","last_peered":"2024-04-23T18:22:38.398668+0000","last_clean":"2024-04-23T18:22:38.398668+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:22:38.398668+0000","last_undegraded":"2024-04-23T18:22:38.398668+0000","last_fullsized":"2024-04-23T18:22:38.398668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876669+0000","last_change":"2024-04-23T18:22:33.407067+0000","last_active":"2024-04-23T18:22:38.876669+0000","last_peered":"2024-04-23T18:22:38.876669+0000","last_clean":"2024-04-23T18:22:38.876669+0000","last_became_active":"2024-04-23T18:22:33.406727+0000","last_became_peered":"2024-04-23T18:22:33.406727+0000","last_unstale":"2024-04-23T18:22:38.876669+0000","last_undegraded":"2024-04-23T18:22:38.876669+0000","last_fullsized":"2024-04-23T18:22:38.876669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:21:04.444047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.510349+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:23:00.510349+0000","last_peered":"2024-04-23T18:23:00.510349+0000","last_clean":"2024-04-23T18:23:00.510349+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:23:00.510349+0000","last_undegraded":"2024-04-23T18:23:00.510349+0000","last_fullsized":"2024-04-23T18:23:00.510349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876191+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:22:38.876191+0000","last_peered":"2024-04-23T18:22:38.876191+0000","last_clean":"2024-04-23T18:22:38.876191+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:22:38.876191+0000","last_undegraded":"2024-04-23T18:22:38.876191+0000","last_fullsized":"2024-04-23T18:22:38.876191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395264+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:22:38.395264+0000","last_peered":"2024-04-23T18:22:38.395264+0000","last_clean":"2024-04-23T18:22:38.395264+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:22:38.395264+0000","last_undegraded":"2024-04-23T18:22:38.395264+0000","last_fullsized":"2024-04-23T18:22:38.395264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395402+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:22:38.395402+0000","last_peered":"2024-04-23T18:22:38.395402+0000","last_clean":"2024-04-23T18:22:38.395402+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:22:38.395402+0000","last_undegraded":"2024-04-23T18:22:38.395402+0000","last_fullsized":"2024-04-23T18:22:38.395402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512523+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:22:38.512523+0000","last_peered":"2024-04-23T18:22:38.512523+0000","last_clean":"2024-04-23T18:22:38.512523+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:22:38.512523+0000","last_undegraded":"2024-04-23T18:22:38.512523+0000","last_fullsized":"2024-04-23T18:22:38.512523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877129+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:22:38.877129+0000","last_peered":"2024-04-23T18:22:38.877129+0000","last_clean":"2024-04-23T18:22:38.877129+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:22:38.877129+0000","last_undegraded":"2024-04-23T18:22:38.877129+0000","last_fullsized":"2024-04-23T18:22:38.877129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.511072+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:23:00.511072+0000","last_peered":"2024-04-23T18:23:00.511072+0000","last_clean":"2024-04-23T18:23:00.511072+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:23:00.511072+0000","last_undegraded":"2024-04-23T18:23:00.511072+0000","last_fullsized":"2024-04-23T18:23:00.511072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512108+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:22:38.512108+0000","last_peered":"2024-04-23T18:22:38.512108+0000","last_clean":"2024-04-23T18:22:38.512108+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:22:38.512108+0000","last_undegraded":"2024-04-23T18:22:38.512108+0000","last_fullsized":"2024-04-23T18:22:38.512108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875754+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:22:38.875754+0000","last_peered":"2024-04-23T18:22:38.875754+0000","last_clean":"2024-04-23T18:22:38.875754+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:22:38.875754+0000","last_undegraded":"2024-04-23T18:22:38.875754+0000","last_fullsized":"2024-04-23T18:22:38.875754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.499797+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:23:00.499797+0000","last_peered":"2024-04-23T18:23:00.499797+0000","last_clean":"2024-04-23T18:23:00.499797+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:23:00.499797+0000","last_undegraded":"2024-04-23T18:23:00.499797+0000","last_fullsized":"2024-04-23T18:23:00.499797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520575+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:22:38.520575+0000","last_peered":"2024-04-23T18:22:38.520575+0000","last_clean":"2024-04-23T18:22:38.520575+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:22:38.520575+0000","last_undegraded":"2024-04-23T18:22:38.520575+0000","last_fullsized":"2024-04-23T18:22:38.520575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877083+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:22:38.877083+0000","last_peered":"2024-04-23T18:22:38.877083+0000","last_clean":"2024-04-23T18:22:38.877083+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:22:38.877083+0000","last_undegraded":"2024-04-23T18:22:38.877083+0000","last_fullsized":"2024-04-23T18:22:38.877083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.510932+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:23:00.510932+0000","last_peered":"2024-04-23T18:23:00.510932+0000","last_clean":"2024-04-23T18:23:00.510932+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:23:00.510932+0000","last_undegraded":"2024-04-23T18:23:00.510932+0000","last_fullsized":"2024-04-23T18:23:00.510932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772018+0000","last_change":"2024-04-23T18:22:37.423270+0000","last_active":"2024-04-23T18:22:38.772018+0000","last_peered":"2024-04-23T18:22:38.772018+0000","last_clean":"2024-04-23T18:22:38.772018+0000","last_became_active":"2024-04-23T18:22:37.422847+0000","last_became_peered":"2024-04-23T18:22:37.422847+0000","last_unstale":"2024-04-23T18:22:38.772018+0000","last_undegraded":"2024-04-23T18:22:38.772018+0000","last_fullsized":"2024-04-23T18:22:38.772018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:42.248011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399891+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:22:38.399891+0000","last_peered":"2024-04-23T18:22:38.399891+0000","last_clean":"2024-04-23T18:22:38.399891+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:22:38.399891+0000","last_undegraded":"2024-04-23T18:22:38.399891+0000","last_fullsized":"2024-04-23T18:22:38.399891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772425+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:22:38.772425+0000","last_peered":"2024-04-23T18:22:38.772425+0000","last_clean":"2024-04-23T18:22:38.772425+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:22:38.772425+0000","last_undegraded":"2024-04-23T18:22:38.772425+0000","last_fullsized":"2024-04-23T18:22:38.772425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399340+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:22:38.399340+0000","last_peered":"2024-04-23T18:22:38.399340+0000","last_clean":"2024-04-23T18:22:38.399340+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:22:38.399340+0000","last_undegraded":"2024-04-23T18:22:38.399340+0000","last_fullsized":"2024-04-23T18:22:38.399340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876364+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:22:38.876364+0000","last_peered":"2024-04-23T18:22:38.876364+0000","last_clean":"2024-04-23T18:22:38.876364+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:22:38.876364+0000","last_undegraded":"2024-04-23T18:22:38.876364+0000","last_fullsized":"2024-04-23T18:22:38.876364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.503962+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:23:00.503962+0000","last_peered":"2024-04-23T18:23:00.503962+0000","last_clean":"2024-04-23T18:23:00.503962+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:23:00.503962+0000","last_undegraded":"2024-04-23T18:23:00.503962+0000","last_fullsized":"2024-04-23T18:23:00.503962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511802+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:22:38.511802+0000","last_peered":"2024-04-23T18:22:38.511802+0000","last_clean":"2024-04-23T18:22:38.511802+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:22:38.511802+0000","last_undegraded":"2024-04-23T18:22:38.511802+0000","last_fullsized":"2024-04-23T18:22:38.511802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520447+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:22:38.520447+0000","last_peered":"2024-04-23T18:22:38.520447+0000","last_clean":"2024-04-23T18:22:38.520447+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:22:38.520447+0000","last_undegraded":"2024-04-23T18:22:38.520447+0000","last_fullsized":"2024-04-23T18:22:38.520447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.505519+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:23:00.505519+0000","last_peered":"2024-04-23T18:23:00.505519+0000","last_clean":"2024-04-23T18:23:00.505519+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:23:00.505519+0000","last_undegraded":"2024-04-23T18:23:00.505519+0000","last_fullsized":"2024-04-23T18:23:00.505519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511805+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:22:38.511805+0000","last_peered":"2024-04-23T18:22:38.511805+0000","last_clean":"2024-04-23T18:22:38.511805+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:22:38.511805+0000","last_undegraded":"2024-04-23T18:22:38.511805+0000","last_fullsized":"2024-04-23T18:22:38.511805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876162+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:22:38.876162+0000","last_peered":"2024-04-23T18:22:38.876162+0000","last_clean":"2024-04-23T18:22:38.876162+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:22:38.876162+0000","last_undegraded":"2024-04-23T18:22:38.876162+0000","last_fullsized":"2024-04-23T18:22:38.876162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771668+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:22:38.771668+0000","last_peered":"2024-04-23T18:22:38.771668+0000","last_clean":"2024-04-23T18:22:38.771668+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:22:38.771668+0000","last_undegraded":"2024-04-23T18:22:38.771668+0000","last_fullsized":"2024-04-23T18:22:38.771668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519727+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:22:38.519727+0000","last_peered":"2024-04-23T18:22:38.519727+0000","last_clean":"2024-04-23T18:22:38.519727+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:22:38.519727+0000","last_undegraded":"2024-04-23T18:22:38.519727+0000","last_fullsized":"2024-04-23T18:22:38.519727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396141+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:22:38.396141+0000","last_peered":"2024-04-23T18:22:38.396141+0000","last_clean":"2024-04-23T18:22:38.396141+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:22:38.396141+0000","last_undegraded":"2024-04-23T18:22:38.396141+0000","last_fullsized":"2024-04-23T18:22:38.396141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511775+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:22:38.511775+0000","last_peered":"2024-04-23T18:22:38.511775+0000","last_clean":"2024-04-23T18:22:38.511775+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:22:38.511775+0000","last_undegraded":"2024-04-23T18:22:38.511775+0000","last_fullsized":"2024-04-23T18:22:38.511775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511945+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:22:38.511945+0000","last_peered":"2024-04-23T18:22:38.511945+0000","last_clean":"2024-04-23T18:22:38.511945+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:22:38.511945+0000","last_undegraded":"2024-04-23T18:22:38.511945+0000","last_fullsized":"2024-04-23T18:22:38.511945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395587+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:22:38.395587+0000","last_peered":"2024-04-23T18:22:38.395587+0000","last_clean":"2024-04-23T18:22:38.395587+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:22:38.395587+0000","last_undegraded":"2024-04-23T18:22:38.395587+0000","last_fullsized":"2024-04-23T18:22:38.395587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876159+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:22:38.876159+0000","last_peered":"2024-04-23T18:22:38.876159+0000","last_clean":"2024-04-23T18:22:38.876159+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:22:38.876159+0000","last_undegraded":"2024-04-23T18:22:38.876159+0000","last_fullsized":"2024-04-23T18:22:38.876159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394359+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:22:38.394359+0000","last_peered":"2024-04-23T18:22:38.394359+0000","last_clean":"2024-04-23T18:22:38.394359+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:22:38.394359+0000","last_undegraded":"2024-04-23T18:22:38.394359+0000","last_fullsized":"2024-04-23T18:22:38.394359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:23:00.511922+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:23:00.511922+0000","last_peered":"2024-04-23T18:23:00.511922+0000","last_clean":"2024-04-23T18:23:00.511922+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:23:00.511922+0000","last_undegraded":"2024-04-23T18:23:00.511922+0000","last_fullsized":"2024-04-23T18:23:00.511922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.398922+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:22:38.398922+0000","last_peered":"2024-04-23T18:22:38.398922+0000","last_clean":"2024-04-23T18:22:38.398922+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:22:38.398922+0000","last_undegraded":"2024-04-23T18:22:38.398922+0000","last_fullsized":"2024-04-23T18:22:38.398922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512357+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:22:38.512357+0000","last_peered":"2024-04-23T18:22:38.512357+0000","last_clean":"2024-04-23T18:22:38.512357+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:22:38.512357+0000","last_undegraded":"2024-04-23T18:22:38.512357+0000","last_fullsized":"2024-04-23T18:22:38.512357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395074+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:22:38.395074+0000","last_peered":"2024-04-23T18:22:38.395074+0000","last_clean":"2024-04-23T18:22:38.395074+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:22:38.395074+0000","last_undegraded":"2024-04-23T18:22:38.395074+0000","last_fullsized":"2024-04-23T18:22:38.395074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.393976+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:22:38.393976+0000","last_peered":"2024-04-23T18:22:38.393976+0000","last_clean":"2024-04-23T18:22:38.393976+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:22:38.393976+0000","last_undegraded":"2024-04-23T18:22:38.393976+0000","last_fullsized":"2024-04-23T18:22:38.393976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519749+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:22:38.519749+0000","last_peered":"2024-04-23T18:22:38.519749+0000","last_clean":"2024-04-23T18:22:38.519749+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:22:38.519749+0000","last_undegraded":"2024-04-23T18:22:38.519749+0000","last_fullsized":"2024-04-23T18:22:38.519749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876029+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:22:38.876029+0000","last_peered":"2024-04-23T18:22:38.876029+0000","last_clean":"2024-04-23T18:22:38.876029+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:22:38.876029+0000","last_undegraded":"2024-04-23T18:22:38.876029+0000","last_fullsized":"2024-04-23T18:22:38.876029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512257+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:22:38.512257+0000","last_peered":"2024-04-23T18:22:38.512257+0000","last_clean":"2024-04-23T18:22:38.512257+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:22:38.512257+0000","last_undegraded":"2024-04-23T18:22:38.512257+0000","last_fullsized":"2024-04-23T18:22:38.512257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772250+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:22:38.772250+0000","last_peered":"2024-04-23T18:22:38.772250+0000","last_clean":"2024-04-23T18:22:38.772250+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:22:38.772250+0000","last_undegraded":"2024-04-23T18:22:38.772250+0000","last_fullsized":"2024-04-23T18:22:38.772250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396520+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:22:38.396520+0000","last_peered":"2024-04-23T18:22:38.396520+0000","last_clean":"2024-04-23T18:22:38.396520+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:22:38.396520+0000","last_undegraded":"2024-04-23T18:22:38.396520+0000","last_fullsized":"2024-04-23T18:22:38.396520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512421+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:22:38.512421+0000","last_peered":"2024-04-23T18:22:38.512421+0000","last_clean":"2024-04-23T18:22:38.512421+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:22:38.512421+0000","last_undegraded":"2024-04-23T18:22:38.512421+0000","last_fullsized":"2024-04-23T18:22:38.512421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519528+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:22:38.519528+0000","last_peered":"2024-04-23T18:22:38.519528+0000","last_clean":"2024-04-23T18:22:38.519528+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:22:38.519528+0000","last_undegraded":"2024-04-23T18:22:38.519528+0000","last_fullsized":"2024-04-23T18:22:38.519528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.512054+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:22:38.512054+0000","last_peered":"2024-04-23T18:22:38.512054+0000","last_clean":"2024-04-23T18:22:38.512054+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:22:38.512054+0000","last_undegraded":"2024-04-23T18:22:38.512054+0000","last_fullsized":"2024-04-23T18:22:38.512054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519675+0000","last_change":"2024-04-23T18:22:33.397675+0000","last_active":"2024-04-23T18:22:38.519675+0000","last_peered":"2024-04-23T18:22:38.519675+0000","last_clean":"2024-04-23T18:22:38.519675+0000","last_became_active":"2024-04-23T18:22:33.396752+0000","last_became_peered":"2024-04-23T18:22:33.396752+0000","last_unstale":"2024-04-23T18:22:38.519675+0000","last_undegraded":"2024-04-23T18:22:38.519675+0000","last_fullsized":"2024-04-23T18:22:38.519675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:26.022097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875901+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:22:38.875901+0000","last_peered":"2024-04-23T18:22:38.875901+0000","last_clean":"2024-04-23T18:22:38.875901+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:22:38.875901+0000","last_undegraded":"2024-04-23T18:22:38.875901+0000","last_fullsized":"2024-04-23T18:22:38.875901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.395896+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:22:38.395896+0000","last_peered":"2024-04-23T18:22:38.395896+0000","last_clean":"2024-04-23T18:22:38.395896+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:22:38.395896+0000","last_undegraded":"2024-04-23T18:22:38.395896+0000","last_fullsized":"2024-04-23T18:22:38.395896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877641+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:22:38.877641+0000","last_peered":"2024-04-23T18:22:38.877641+0000","last_clean":"2024-04-23T18:22:38.877641+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:22:38.877641+0000","last_undegraded":"2024-04-23T18:22:38.877641+0000","last_fullsized":"2024-04-23T18:22:38.877641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.394629+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:22:38.394629+0000","last_peered":"2024-04-23T18:22:38.394629+0000","last_clean":"2024-04-23T18:22:38.394629+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:22:38.394629+0000","last_undegraded":"2024-04-23T18:22:38.394629+0000","last_fullsized":"2024-04-23T18:22:38.394629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.521048+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:22:38.521048+0000","last_peered":"2024-04-23T18:22:38.521048+0000","last_clean":"2024-04-23T18:22:38.521048+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:22:38.521048+0000","last_undegraded":"2024-04-23T18:22:38.521048+0000","last_fullsized":"2024-04-23T18:22:38.521048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519224+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:22:38.519224+0000","last_peered":"2024-04-23T18:22:38.519224+0000","last_clean":"2024-04-23T18:22:38.519224+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:22:38.519224+0000","last_undegraded":"2024-04-23T18:22:38.519224+0000","last_fullsized":"2024-04-23T18:22:38.519224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.771738+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:22:38.771738+0000","last_peered":"2024-04-23T18:22:38.771738+0000","last_clean":"2024-04-23T18:22:38.771738+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:22:38.771738+0000","last_undegraded":"2024-04-23T18:22:38.771738+0000","last_fullsized":"2024-04-23T18:22:38.771738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.875743+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:22:38.875743+0000","last_peered":"2024-04-23T18:22:38.875743+0000","last_clean":"2024-04-23T18:22:38.875743+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:22:38.875743+0000","last_undegraded":"2024-04-23T18:22:38.875743+0000","last_fullsized":"2024-04-23T18:22:38.875743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511902+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:22:38.511902+0000","last_peered":"2024-04-23T18:22:38.511902+0000","last_clean":"2024-04-23T18:22:38.511902+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:22:38.511902+0000","last_undegraded":"2024-04-23T18:22:38.511902+0000","last_fullsized":"2024-04-23T18:22:38.511902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.399785+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:22:38.399785+0000","last_peered":"2024-04-23T18:22:38.399785+0000","last_clean":"2024-04-23T18:22:38.399785+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:22:38.399785+0000","last_undegraded":"2024-04-23T18:22:38.399785+0000","last_fullsized":"2024-04-23T18:22:38.399785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396466+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:22:38.396466+0000","last_peered":"2024-04-23T18:22:38.396466+0000","last_clean":"2024-04-23T18:22:38.396466+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:22:38.396466+0000","last_undegraded":"2024-04-23T18:22:38.396466+0000","last_fullsized":"2024-04-23T18:22:38.396466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.396387+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:22:38.396387+0000","last_peered":"2024-04-23T18:22:38.396387+0000","last_clean":"2024-04-23T18:22:38.396387+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:22:38.396387+0000","last_undegraded":"2024-04-23T18:22:38.396387+0000","last_fullsized":"2024-04-23T18:22:38.396387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.878029+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:22:38.878029+0000","last_peered":"2024-04-23T18:22:38.878029+0000","last_clean":"2024-04-23T18:22:38.878029+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:22:38.878029+0000","last_undegraded":"2024-04-23T18:22:38.878029+0000","last_fullsized":"2024-04-23T18:22:38.878029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.511665+0000","last_change":"2024-04-23T18:22:33.397779+0000","last_active":"2024-04-23T18:22:38.511665+0000","last_peered":"2024-04-23T18:22:38.511665+0000","last_clean":"2024-04-23T18:22:38.511665+0000","last_became_active":"2024-04-23T18:22:33.397476+0000","last_became_peered":"2024-04-23T18:22:33.397476+0000","last_unstale":"2024-04-23T18:22:38.511665+0000","last_undegraded":"2024-04-23T18:22:38.511665+0000","last_fullsized":"2024-04-23T18:22:38.511665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:07.442252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876554+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:22:38.876554+0000","last_peered":"2024-04-23T18:22:38.876554+0000","last_clean":"2024-04-23T18:22:38.876554+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:22:38.876554+0000","last_undegraded":"2024-04-23T18:22:38.876554+0000","last_fullsized":"2024-04-23T18:22:38.876554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.519455+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:22:38.519455+0000","last_peered":"2024-04-23T18:22:38.519455+0000","last_clean":"2024-04-23T18:22:38.519455+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:22:38.519455+0000","last_undegraded":"2024-04-23T18:22:38.519455+0000","last_fullsized":"2024-04-23T18:22:38.519455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876554+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:22:38.876554+0000","last_peered":"2024-04-23T18:22:38.876554+0000","last_clean":"2024-04-23T18:22:38.876554+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:22:38.876554+0000","last_undegraded":"2024-04-23T18:22:38.876554+0000","last_fullsized":"2024-04-23T18:22:38.876554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.520171+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:22:38.520171+0000","last_peered":"2024-04-23T18:22:38.520171+0000","last_clean":"2024-04-23T18:22:38.520171+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:22:38.520171+0000","last_undegraded":"2024-04-23T18:22:38.520171+0000","last_fullsized":"2024-04-23T18:22:38.520171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.876012+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:22:38.876012+0000","last_peered":"2024-04-23T18:22:38.876012+0000","last_clean":"2024-04-23T18:22:38.876012+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:22:38.876012+0000","last_undegraded":"2024-04-23T18:22:38.876012+0000","last_fullsized":"2024-04-23T18:22:38.876012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.772513+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:22:38.772513+0000","last_peered":"2024-04-23T18:22:38.772513+0000","last_clean":"2024-04-23T18:22:38.772513+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:22:38.772513+0000","last_undegraded":"2024-04-23T18:22:38.772513+0000","last_fullsized":"2024-04-23T18:22:38.772513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T18:22:38.877857+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:22:38.877857+0000","last_peered":"2024-04-23T18:22:38.877857+0000","last_clean":"2024-04-23T18:22:38.877857+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:22:38.877857+0000","last_undegraded":"2024-04-23T18:22:38.877857+0000","last_fullsized":"2024-04-23T18:22:38.877857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:23:03.884 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T18:23:03.885 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-23T18:23:03.885 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-23T18:23:03.885 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T18:23:04.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.072+0000 7f6acca00640 1 Processor -- start 2024-04-23T18:23:04.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.072+0000 7f6acca00640 1 -- start start 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6acca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac8073860 0x7f6ac814f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6acca00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6ac80c8dc0 0x7f6ac814fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6acca00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac80c3ad0 con 0x7f6ac8073480 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6acca00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac80c4a80 con 0x7f6ac80c8dc0 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6acca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac80c3e70 con 0x7f6ac8073860 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6ac7e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6ac80c8dc0 0x7f6ac814fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6ac7e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6ac80c8dc0 0x7f6ac814fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41272/0 (socket says 172.21.15.28:41272) 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6ac7400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6ac8073480 0x7f6ac806ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58676/0 (socket says 172.21.15.28:58676) 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6ac7e00640 1 -- 172.21.15.28:0/1806239338 learned_addr learned my addr 172.21.15.28:0/1806239338 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6abfe00640 1 --2- 172.21.15.28:0/1806239338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac8073860 0x7f6ac814f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6ac7e00640 1 -- 172.21.15.28:0/1806239338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac8073860 msgr2=0x7f6ac814f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:04.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6ac7e00640 1 --2- 172.21.15.28:0/1806239338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac8073860 0x7f6ac814f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6ac7e00640 1 -- 172.21.15.28:0/1806239338 >> v1:172.21.15.28:6789/0 conn(0x7f6ac8073480 legacy=0x7f6ac806ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6ac7e00640 1 -- 172.21.15.28:0/1806239338 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac80c4150 con 0x7f6ac80c8dc0 2024-04-23T18:23:04.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6ac6a00640 1 -- 172.21.15.28:0/1806239338 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1934819486 0 0) 0x7f6ac80c3ad0 con 0x7f6ac8073480 2024-04-23T18:23:04.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.076+0000 7f6abfe00640 1 --2- 172.21.15.28:0/1806239338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac8073860 0x7f6ac814f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:04.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6ac7e00640 1 --2- 172.21.15.28:0/1806239338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ac80c8dc0 0x7f6ac814fcf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009e80 tx=0x7f6ac001f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bf418abdd62bd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:04.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6ac6a00640 1 -- 172.21.15.28:0/1806239338 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac00b4070 con 0x7f6ac80c8dc0 2024-04-23T18:23:04.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6ac6a00640 1 -- 172.21.15.28:0/1806239338 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac00af400 con 0x7f6ac80c8dc0 2024-04-23T18:23:04.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6ac6a00640 1 -- 172.21.15.28:0/1806239338 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac00af7d0 con 0x7f6ac80c8dc0 2024-04-23T18:23:04.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6acca00640 1 -- 172.21.15.28:0/1806239338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ac80c8dc0 msgr2=0x7f6ac814fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6acca00640 1 --2- 172.21.15.28:0/1806239338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ac80c8dc0 0x7f6ac814fcf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009e80 tx=0x7f6ac001f200 comp rx=0 tx=0).stop 2024-04-23T18:23:04.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6acca00640 1 -- 172.21.15.28:0/1806239338 shutdown_connections 2024-04-23T18:23:04.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6acca00640 1 --2- 172.21.15.28:0/1806239338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ac80c8dc0 0x7f6ac814fcf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6acca00640 1 --2- 172.21.15.28:0/1806239338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac8073860 0x7f6ac814f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6acca00640 1 -- 172.21.15.28:0/1806239338 >> 172.21.15.28:0/1806239338 conn(0x7f6ac80676e0 msgr2=0x7f6ac8067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:04.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6acca00640 1 -- 172.21.15.28:0/1806239338 shutdown_connections 2024-04-23T18:23:04.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6acca00640 1 -- 172.21.15.28:0/1806239338 wait complete. 2024-04-23T18:23:04.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6acca00640 1 Processor -- start 2024-04-23T18:23:04.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.080+0000 7f6acca00640 1 -- start start 2024-04-23T18:23:04.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6acca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac8073480 0x7f6ac8148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6acca00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ac8073860 0x7f6ac8146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6acca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac80c8dc0 0x7f6ac8146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6acca00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac806f610 con 0x7f6ac8073860 2024-04-23T18:23:04.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6acca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac80c4710 con 0x7f6ac8073480 2024-04-23T18:23:04.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6acca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac806f940 con 0x7f6ac80c8dc0 2024-04-23T18:23:04.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abfe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ac8073860 0x7f6ac8146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abfe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ac8073860 0x7f6ac8146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41278/0 (socket says 172.21.15.28:41278) 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abfe00640 1 -- 172.21.15.28:0/3568250829 learned_addr learned my addr 172.21.15.28:0/3568250829 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6ac7400640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac8073480 0x7f6ac8148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6ac7e00640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac80c8dc0 0x7f6ac8146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abfe00640 1 -- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac80c8dc0 msgr2=0x7f6ac8146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abfe00640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac80c8dc0 0x7f6ac8146bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abfe00640 1 -- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac8073480 msgr2=0x7f6ac8148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abfe00640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac8073480 0x7f6ac8148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abfe00640 1 -- 172.21.15.28:0/3568250829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac81f5410 con 0x7f6ac8073860 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abfe00640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ac8073860 0x7f6ac8146690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e7e0 tx=0x7f6ab000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abf400640 1 -- 172.21.15.28:0/3568250829 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0017070 con 0x7f6ac8073860 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abf400640 1 -- 172.21.15.28:0/3568250829 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab000c670 con 0x7f6ac8073860 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abf400640 1 -- 172.21.15.28:0/3568250829 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000f040 con 0x7f6ac8073860 2024-04-23T18:23:04.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6acca00640 1 -- 172.21.15.28:0/3568250829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac81455f0 con 0x7f6ac8073860 2024-04-23T18:23:04.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6acca00640 1 -- 172.21.15.28:0/3568250829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac8145bb0 con 0x7f6ac8073860 2024-04-23T18:23:04.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6acca00640 1 -- 172.21.15.28:0/3568250829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac8074290 con 0x7f6ac8073860 2024-04-23T18:23:04.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.084+0000 7f6abf400640 1 -- 172.21.15.28:0/3568250829 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6ab001a070 con 0x7f6ac8073860 2024-04-23T18:23:04.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.088+0000 7f6abf400640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6aa4068380 0x7f6aa406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.088+0000 7f6abf400640 1 -- 172.21.15.28:0/3568250829 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6ab0086880 con 0x7f6ac8073860 2024-04-23T18:23:04.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.088+0000 7f6ac7400640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6aa4068380 0x7f6aa406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.088+0000 7f6ac7400640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6aa4068380 0x7f6aa406a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8007fd0 tx=0x7f6ab8007d60 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:04.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.092+0000 7f6abf400640 1 -- 172.21.15.28:0/3568250829 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6ab0056410 con 0x7f6ac8073860 2024-04-23T18:23:04.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.292+0000 7f6acca00640 1 -- 172.21.15.28:0/3568250829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6ac8150010 con 0x7f6ac8073860 2024-04-23T18:23:04.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.292+0000 7f6abf400640 1 -- 172.21.15.28:0/3568250829 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6ab005a710 con 0x7f6ac8073860 2024-04-23T18:23:04.285 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:04.286 INFO:teuthology.orchestra.run.smithi028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-23T18:23:04.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.292+0000 7f6acca00640 1 -- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6aa4068380 msgr2=0x7f6aa406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.292+0000 7f6acca00640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6aa4068380 0x7f6aa406a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8007fd0 tx=0x7f6ab8007d60 comp rx=0 tx=0).stop 2024-04-23T18:23:04.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.292+0000 7f6acca00640 1 -- 172.21.15.28:0/3568250829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ac8073860 msgr2=0x7f6ac8146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.292+0000 7f6acca00640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ac8073860 0x7f6ac8146690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e7e0 tx=0x7f6ab000eca0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.296+0000 7f6acca00640 1 -- 172.21.15.28:0/3568250829 shutdown_connections 2024-04-23T18:23:04.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.296+0000 7f6acca00640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6aa4068380 0x7f6aa406a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.296+0000 7f6acca00640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6ac80c8dc0 0x7f6ac8146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.296+0000 7f6acca00640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6ac8073860 0x7f6ac8146690 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.296+0000 7f6acca00640 1 --2- 172.21.15.28:0/3568250829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac8073480 0x7f6ac8148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.296+0000 7f6acca00640 1 -- 172.21.15.28:0/3568250829 >> 172.21.15.28:0/3568250829 conn(0x7f6ac80676e0 msgr2=0x7f6ac80c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:04.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.296+0000 7f6acca00640 1 -- 172.21.15.28:0/3568250829 shutdown_connections 2024-04-23T18:23:04.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.296+0000 7f6acca00640 1 -- 172.21.15.28:0/3568250829 wait complete. 2024-04-23T18:23:04.306 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-23T18:23:04.306 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:23:04.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f831e200640 1 Processor -- start 2024-04-23T18:23:04.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f831e200640 1 -- start start 2024-04-23T18:23:04.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f831e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83180c9a00 0x7f8318158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f831e200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83180c3bc0 con 0x7f83180c9e40 2024-04-23T18:23:04.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f831e200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83180c4940 con 0x7f83181531a0 2024-04-23T18:23:04.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f831e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f83180c6790 con 0x7f83180c9a00 2024-04-23T18:23:04.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f8317e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f83180c9e40 0x7f8318072f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58678/0 (socket says 172.21.15.28:58678) 2024-04-23T18:23:04.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f8317e00640 1 -- 172.21.15.28:0/2985808489 learned_addr learned my addr 172.21.15.28:0/2985808489 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:04.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f830fe00640 1 --2- 172.21.15.28:0/2985808489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83180c9a00 0x7f8318158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f8316a00640 1 -- 172.21.15.28:0/2985808489 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1617663226 0 0) 0x7f83180c3bc0 con 0x7f83180c9e40 2024-04-23T18:23:04.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f8316a00640 1 -- 172.21.15.28:0/2985808489 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82fc003530 con 0x7f83180c9e40 2024-04-23T18:23:04.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f830fe00640 1 -- 172.21.15.28:0/2985808489 >> v1:172.21.15.137:6789/0 conn(0x7f83181531a0 legacy=0x7f83180c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f830fe00640 1 -- 172.21.15.28:0/2985808489 >> v1:172.21.15.28:6789/0 conn(0x7f83180c9e40 legacy=0x7f8318072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.456+0000 7f830fe00640 1 -- 172.21.15.28:0/2985808489 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83180c6a70 con 0x7f83180c9a00 2024-04-23T18:23:04.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.460+0000 7f830fe00640 1 --2- 172.21.15.28:0/2985808489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83180c9a00 0x7f8318158ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f83000097f0 tx=0x7f830001ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e1f03221391f006 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:04.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.460+0000 7f8316a00640 1 -- 172.21.15.28:0/2985808489 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83000b5070 con 0x7f83180c9a00 2024-04-23T18:23:04.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.460+0000 7f8316a00640 1 -- 172.21.15.28:0/2985808489 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83000a89d0 con 0x7f83180c9a00 2024-04-23T18:23:04.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.460+0000 7f8316a00640 1 -- 172.21.15.28:0/2985808489 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83000a8d80 con 0x7f83180c9a00 2024-04-23T18:23:04.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.460+0000 7f831e200640 1 -- 172.21.15.28:0/2985808489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83180c9a00 msgr2=0x7f8318158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.460+0000 7f831e200640 1 --2- 172.21.15.28:0/2985808489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83180c9a00 0x7f8318158ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f83000097f0 tx=0x7f830001ecd0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.460+0000 7f831e200640 1 -- 172.21.15.28:0/2985808489 shutdown_connections 2024-04-23T18:23:04.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.460+0000 7f831e200640 1 --2- 172.21.15.28:0/2985808489 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83180c9a00 0x7f8318158ef0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.460+0000 7f831e200640 1 -- 172.21.15.28:0/2985808489 >> 172.21.15.28:0/2985808489 conn(0x7f831806d0a0 msgr2=0x7f83180676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:04.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.460+0000 7f831e200640 1 -- 172.21.15.28:0/2985808489 shutdown_connections 2024-04-23T18:23:04.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.460+0000 7f831e200640 1 -- 172.21.15.28:0/2985808489 wait complete. 2024-04-23T18:23:04.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f831e200640 1 Processor -- start 2024-04-23T18:23:04.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f831e200640 1 -- start start 2024-04-23T18:23:04.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f831e200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83180c9a00 0x7f83181f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f831e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83180c9e40 0x7f83181e4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f831e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83181531a0 0x7f83181df800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f831e200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f83180c4420 con 0x7f83180c9a00 2024-04-23T18:23:04.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f831e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83180c4140 con 0x7f83180c9e40 2024-04-23T18:23:04.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f831e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8318153580 con 0x7f83181531a0 2024-04-23T18:23:04.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f8317400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83180c9a00 0x7f83181f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f8317400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83180c9a00 0x7f83181f4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41294/0 (socket says 172.21.15.28:41294) 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f8317400640 1 -- 172.21.15.28:0/116550539 learned_addr learned my addr 172.21.15.28:0/116550539 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f830fe00640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83180c9e40 0x7f83181e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f8317e00640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83181531a0 0x7f83181df800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f8317400640 1 -- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83181531a0 msgr2=0x7f83181df800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f8317400640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83181531a0 0x7f83181df800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f8317400640 1 -- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83180c9e40 msgr2=0x7f83181e4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f8317400640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83180c9e40 0x7f83181e4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f8317400640 1 -- 172.21.15.28:0/116550539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83181f5480 con 0x7f83180c9a00 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f8317e00640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83181531a0 0x7f83181df800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f8317400640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83180c9a00 0x7f83181f4f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f830800c3f0 tx=0x7f830800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:04.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f830f400640 1 -- 172.21.15.28:0/116550539 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308017070 con 0x7f83180c9a00 2024-04-23T18:23:04.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f830f400640 1 -- 172.21.15.28:0/116550539 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83080052d0 con 0x7f83180c9a00 2024-04-23T18:23:04.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f831e200640 1 -- 172.21.15.28:0/116550539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83181f1010 con 0x7f83180c9a00 2024-04-23T18:23:04.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f830f400640 1 -- 172.21.15.28:0/116550539 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308003840 con 0x7f83180c9a00 2024-04-23T18:23:04.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.464+0000 7f831e200640 1 -- 172.21.15.28:0/116550539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83181f12d0 con 0x7f83180c9a00 2024-04-23T18:23:04.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.468+0000 7f831e200640 1 -- 172.21.15.28:0/116550539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8318068cd0 con 0x7f83180c9a00 2024-04-23T18:23:04.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.468+0000 7f830f400640 1 -- 172.21.15.28:0/116550539 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f830801a070 con 0x7f83180c9a00 2024-04-23T18:23:04.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.468+0000 7f830f400640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f82f4068380 0x7f82f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.468+0000 7f830f400640 1 -- 172.21.15.28:0/116550539 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8308086100 con 0x7f83180c9a00 2024-04-23T18:23:04.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.468+0000 7f830fe00640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f82f4068380 0x7f82f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.468+0000 7f830fe00640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f82f4068380 0x7f82f406a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f83000b2000 tx=0x7f83000aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:04.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.472+0000 7f830f400640 1 -- 172.21.15.28:0/116550539 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8308005480 con 0x7f83180c9a00 2024-04-23T18:23:04.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f831e200640 1 -- 172.21.15.28:0/116550539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8318068460 con 0x7f83180c9a00 2024-04-23T18:23:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f830f400640 1 -- 172.21.15.28:0/116550539 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f83080562e0 con 0x7f83180c9a00 2024-04-23T18:23:04.633 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:04.634 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:23:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f831e200640 1 -- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f82f4068380 msgr2=0x7f82f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f831e200640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f82f4068380 0x7f82f406a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f83000b2000 tx=0x7f83000aa070 comp rx=0 tx=0).stop 2024-04-23T18:23:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f831e200640 1 -- 172.21.15.28:0/116550539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83180c9a00 msgr2=0x7f83181f4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f831e200640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83180c9a00 0x7f83181f4f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f830800c3f0 tx=0x7f830800c8b0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f831e200640 1 -- 172.21.15.28:0/116550539 shutdown_connections 2024-04-23T18:23:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f831e200640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f82f4068380 0x7f82f406a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f831e200640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83181531a0 0x7f83181df800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f831e200640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83180c9e40 0x7f83181e4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f831e200640 1 --2- 172.21.15.28:0/116550539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f83180c9a00 0x7f83181f4f40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.640+0000 7f831e200640 1 -- 172.21.15.28:0/116550539 >> 172.21.15.28:0/116550539 conn(0x7f831806d0a0 msgr2=0x7f83180c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.644+0000 7f831e200640 1 -- 172.21.15.28:0/116550539 shutdown_connections 2024-04-23T18:23:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.644+0000 7f831e200640 1 -- 172.21.15.28:0/116550539 wait complete. 2024-04-23T18:23:04.654 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T18:22:19.363864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T18:22:31.040656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T18:22:31.703845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T18:22:35.387908+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T18:23:04.655 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T18:23:04.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.804+0000 7fadd4a00640 1 Processor -- start 2024-04-23T18:23:04.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.804+0000 7fadd4a00640 1 -- start start 2024-04-23T18:23:04.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadd4a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fadd01551b0 0x7fadd015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadd4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fadd00c9fc0 0x7fadd00ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadd4a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fadd0073710 0x7fadd0073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadd4a00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fadd015bbe0 con 0x7fadd01551b0 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadd4a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fadd015aff0 con 0x7fadd0073710 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadd4a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fadd006c530 con 0x7fadd00c9fc0 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadcde00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fadd01551b0 0x7fadd015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadcde00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fadd01551b0 0x7fadd015f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41300/0 (socket says 172.21.15.28:41300) 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadcde00640 1 -- 172.21.15.28:0/596329052 learned_addr learned my addr 172.21.15.28:0/596329052 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadcd400640 1 --2- 172.21.15.28:0/596329052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fadd00c9fc0 0x7fadd00ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadce800640 1 --2- 172.21.15.28:0/596329052 >> v2:172.21.15.137:3300/0 conn(0x7fadd0073710 0x7fadd0073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadcde00640 1 -- 172.21.15.28:0/596329052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fadd00c9fc0 msgr2=0x7fadd00ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadcde00640 1 --2- 172.21.15.28:0/596329052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fadd00c9fc0 0x7fadd00ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadcde00640 1 -- 172.21.15.28:0/596329052 >> v2:172.21.15.137:3300/0 conn(0x7fadd0073710 msgr2=0x7fadd0073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadcde00640 1 --2- 172.21.15.28:0/596329052 >> v2:172.21.15.137:3300/0 conn(0x7fadd0073710 0x7fadd0073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.808+0000 7fadcde00640 1 -- 172.21.15.28:0/596329052 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd015b2b0 con 0x7fadd01551b0 2024-04-23T18:23:04.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadcde00640 1 --2- 172.21.15.28:0/596329052 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadd01551b0 0x7fadd015f1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fadd00cc7c0 tx=0x7fadc001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7651d272163165 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:04.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadcca00640 1 -- 172.21.15.28:0/596329052 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc00b0070 con 0x7fadd01551b0 2024-04-23T18:23:04.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadcca00640 1 -- 172.21.15.28:0/596329052 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc00ab600 con 0x7fadd01551b0 2024-04-23T18:23:04.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadcca00640 1 -- 172.21.15.28:0/596329052 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc00ab9d0 con 0x7fadd01551b0 2024-04-23T18:23:04.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 -- 172.21.15.28:0/596329052 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadd01551b0 msgr2=0x7fadd015f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 --2- 172.21.15.28:0/596329052 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadd01551b0 0x7fadd015f1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fadd00cc7c0 tx=0x7fadc001c520 comp rx=0 tx=0).stop 2024-04-23T18:23:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 -- 172.21.15.28:0/596329052 shutdown_connections 2024-04-23T18:23:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 --2- 172.21.15.28:0/596329052 >> v2:172.21.15.137:3300/0 conn(0x7fadd0073710 0x7fadd0073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 --2- 172.21.15.28:0/596329052 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fadd00c9fc0 0x7fadd00ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 --2- 172.21.15.28:0/596329052 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadd01551b0 0x7fadd015f1a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 -- 172.21.15.28:0/596329052 >> 172.21.15.28:0/596329052 conn(0x7fadd00676e0 msgr2=0x7fadd0067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 -- 172.21.15.28:0/596329052 shutdown_connections 2024-04-23T18:23:04.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 -- 172.21.15.28:0/596329052 wait complete. 2024-04-23T18:23:04.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 Processor -- start 2024-04-23T18:23:04.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 -- start start 2024-04-23T18:23:04.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadd0073710 0x7fadd015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fadd00c9fc0 0x7fadd00c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadd01551b0 0x7fadd0146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fadd0070ba0 con 0x7fadd01551b0 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fadd0070a20 con 0x7fadd0073710 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadd4a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fadd0070d20 con 0x7fadd00c9fc0 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadce800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadd01551b0 0x7fadd0146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadcde00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadd0073710 0x7fadd015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadce800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadd01551b0 0x7fadd0146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41312/0 (socket says 172.21.15.28:41312) 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadce800640 1 -- 172.21.15.28:0/4208011571 learned_addr learned my addr 172.21.15.28:0/4208011571 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.812+0000 7fadcd400640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fadd00c9fc0 0x7fadd00c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadce800640 1 -- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fadd00c9fc0 msgr2=0x7fadd00c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadce800640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fadd00c9fc0 0x7fadd00c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadce800640 1 -- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadd0073710 msgr2=0x7fadd015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadce800640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadd0073710 0x7fadd015c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadce800640 1 -- 172.21.15.28:0/4208011571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd00c7d00 con 0x7fadd01551b0 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadcd400640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fadd00c9fc0 0x7fadd00c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:04.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadce800640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadd01551b0 0x7fadd0146660 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fadc8007e40 tx=0x7fadc800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadc6000640 1 -- 172.21.15.28:0/4208011571 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8014620 con 0x7fadd01551b0 2024-04-23T18:23:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadc6000640 1 -- 172.21.15.28:0/4208011571 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc8019070 con 0x7fadd01551b0 2024-04-23T18:23:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadc6000640 1 -- 172.21.15.28:0/4208011571 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8014a20 con 0x7fadd01551b0 2024-04-23T18:23:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadd4a00640 1 -- 172.21.15.28:0/4208011571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd0155960 con 0x7fadd01551b0 2024-04-23T18:23:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadd4a00640 1 -- 172.21.15.28:0/4208011571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd00c7fa0 con 0x7fadd01551b0 2024-04-23T18:23:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadd4a00640 1 -- 172.21.15.28:0/4208011571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd0068db0 con 0x7fadd01551b0 2024-04-23T18:23:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadc6000640 1 -- 172.21.15.28:0/4208011571 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fadc8014bc0 con 0x7fadd01551b0 2024-04-23T18:23:04.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadc6000640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fadb00683b0 0x7fadb006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:04.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.816+0000 7fadc6000640 1 -- 172.21.15.28:0/4208011571 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fadc8087590 con 0x7fadd01551b0 2024-04-23T18:23:04.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.820+0000 7fadcde00640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fadb00683b0 0x7fadb006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:04.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.820+0000 7fadcde00640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fadb00683b0 0x7fadb006a870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fadc00ad000 tx=0x7fadc0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:04.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.820+0000 7fadc6000640 1 -- 172.21.15.28:0/4208011571 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fadc8057090 con 0x7fadd01551b0 2024-04-23T18:23:04.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.988+0000 7fadd4a00640 1 -- 172.21.15.28:0/4208011571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fadd01591c0 con 0x7fadd01551b0 2024-04-23T18:23:04.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.988+0000 7fadc6000640 1 -- 172.21.15.28:0/4208011571 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fadc805b390 con 0x7fadd01551b0 2024-04-23T18:23:04.983 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-04-23T18:23:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 -- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fadb00683b0 msgr2=0x7fadb006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fadb00683b0 0x7fadb006a870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fadc00ad000 tx=0x7fadc0008040 comp rx=0 tx=0).stop 2024-04-23T18:23:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 -- 172.21.15.28:0/4208011571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadd01551b0 msgr2=0x7fadd0146660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadd01551b0 0x7fadd0146660 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fadc8007e40 tx=0x7fadc800e4b0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 -- 172.21.15.28:0/4208011571 shutdown_connections 2024-04-23T18:23:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fadb00683b0 0x7fadb006a870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fadd00c9fc0 0x7fadd00c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fadd01551b0 0x7fadd0146660 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 --2- 172.21.15.28:0/4208011571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadd0073710 0x7fadd015c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 -- 172.21.15.28:0/4208011571 >> 172.21.15.28:0/4208011571 conn(0x7fadd00676e0 msgr2=0x7fadd015a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 -- 172.21.15.28:0/4208011571 shutdown_connections 2024-04-23T18:23:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:04.992+0000 7fadd4a00640 1 -- 172.21.15.28:0/4208011571 wait complete. 2024-04-23T18:23:05.005 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T18:23:05.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0184400640 1 Processor -- start 2024-04-23T18:23:05.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0184400640 1 -- start start 2024-04-23T18:23:05.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0184400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f017c152100 0x7f017c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0184400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f017c0c9e50 0x7f017c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0184400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017c15b520 con 0x7f017c0c8d50 2024-04-23T18:23:05.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0184400640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f017c071d40 con 0x7f017c152100 2024-04-23T18:23:05.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0184400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f017c072020 con 0x7f017c0c9e50 2024-04-23T18:23:05.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0181a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f017c152100 0x7f017c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0181a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f017c152100 0x7f017c15bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41316/0 (socket says 172.21.15.28:41316) 2024-04-23T18:23:05.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0181a00640 1 -- 172.21.15.28:0/3295007041 learned_addr learned my addr 172.21.15.28:0/3295007041 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:05.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0181000640 1 --2- 172.21.15.28:0/3295007041 >> v2:172.21.15.137:3300/0 conn(0x7f017c0c9e50 0x7f017c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0181a00640 1 -- 172.21.15.28:0/3295007041 >> v2:172.21.15.137:3300/0 conn(0x7f017c0c9e50 msgr2=0x7f017c06ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:05.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0181a00640 1 --2- 172.21.15.28:0/3295007041 >> v2:172.21.15.137:3300/0 conn(0x7f017c0c9e50 0x7f017c06ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0181a00640 1 -- 172.21.15.28:0/3295007041 >> v1:172.21.15.137:6789/0 conn(0x7f017c0c8d50 legacy=0x7f017c072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.156+0000 7f0181a00640 1 -- 172.21.15.28:0/3295007041 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c15b7c0 con 0x7f017c152100 2024-04-23T18:23:05.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f0181a00640 1 --2- 172.21.15.28:0/3295007041 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f017c152100 0x7f017c15bfc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f017c0c3de0 tx=0x7f017001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e1ad1ebad54b32 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:05.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f017be00640 1 -- 172.21.15.28:0/3295007041 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01700b5070 con 0x7f017c152100 2024-04-23T18:23:05.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f017be00640 1 -- 172.21.15.28:0/3295007041 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01700a8a10 con 0x7f017c152100 2024-04-23T18:23:05.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f017be00640 1 -- 172.21.15.28:0/3295007041 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01700a8de0 con 0x7f017c152100 2024-04-23T18:23:05.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f0184400640 1 -- 172.21.15.28:0/3295007041 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f017c152100 msgr2=0x7f017c15bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f0184400640 1 --2- 172.21.15.28:0/3295007041 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f017c152100 0x7f017c15bfc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f017c0c3de0 tx=0x7f017001ed10 comp rx=0 tx=0).stop 2024-04-23T18:23:05.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f0184400640 1 -- 172.21.15.28:0/3295007041 shutdown_connections 2024-04-23T18:23:05.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f0184400640 1 --2- 172.21.15.28:0/3295007041 >> v2:172.21.15.137:3300/0 conn(0x7f017c0c9e50 0x7f017c06ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f0184400640 1 --2- 172.21.15.28:0/3295007041 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f017c152100 0x7f017c15bfc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f0184400640 1 -- 172.21.15.28:0/3295007041 >> 172.21.15.28:0/3295007041 conn(0x7f017c0c9330 msgr2=0x7f017c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:05.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f0184400640 1 -- 172.21.15.28:0/3295007041 shutdown_connections 2024-04-23T18:23:05.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.160+0000 7f0184400640 1 -- 172.21.15.28:0/3295007041 wait complete. 2024-04-23T18:23:05.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0184400640 1 Processor -- start 2024-04-23T18:23:05.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0184400640 1 -- start start 2024-04-23T18:23:05.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0184400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f017c0c8d50 0x7f017c149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0184400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f017c0c9e50 0x7f017c14a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0184400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f017c152100 0x7f017c153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0184400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f017c070fc0 con 0x7f017c152100 2024-04-23T18:23:05.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0184400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f017c070e40 con 0x7f017c0c9e50 2024-04-23T18:23:05.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0184400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f017c071140 con 0x7f017c0c8d50 2024-04-23T18:23:05.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0182400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f017c152100 0x7f017c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0182400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f017c152100 0x7f017c153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41330/0 (socket says 172.21.15.28:41330) 2024-04-23T18:23:05.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0182400640 1 -- 172.21.15.28:0/1632136768 learned_addr learned my addr 172.21.15.28:0/1632136768 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:05.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0181000640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f017c0c9e50 0x7f017c14a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0181a00640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f017c0c8d50 0x7f017c149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0182400640 1 -- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f017c0c8d50 msgr2=0x7f017c149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0182400640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f017c0c8d50 0x7f017c149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0182400640 1 -- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f017c0c9e50 msgr2=0x7f017c14a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0182400640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f017c0c9e50 0x7f017c14a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0182400640 1 -- 172.21.15.28:0/1632136768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c0c3210 con 0x7f017c152100 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0182400640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f017c152100 0x7f017c153490 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f017400c6f0 tx=0x7f017400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0179600640 1 -- 172.21.15.28:0/1632136768 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174003980 con 0x7f017c152100 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0179600640 1 -- 172.21.15.28:0/1632136768 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0174003b20 con 0x7f017c152100 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0179600640 1 -- 172.21.15.28:0/1632136768 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017400a850 con 0x7f017c152100 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0184400640 1 -- 172.21.15.28:0/1632136768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017c0c8b80 con 0x7f017c152100 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.164+0000 7f0184400640 1 -- 172.21.15.28:0/1632136768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017c152b30 con 0x7f017c152100 2024-04-23T18:23:05.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.168+0000 7f0184400640 1 -- 172.21.15.28:0/1632136768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f017c068db0 con 0x7f017c152100 2024-04-23T18:23:05.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.168+0000 7f0179600640 1 -- 172.21.15.28:0/1632136768 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f017400a9f0 con 0x7f017c152100 2024-04-23T18:23:05.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.168+0000 7f0179600640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f015c068380 0x7f015c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.168+0000 7f0179600640 1 -- 172.21.15.28:0/1632136768 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0174086b20 con 0x7f017c152100 2024-04-23T18:23:05.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.168+0000 7f0181a00640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f015c068380 0x7f015c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.168+0000 7f0181a00640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f015c068380 0x7f015c06a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f01700b2000 tx=0x7f0170009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:05.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.172+0000 7f0179600640 1 -- 172.21.15.28:0/1632136768 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0174056620 con 0x7f017c152100 2024-04-23T18:23:05.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 -- 172.21.15.28:0/1632136768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f017c0c9940 con 0x7f017c152100 2024-04-23T18:23:05.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0179600640 1 -- 172.21.15.28:0/1632136768 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f017405a920 con 0x7f017c152100 2024-04-23T18:23:05.336 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:23:05.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 -- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f015c068380 msgr2=0x7f015c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f015c068380 0x7f015c06a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f01700b2000 tx=0x7f0170009040 comp rx=0 tx=0).stop 2024-04-23T18:23:05.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 -- 172.21.15.28:0/1632136768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f017c152100 msgr2=0x7f017c153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f017c152100 0x7f017c153490 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f017400c6f0 tx=0x7f017400cbb0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 -- 172.21.15.28:0/1632136768 shutdown_connections 2024-04-23T18:23:05.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f015c068380 0x7f015c06a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f017c152100 0x7f017c153490 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f017c0c9e50 0x7f017c14a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 --2- 172.21.15.28:0/1632136768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f017c0c8d50 0x7f017c149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 -- 172.21.15.28:0/1632136768 >> 172.21.15.28:0/1632136768 conn(0x7f017c0c9330 msgr2=0x7f017c151310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:05.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 -- 172.21.15.28:0/1632136768 shutdown_connections 2024-04-23T18:23:05.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.344+0000 7f0184400640 1 -- 172.21.15.28:0/1632136768 wait complete. 2024-04-23T18:23:05.358 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T18:23:05.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.508+0000 7fb672e00640 1 Processor -- start 2024-04-23T18:23:05.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.508+0000 7fb672e00640 1 -- start start 2024-04-23T18:23:05.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.508+0000 7fb672e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb66c1551b0 0x7fb66c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.508+0000 7fb672e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb66c0ca3e0 0x7fb66c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.508+0000 7fb672e00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66c0ca870 con 0x7fb66c0c9fc0 2024-04-23T18:23:05.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.508+0000 7fb672e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb66c15bbe0 con 0x7fb66c1551b0 2024-04-23T18:23:05.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.508+0000 7fb672e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb66c15aff0 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb663e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb66c0c9fc0 0x7fb66c073710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58692/0 (socket says 172.21.15.28:58692) 2024-04-23T18:23:05.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb663e00640 1 -- 172.21.15.28:0/2365721423 learned_addr learned my addr 172.21.15.28:0/2365721423 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:05.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb66be00640 1 --2- 172.21.15.28:0/2365721423 >> v2:172.21.15.137:3300/0 conn(0x7fb66c1551b0 0x7fb66c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb670e00640 1 --2- 172.21.15.28:0/2365721423 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb66c0ca3e0 0x7fb66c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb66b400640 1 -- 172.21.15.28:0/2365721423 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2176175871 0 0) 0x7fb654001120 con 0x7fb66c0c9fc0 2024-04-23T18:23:05.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb66b400640 1 -- 172.21.15.28:0/2365721423 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb650003530 con 0x7fb66c0c9fc0 2024-04-23T18:23:05.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb66be00640 1 -- 172.21.15.28:0/2365721423 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb66c0ca3e0 msgr2=0x7fb66c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:05.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb66be00640 1 --2- 172.21.15.28:0/2365721423 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb66c0ca3e0 0x7fb66c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb66be00640 1 -- 172.21.15.28:0/2365721423 >> v1:172.21.15.28:6789/0 conn(0x7fb66c0c9fc0 legacy=0x7fb66c073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb66be00640 1 -- 172.21.15.28:0/2365721423 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c06c530 con 0x7fb66c1551b0 2024-04-23T18:23:05.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb670e00640 1 --2- 172.21.15.28:0/2365721423 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb66c0ca3e0 0x7fb66c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:05.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.512+0000 7fb66be00640 1 --2- 172.21.15.28:0/2365721423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1551b0 0x7fb66c15f1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0097c0 tx=0x7fb65c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba9b2365d3f83a16 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:05.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb66b400640 1 -- 172.21.15.28:0/2365721423 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0b0070 con 0x7fb66c1551b0 2024-04-23T18:23:05.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb66b400640 1 -- 172.21.15.28:0/2365721423 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65c0ab600 con 0x7fb66c1551b0 2024-04-23T18:23:05.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb66b400640 1 -- 172.21.15.28:0/2365721423 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0ab9b0 con 0x7fb66c1551b0 2024-04-23T18:23:05.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 -- 172.21.15.28:0/2365721423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1551b0 msgr2=0x7fb66c15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 --2- 172.21.15.28:0/2365721423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1551b0 0x7fb66c15f1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0097c0 tx=0x7fb65c01c4a0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 -- 172.21.15.28:0/2365721423 shutdown_connections 2024-04-23T18:23:05.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 --2- 172.21.15.28:0/2365721423 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb66c0ca3e0 0x7fb66c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 --2- 172.21.15.28:0/2365721423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1551b0 0x7fb66c15f1a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 -- 172.21.15.28:0/2365721423 >> 172.21.15.28:0/2365721423 conn(0x7fb66c0676e0 msgr2=0x7fb66c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:05.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 -- 172.21.15.28:0/2365721423 shutdown_connections 2024-04-23T18:23:05.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 -- 172.21.15.28:0/2365721423 wait complete. 2024-04-23T18:23:05.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 Processor -- start 2024-04-23T18:23:05.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 -- start start 2024-04-23T18:23:05.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb66c0c9fc0 0x7fb66c0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb66c0ca3e0 0x7fb66c0cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1551b0 0x7fb66c153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c155710 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c155590 con 0x7fb66c1551b0 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb672e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb66c073e20 con 0x7fb66c0c9fc0 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb663e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb66c0ca3e0 0x7fb66c0cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb663e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb66c0ca3e0 0x7fb66c0cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41334/0 (socket says 172.21.15.28:41334) 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.516+0000 7fb663e00640 1 -- 172.21.15.28:0/3828515652 learned_addr learned my addr 172.21.15.28:0/3828515652 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb66be00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb66c0c9fc0 0x7fb66c0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb670e00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1551b0 0x7fb66c153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb663e00640 1 -- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb66c0c9fc0 msgr2=0x7fb66c0cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb663e00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb66c0c9fc0 0x7fb66c0cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb663e00640 1 -- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1551b0 msgr2=0x7fb66c153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb663e00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1551b0 0x7fb66c153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb663e00640 1 -- 172.21.15.28:0/3828515652 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c0cbb60 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb663e00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb66c0ca3e0 0x7fb66c0cd470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb65400c3f0 tx=0x7fb65400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:05.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb668c00640 1 -- 172.21.15.28:0/3828515652 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb654017070 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb668c00640 1 -- 172.21.15.28:0/3828515652 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb654005cf0 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb672e00640 1 -- 172.21.15.28:0/3828515652 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66c0c9020 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb668c00640 1 -- 172.21.15.28:0/3828515652 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb654007310 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb672e00640 1 -- 172.21.15.28:0/3828515652 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66c1f74d0 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb672e00640 1 -- 172.21.15.28:0/3828515652 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb66c068db0 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb668c00640 1 -- 172.21.15.28:0/3828515652 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb65401a070 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb668c00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb648068380 0x7fb64806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.520+0000 7fb668c00640 1 -- 172.21.15.28:0/3828515652 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb654086110 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.524+0000 7fb66be00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb648068380 0x7fb64806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.524+0000 7fb66be00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb648068380 0x7fb64806a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0ad000 tx=0x7fb65c0a6000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:05.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.524+0000 7fb668c00640 1 -- 172.21.15.28:0/3828515652 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb66c0ca870 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.611 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-23T18:23:05.615+0000 7f925291f640 -1 quiesce.mds.0 failed to decode message of type 1286 v1: End of buffer [buffer:2] 2024-04-23T18:23:05.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.696+0000 7fb672e00640 1 -- 172.21.15.28:0/3828515652 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb66c0c5a10 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.696+0000 7fb668c00640 1 -- 172.21.15.28:0/3828515652 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fb654055c10 con 0x7fb66c0ca3e0 2024-04-23T18:23:05.691 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2024-04-23T18:23:05.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 -- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb648068380 msgr2=0x7fb64806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb648068380 0x7fb64806a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0ad000 tx=0x7fb65c0a6000 comp rx=0 tx=0).stop 2024-04-23T18:23:05.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 -- 172.21.15.28:0/3828515652 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb66c0ca3e0 msgr2=0x7fb66c0cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb66c0ca3e0 0x7fb66c0cd470 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb65400c3f0 tx=0x7fb65400c7f0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 -- 172.21.15.28:0/3828515652 shutdown_connections 2024-04-23T18:23:05.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb648068380 0x7fb64806a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1551b0 0x7fb66c153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb66c0ca3e0 0x7fb66c0cd470 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 --2- 172.21.15.28:0/3828515652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb66c0c9fc0 0x7fb66c0cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 -- 172.21.15.28:0/3828515652 >> 172.21.15.28:0/3828515652 conn(0x7fb66c0676e0 msgr2=0x7fb66c067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:05.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 -- 172.21.15.28:0/3828515652 shutdown_connections 2024-04-23T18:23:05.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.700+0000 7fb672e00640 1 -- 172.21.15.28:0/3828515652 wait complete. 2024-04-23T18:23:05.712 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T18:23:05.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f787b400640 1 Processor -- start 2024-04-23T18:23:05.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f787b400640 1 -- start start 2024-04-23T18:23:05.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f787b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f787414f8d0 0x7f7874158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f787b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78740c9e50 0x7f78740c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f787b400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7874073520 con 0x7f7874073050 2024-04-23T18:23:05.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f787b400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7874073da0 con 0x7f787414f8d0 2024-04-23T18:23:05.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f787b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f78740737e0 con 0x7f78740c9e50 2024-04-23T18:23:05.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f786be00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7874073050 0x7f78740c7230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58696/0 (socket says 172.21.15.28:58696) 2024-04-23T18:23:05.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f786be00640 1 -- 172.21.15.28:0/428304715 learned_addr learned my addr 172.21.15.28:0/428304715 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:05.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f7879400640 1 --2- 172.21.15.28:0/428304715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78740c9e50 0x7f78740c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f7878a00640 1 --2- 172.21.15.28:0/428304715 >> v2:172.21.15.137:3300/0 conn(0x7f787414f8d0 0x7f7874158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f7873e00640 1 -- 172.21.15.28:0/428304715 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638208393 0 0) 0x7f7874073520 con 0x7f7874073050 2024-04-23T18:23:05.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f7873e00640 1 -- 172.21.15.28:0/428304715 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7858003530 con 0x7f7874073050 2024-04-23T18:23:05.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f7879400640 1 -- 172.21.15.28:0/428304715 >> v2:172.21.15.137:3300/0 conn(0x7f787414f8d0 msgr2=0x7f7874158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:05.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f7879400640 1 --2- 172.21.15.28:0/428304715 >> v2:172.21.15.137:3300/0 conn(0x7f787414f8d0 0x7f7874158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f7879400640 1 -- 172.21.15.28:0/428304715 >> v1:172.21.15.28:6789/0 conn(0x7f7874073050 legacy=0x7f78740c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.864+0000 7f7879400640 1 -- 172.21.15.28:0/428304715 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7874073ac0 con 0x7f78740c9e50 2024-04-23T18:23:05.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f7879400640 1 --2- 172.21.15.28:0/428304715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78740c9e50 0x7f78740c6900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f786c009d90 tx=0x7f786c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a0cd097f6aee4f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:05.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f7873e00640 1 -- 172.21.15.28:0/428304715 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c0b2070 con 0x7f78740c9e50 2024-04-23T18:23:05.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f7873e00640 1 -- 172.21.15.28:0/428304715 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786c0a5990 con 0x7f78740c9e50 2024-04-23T18:23:05.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f7873e00640 1 -- 172.21.15.28:0/428304715 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c0a5d40 con 0x7f78740c9e50 2024-04-23T18:23:05.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f787b400640 1 -- 172.21.15.28:0/428304715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78740c9e50 msgr2=0x7f78740c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f787b400640 1 --2- 172.21.15.28:0/428304715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78740c9e50 0x7f78740c6900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f786c009d90 tx=0x7f786c01c8b0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f787b400640 1 -- 172.21.15.28:0/428304715 shutdown_connections 2024-04-23T18:23:05.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f787b400640 1 --2- 172.21.15.28:0/428304715 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78740c9e50 0x7f78740c6900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f787b400640 1 --2- 172.21.15.28:0/428304715 >> v2:172.21.15.137:3300/0 conn(0x7f787414f8d0 0x7f7874158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f787b400640 1 -- 172.21.15.28:0/428304715 >> 172.21.15.28:0/428304715 conn(0x7f78740c9330 msgr2=0x7f78740c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:05.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f787b400640 1 -- 172.21.15.28:0/428304715 shutdown_connections 2024-04-23T18:23:05.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.868+0000 7f787b400640 1 -- 172.21.15.28:0/428304715 wait complete. 2024-04-23T18:23:05.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f787b400640 1 Processor -- start 2024-04-23T18:23:05.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f787b400640 1 -- start start 2024-04-23T18:23:05.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f787b400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7874073050 0x7f78740cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f787b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78740c9e50 0x7f787414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f787b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f787414f8d0 0x7f78741f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f787b400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f78740c7940 con 0x7f7874073050 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f787b400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f787414fcb0 con 0x7f787414f8d0 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f787b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f78740c7ac0 con 0x7f78740c9e50 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7878a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7874073050 0x7f78740cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7878a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7874073050 0x7f78740cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41340/0 (socket says 172.21.15.28:41340) 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7878a00640 1 -- 172.21.15.28:0/1425964019 learned_addr learned my addr 172.21.15.28:0/1425964019 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f786be00640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78740c9e50 0x7f787414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7879400640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f787414f8d0 0x7f78741f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7878a00640 1 -- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78740c9e50 msgr2=0x7f787414e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7878a00640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78740c9e50 0x7f787414e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7878a00640 1 -- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f787414f8d0 msgr2=0x7f78741f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:05.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7878a00640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f787414f8d0 0x7f78741f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:05.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7878a00640 1 -- 172.21.15.28:0/1425964019 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78740714a0 con 0x7f7874073050 2024-04-23T18:23:05.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7878a00640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7874073050 0x7f78740cc1b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f786400e8a0 tx=0x7f786400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:05.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7871600640 1 -- 172.21.15.28:0/1425964019 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7864017070 con 0x7f7874073050 2024-04-23T18:23:05.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7871600640 1 -- 172.21.15.28:0/1425964019 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786400c940 con 0x7f7874073050 2024-04-23T18:23:05.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f7871600640 1 -- 172.21.15.28:0/1425964019 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786400ccf0 con 0x7f7874073050 2024-04-23T18:23:05.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f787b400640 1 -- 172.21.15.28:0/1425964019 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7874071780 con 0x7f7874073050 2024-04-23T18:23:05.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f787b400640 1 -- 172.21.15.28:0/1425964019 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7874071d40 con 0x7f7874073050 2024-04-23T18:23:05.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.872+0000 7f787b400640 1 -- 172.21.15.28:0/1425964019 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7874068db0 con 0x7f7874073050 2024-04-23T18:23:05.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.876+0000 7f7871600640 1 -- 172.21.15.28:0/1425964019 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f786401a070 con 0x7f7874073050 2024-04-23T18:23:05.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.876+0000 7f7871600640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f78500683b0 0x7f785006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:05.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.876+0000 7f7871600640 1 -- 172.21.15.28:0/1425964019 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7864086ec0 con 0x7f7874073050 2024-04-23T18:23:05.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.876+0000 7f786be00640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f78500683b0 0x7f785006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:05.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.876+0000 7f786be00640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f78500683b0 0x7f785006a870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f785c007fd0 tx=0x7f785c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:05.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:05.880+0000 7f7871600640 1 -- 172.21.15.28:0/1425964019 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7864056ae0 con 0x7f7874073050 2024-04-23T18:23:06.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.044+0000 7f787b400640 1 -- 172.21.15.28:0/1425964019 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f78740c8e20 con 0x7f7874073050 2024-04-23T18:23:06.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.044+0000 7f7871600640 1 -- 172.21.15.28:0/1425964019 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f786405ade0 con 0x7f7874073050 2024-04-23T18:23:06.039 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:23:06.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 -- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f78500683b0 msgr2=0x7f785006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f78500683b0 0x7f785006a870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f785c007fd0 tx=0x7f785c009040 comp rx=0 tx=0).stop 2024-04-23T18:23:06.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 -- 172.21.15.28:0/1425964019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7874073050 msgr2=0x7f78740cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7874073050 0x7f78740cc1b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f786400e8a0 tx=0x7f786400eca0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 -- 172.21.15.28:0/1425964019 shutdown_connections 2024-04-23T18:23:06.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f78500683b0 0x7f785006a870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f78740c9e50 0x7f787414e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f787414f8d0 0x7f78741f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 --2- 172.21.15.28:0/1425964019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7874073050 0x7f78740cc1b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 -- 172.21.15.28:0/1425964019 >> 172.21.15.28:0/1425964019 conn(0x7f78740c9330 msgr2=0x7f787406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:06.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 -- 172.21.15.28:0/1425964019 shutdown_connections 2024-04-23T18:23:06.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.048+0000 7f787b400640 1 -- 172.21.15.28:0/1425964019 wait complete. 2024-04-23T18:23:06.060 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:23:06.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a20a00640 1 Processor -- start 2024-04-23T18:23:06.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a20a00640 1 -- start start 2024-04-23T18:23:06.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a20a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0a1c0ce800 0x7f0a1c070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a20a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c0cebe0 0x7f0a1c15c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a20a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a1c071480 0x7f0a1c15ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a20a00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f0a1c15c4e0 con 0x7f0a1c0ce800 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a20a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0a1c15b300 con 0x7f0a1c071480 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a20a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c06c4a0 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a1b400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0a1c0ce800 0x7f0a1c070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a13e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c0cebe0 0x7f0a1c15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a1b400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0a1c0ce800 0x7f0a1c070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41352/0 (socket says 172.21.15.28:41352) 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a13e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c0cebe0 0x7f0a1c15c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:43252/0 (socket says 172.21.15.28:43252) 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a1b400640 1 -- 172.21.15.28:0/1310167639 learned_addr learned my addr 172.21.15.28:0/1310167639 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.208+0000 7f0a1be00640 1 --2- 172.21.15.28:0/1310167639 >> v2:172.21.15.137:3300/0 conn(0x7f0a1c071480 0x7f0a1c15ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a13e00640 1 -- 172.21.15.28:0/1310167639 >> v2:172.21.15.137:3300/0 conn(0x7f0a1c071480 msgr2=0x7f0a1c15ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a13e00640 1 --2- 172.21.15.28:0/1310167639 >> v2:172.21.15.137:3300/0 conn(0x7f0a1c071480 0x7f0a1c15ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a13e00640 1 -- 172.21.15.28:0/1310167639 >> v2:172.21.15.28:3300/0 conn(0x7f0a1c0ce800 msgr2=0x7f0a1c070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:06.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a13e00640 1 --2- 172.21.15.28:0/1310167639 >> v2:172.21.15.28:3300/0 conn(0x7f0a1c0ce800 0x7f0a1c070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a13e00640 1 -- 172.21.15.28:0/1310167639 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c15b5a0 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a13e00640 1 --2- 172.21.15.28:0/1310167639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c0cebe0 0x7f0a1c15c970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0a040097c0 tx=0x7f0a0401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a09d2280d6193ec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:06.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a1aa00640 1 -- 172.21.15.28:0/1310167639 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a040ab620 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a1aa00640 1 -- 172.21.15.28:0/1310167639 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a040b0070 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a1aa00640 1 -- 172.21.15.28:0/1310167639 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a040ab9e0 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a20a00640 1 -- 172.21.15.28:0/1310167639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c0cebe0 msgr2=0x7f0a1c15c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a20a00640 1 --2- 172.21.15.28:0/1310167639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c0cebe0 0x7f0a1c15c970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0a040097c0 tx=0x7f0a0401c460 comp rx=0 tx=0).stop 2024-04-23T18:23:06.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a20a00640 1 -- 172.21.15.28:0/1310167639 shutdown_connections 2024-04-23T18:23:06.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a20a00640 1 --2- 172.21.15.28:0/1310167639 >> v2:172.21.15.137:3300/0 conn(0x7f0a1c071480 0x7f0a1c15ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a20a00640 1 --2- 172.21.15.28:0/1310167639 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c0cebe0 0x7f0a1c15c970 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a20a00640 1 --2- 172.21.15.28:0/1310167639 >> v2:172.21.15.28:3300/0 conn(0x7f0a1c0ce800 0x7f0a1c070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a20a00640 1 -- 172.21.15.28:0/1310167639 >> 172.21.15.28:0/1310167639 conn(0x7f0a1c075e30 msgr2=0x7f0a1c0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:06.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a20a00640 1 -- 172.21.15.28:0/1310167639 shutdown_connections 2024-04-23T18:23:06.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.212+0000 7f0a20a00640 1 -- 172.21.15.28:0/1310167639 wait complete. 2024-04-23T18:23:06.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a20a00640 1 Processor -- start 2024-04-23T18:23:06.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a20a00640 1 -- start start 2024-04-23T18:23:06.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a20a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c071480 0x7f0a1c151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a20a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c0ce800 0x7f0a1c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a20a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a1c0cebe0 0x7f0a1c1470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a20a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c15aff0 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a20a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c071190 con 0x7f0a1c0ce800 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a20a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c155450 con 0x7f0a1c071480 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a1be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a1c0cebe0 0x7f0a1c1470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a1be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a1c0cebe0 0x7f0a1c1470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41362/0 (socket says 172.21.15.28:41362) 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a1be00640 1 -- 172.21.15.28:0/1819957080 learned_addr learned my addr 172.21.15.28:0/1819957080 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a1b400640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c071480 0x7f0a1c151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a13e00640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c0ce800 0x7f0a1c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a1be00640 1 -- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c071480 msgr2=0x7f0a1c151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a1be00640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c071480 0x7f0a1c151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a1be00640 1 -- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c0ce800 msgr2=0x7f0a1c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a1be00640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c0ce800 0x7f0a1c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a1be00640 1 -- 172.21.15.28:0/1819957080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c15f390 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a13e00640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c0ce800 0x7f0a1c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a1be00640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a1c0cebe0 0x7f0a1c1470d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400eea0 tx=0x7f0a1400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a13400640 1 -- 172.21.15.28:0/1819957080 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14018020 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a13400640 1 -- 172.21.15.28:0/1819957080 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a14014400 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a13400640 1 -- 172.21.15.28:0/1819957080 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a140147f0 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.216+0000 7f0a20a00640 1 -- 172.21.15.28:0/1819957080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1c14ffc0 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.220+0000 7f0a20a00640 1 -- 172.21.15.28:0/1819957080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1c150580 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.220+0000 7f0a20a00640 1 -- 172.21.15.28:0/1819957080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1c1507c0 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.220+0000 7f0a13400640 1 -- 172.21.15.28:0/1819957080 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a1401b020 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.220+0000 7f0a13400640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f09f80683b0 0x7f09f806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.220+0000 7f0a13400640 1 -- 172.21.15.28:0/1819957080 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0a14087650 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.220+0000 7f0a1b400640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f09f80683b0 0x7f09f806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.220+0000 7f0a1b400640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f09f80683b0 0x7f09f806a870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009b50 tx=0x7f0a0c009240 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:06.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.224+0000 7f0a13400640 1 -- 172.21.15.28:0/1819957080 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a1c1507c0 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.424+0000 7f0a20a00640 1 -- 172.21.15.28:0/1819957080 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a1c068cd0 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a13400640 1 -- 172.21.15.28:0/1819957080 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f0a14022030 con 0x7f0a1c0cebe0 2024-04-23T18:23:06.420 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:06.420 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:23:06.420 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:23:06.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 -- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f09f80683b0 msgr2=0x7f09f806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f09f80683b0 0x7f09f806a870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009b50 tx=0x7f0a0c009240 comp rx=0 tx=0).stop 2024-04-23T18:23:06.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 -- 172.21.15.28:0/1819957080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a1c0cebe0 msgr2=0x7f0a1c1470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a1c0cebe0 0x7f0a1c1470d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400eea0 tx=0x7f0a1400ef90 comp rx=0 tx=0).stop 2024-04-23T18:23:06.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 -- 172.21.15.28:0/1819957080 shutdown_connections 2024-04-23T18:23:06.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f09f80683b0 0x7f09f806a870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a1c0cebe0 0x7f0a1c1470d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a1c0ce800 0x7f0a1c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 --2- 172.21.15.28:0/1819957080 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a1c071480 0x7f0a1c151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 -- 172.21.15.28:0/1819957080 >> 172.21.15.28:0/1819957080 conn(0x7f0a1c075e30 msgr2=0x7f0a1c148950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:06.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 -- 172.21.15.28:0/1819957080 shutdown_connections 2024-04-23T18:23:06.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.428+0000 7f0a20a00640 1 -- 172.21.15.28:0/1819957080 wait complete. 2024-04-23T18:23:06.440 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:23:06.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f649a000640 1 Processor -- start 2024-04-23T18:23:06.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f649a000640 1 -- start start 2024-04-23T18:23:06.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f649a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6494073020 0x7f6494070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f649a000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f64940c5750 0x7f6494142010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f649a000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64940714f0 con 0x7f64940c8980 2024-04-23T18:23:06.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f649a000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f64940c5c50 con 0x7f64940c5750 2024-04-23T18:23:06.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f649a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f64940c5f30 con 0x7f6494073020 2024-04-23T18:23:06.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f648aa00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f64940c5750 0x7f6494142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f6493e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f64940c8980 0x7f6494159470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58712/0 (socket says 172.21.15.28:58712) 2024-04-23T18:23:06.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f6493e00640 1 -- 172.21.15.28:0/4133347516 learned_addr learned my addr 172.21.15.28:0/4133347516 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:06.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f6493400640 1 --2- 172.21.15.28:0/4133347516 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6494073020 0x7f6494070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f648aa00640 1 -- 172.21.15.28:0/4133347516 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6494073020 msgr2=0x7f6494070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:06.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f648aa00640 1 --2- 172.21.15.28:0/4133347516 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6494073020 0x7f6494070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f648aa00640 1 -- 172.21.15.28:0/4133347516 >> v1:172.21.15.28:6789/0 conn(0x7f64940c8980 legacy=0x7f6494159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f648aa00640 1 -- 172.21.15.28:0/4133347516 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64940c6210 con 0x7f64940c5750 2024-04-23T18:23:06.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.588+0000 7f6492a00640 1 -- 172.21.15.28:0/4133347516 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482599555 0 0) 0x7f64940714f0 con 0x7f64940c8980 2024-04-23T18:23:06.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f648aa00640 1 --2- 172.21.15.28:0/4133347516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64940c5750 0x7f6494142010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f647c0097c0 tx=0x7f647c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e27c18a2f884288 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:06.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f6492a00640 1 -- 172.21.15.28:0/4133347516 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c0b5070 con 0x7f64940c5750 2024-04-23T18:23:06.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f6492a00640 1 -- 172.21.15.28:0/4133347516 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647c0a8990 con 0x7f64940c5750 2024-04-23T18:23:06.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f6492a00640 1 -- 172.21.15.28:0/4133347516 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c0a8d60 con 0x7f64940c5750 2024-04-23T18:23:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f649a000640 1 -- 172.21.15.28:0/4133347516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64940c5750 msgr2=0x7f6494142010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f649a000640 1 --2- 172.21.15.28:0/4133347516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64940c5750 0x7f6494142010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f647c0097c0 tx=0x7f647c01ec90 comp rx=0 tx=0).stop 2024-04-23T18:23:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f649a000640 1 -- 172.21.15.28:0/4133347516 shutdown_connections 2024-04-23T18:23:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f649a000640 1 --2- 172.21.15.28:0/4133347516 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64940c5750 0x7f6494142010 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f649a000640 1 --2- 172.21.15.28:0/4133347516 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6494073020 0x7f6494070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f649a000640 1 -- 172.21.15.28:0/4133347516 >> 172.21.15.28:0/4133347516 conn(0x7f64940676e0 msgr2=0x7f6494067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f649a000640 1 -- 172.21.15.28:0/4133347516 shutdown_connections 2024-04-23T18:23:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.592+0000 7f649a000640 1 -- 172.21.15.28:0/4133347516 wait complete. 2024-04-23T18:23:06.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f649a000640 1 Processor -- start 2024-04-23T18:23:06.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f649a000640 1 -- start start 2024-04-23T18:23:06.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f649a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6494073020 0x7f64941f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f649a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64940c5750 0x7f64941f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f649a000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64940c8980 0x7f64941372b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f649a000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6494073400 con 0x7f64940c8980 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f649a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f64940c67d0 con 0x7f64940c5750 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f649a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6494073580 con 0x7f6494073020 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f6493e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64940c8980 0x7f64941372b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f6493e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64940c8980 0x7f64941372b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41378/0 (socket says 172.21.15.28:41378) 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f6493e00640 1 -- 172.21.15.28:0/605553895 learned_addr learned my addr 172.21.15.28:0/605553895 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f6493400640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6494073020 0x7f64941f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f648aa00640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64940c5750 0x7f64941f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f6493400640 1 -- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64940c5750 msgr2=0x7f64941f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f6493400640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64940c5750 0x7f64941f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f6493400640 1 -- 172.21.15.28:0/605553895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64940c8980 msgr2=0x7f64941372b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f6493400640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64940c8980 0x7f64941372b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f6493400640 1 -- 172.21.15.28:0/605553895 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649413bea0 con 0x7f6494073020 2024-04-23T18:23:06.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f6493e00640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64940c8980 0x7f64941372b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:06.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f648aa00640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64940c5750 0x7f64941f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:06.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f6493400640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6494073020 0x7f64941f20f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f648400e870 tx=0x7f648400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:06.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f648be00640 1 -- 172.21.15.28:0/605553895 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6484017070 con 0x7f6494073020 2024-04-23T18:23:06.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f648be00640 1 -- 172.21.15.28:0/605553895 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648400c940 con 0x7f6494073020 2024-04-23T18:23:06.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f648be00640 1 -- 172.21.15.28:0/605553895 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648400ccf0 con 0x7f6494073020 2024-04-23T18:23:06.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f649a000640 1 -- 172.21.15.28:0/605553895 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64941f17a0 con 0x7f6494073020 2024-04-23T18:23:06.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f649a000640 1 -- 172.21.15.28:0/605553895 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f649413bba0 con 0x7f6494073020 2024-04-23T18:23:06.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.596+0000 7f649a000640 1 -- 172.21.15.28:0/605553895 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6494068cd0 con 0x7f6494073020 2024-04-23T18:23:06.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.600+0000 7f648be00640 1 -- 172.21.15.28:0/605553895 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f648401a070 con 0x7f6494073020 2024-04-23T18:23:06.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.600+0000 7f648be00640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6470068380 0x7f647006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.600+0000 7f648be00640 1 -- 172.21.15.28:0/605553895 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f64840870d0 con 0x7f6494073020 2024-04-23T18:23:06.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.600+0000 7f648aa00640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6470068380 0x7f647006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.600+0000 7f648aa00640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6470068380 0x7f647006a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f647c0b2000 tx=0x7f647c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:06.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.612+0000 7f648be00640 1 -- 172.21.15.28:0/605553895 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6484056c50 con 0x7f6494073020 2024-04-23T18:23:06.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.776+0000 7f649a000640 1 -- 172.21.15.28:0/605553895 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64940cb980 con 0x7f6494073020 2024-04-23T18:23:06.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f648be00640 1 -- 172.21.15.28:0/605553895 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f648405af50 con 0x7f6494073020 2024-04-23T18:23:06.773 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:06.773 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:23:06.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 -- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6470068380 msgr2=0x7f647006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6470068380 0x7f647006a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f647c0b2000 tx=0x7f647c008040 comp rx=0 tx=0).stop 2024-04-23T18:23:06.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 -- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6494073020 msgr2=0x7f64941f20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6494073020 0x7f64941f20f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f648400e870 tx=0x7f648400ed30 comp rx=0 tx=0).stop 2024-04-23T18:23:06.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 -- 172.21.15.28:0/605553895 shutdown_connections 2024-04-23T18:23:06.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6470068380 0x7f647006a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64940c8980 0x7f64941372b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64940c5750 0x7f64941f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 --2- 172.21.15.28:0/605553895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6494073020 0x7f64941f20f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 -- 172.21.15.28:0/605553895 >> 172.21.15.28:0/605553895 conn(0x7f64940676e0 msgr2=0x7f649406b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:06.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 -- 172.21.15.28:0/605553895 shutdown_connections 2024-04-23T18:23:06.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.780+0000 7f649a000640 1 -- 172.21.15.28:0/605553895 wait complete. 2024-04-23T18:23:06.795 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T18:22:19.363864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T18:22:31.040656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T18:22:31.703845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T18:22:35.387908+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T18:23:06.795 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T18:23:06.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.944+0000 7fbbe5a00640 1 Processor -- start 2024-04-23T18:23:06.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.944+0000 7fbbe5a00640 1 -- start start 2024-04-23T18:23:06.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbe5a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbbe0144610 0x7fbbe015b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbe5a00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe015e9b0 con 0x7fbbe006c020 2024-04-23T18:23:06.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbe5a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe015ec90 con 0x7fbbe006bc40 2024-04-23T18:23:06.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbe5a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe015ef70 con 0x7fbbe0144610 2024-04-23T18:23:06.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbe5000640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbbe006c020 0x7fbbe01659b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58726/0 (socket says 172.21.15.28:58726) 2024-04-23T18:23:06.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbe5000640 1 -- 172.21.15.28:0/2091328559 learned_addr learned my addr 172.21.15.28:0/2091328559 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:06.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbd7400640 1 --2- 172.21.15.28:0/2091328559 >> v2:172.21.15.137:3300/0 conn(0x7fbbe0144610 0x7fbbe015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbdf400640 1 -- 172.21.15.28:0/2091328559 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200650501 0 0) 0x7fbbe015e9b0 con 0x7fbbe006c020 2024-04-23T18:23:06.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbdf400640 1 -- 172.21.15.28:0/2091328559 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbc4003530 con 0x7fbbe006c020 2024-04-23T18:23:06.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbdf400640 1 -- 172.21.15.28:0/2091328559 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2766678429 0 0) 0x7fbbe015ec90 con 0x7fbbe006bc40 2024-04-23T18:23:06.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbdf400640 1 -- 172.21.15.28:0/2091328559 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbe015e9b0 con 0x7fbbe006bc40 2024-04-23T18:23:06.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbd7400640 1 -- 172.21.15.28:0/2091328559 >> v1:172.21.15.137:6789/0 conn(0x7fbbe006bc40 legacy=0x7fbbe0143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbdf400640 1 -- 172.21.15.28:0/2091328559 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 651382670 0 0) 0x7fbbc4003530 con 0x7fbbe006c020 2024-04-23T18:23:06.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbd7400640 1 -- 172.21.15.28:0/2091328559 >> v1:172.21.15.28:6789/0 conn(0x7fbbe006c020 legacy=0x7fbbe01659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.948+0000 7fbbd7400640 1 -- 172.21.15.28:0/2091328559 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe015f250 con 0x7fbbe0144610 2024-04-23T18:23:06.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbd7400640 1 --2- 172.21.15.28:0/2091328559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0144610 0x7fbbe015b660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80097c0 tx=0x7fbbc801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c02a9807583259f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:06.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbdf400640 1 -- 172.21.15.28:0/2091328559 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80b0070 con 0x7fbbe0144610 2024-04-23T18:23:06.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbdf400640 1 -- 172.21.15.28:0/2091328559 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc80ab400 con 0x7fbbe0144610 2024-04-23T18:23:06.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbdf400640 1 -- 172.21.15.28:0/2091328559 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8001a00 con 0x7fbbe0144610 2024-04-23T18:23:06.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2091328559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0144610 msgr2=0x7fbbe015b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 --2- 172.21.15.28:0/2091328559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0144610 0x7fbbe015b660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80097c0 tx=0x7fbbc801c3c0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2091328559 shutdown_connections 2024-04-23T18:23:06.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 --2- 172.21.15.28:0/2091328559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0144610 0x7fbbe015b660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2091328559 >> 172.21.15.28:0/2091328559 conn(0x7fbbe00ce7e0 msgr2=0x7fbbe00cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:06.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2091328559 shutdown_connections 2024-04-23T18:23:06.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2091328559 wait complete. 2024-04-23T18:23:06.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 Processor -- start 2024-04-23T18:23:06.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 -- start start 2024-04-23T18:23:06.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbe006bc40 0x7fbbe01f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbe006c020 0x7fbbe015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0144610 0x7fbbe0141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe006c6d0 con 0x7fbbe006bc40 2024-04-23T18:23:06.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe006c550 con 0x7fbbe0144610 2024-04-23T18:23:06.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.952+0000 7fbbe5a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe015bba0 con 0x7fbbe006c020 2024-04-23T18:23:06.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbd7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbe006c020 0x7fbbe015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbdfe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbe006bc40 0x7fbbe01f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbd7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbe006c020 0x7fbbe015c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:43302/0 (socket says 172.21.15.28:43302) 2024-04-23T18:23:06.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbd7400640 1 -- 172.21.15.28:0/2421629075 learned_addr learned my addr 172.21.15.28:0/2421629075 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:06.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbe5000640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0144610 0x7fbbe0141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbdfe00640 1 -- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbe006c020 msgr2=0x7fbbe015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbdfe00640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbe006c020 0x7fbbe015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbdfe00640 1 -- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0144610 msgr2=0x7fbbe0141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:06.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbdfe00640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0144610 0x7fbbe0141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:06.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbdfe00640 1 -- 172.21.15.28:0/2421629075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe013f350 con 0x7fbbe006bc40 2024-04-23T18:23:06.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbd7400640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbe006c020 0x7fbbe015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:06.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbdfe00640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbe006bc40 0x7fbbe01f8280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000c460 tx=0x7fbbd000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:06.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbdcc00640 1 -- 172.21.15.28:0/2421629075 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0017070 con 0x7fbbe006bc40 2024-04-23T18:23:06.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbdcc00640 1 -- 172.21.15.28:0/2421629075 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd00052d0 con 0x7fbbe006bc40 2024-04-23T18:23:06.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2421629075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe013f630 con 0x7fbbe006bc40 2024-04-23T18:23:06.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbdcc00640 1 -- 172.21.15.28:0/2421629075 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0003840 con 0x7fbbe006bc40 2024-04-23T18:23:06.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2421629075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe013fbf0 con 0x7fbbe006bc40 2024-04-23T18:23:06.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2421629075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe013fe30 con 0x7fbbe006bc40 2024-04-23T18:23:06.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.956+0000 7fbbdcc00640 1 -- 172.21.15.28:0/2421629075 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbbd001a070 con 0x7fbbe006bc40 2024-04-23T18:23:06.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.960+0000 7fbbdcc00640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbbc068380 0x7fbbbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:06.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.960+0000 7fbbdcc00640 1 -- 172.21.15.28:0/2421629075 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbbd00861c0 con 0x7fbbe006bc40 2024-04-23T18:23:06.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.960+0000 7fbbd7400640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbbc068380 0x7fbbbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:06.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.960+0000 7fbbd7400640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbbc068380 0x7fbbbc06a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80097c0 tx=0x7fbbc80a6000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:06.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:06.964+0000 7fbbdcc00640 1 -- 172.21.15.28:0/2421629075 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbbe013fe30 con 0x7fbbe006bc40 2024-04-23T18:23:07.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2421629075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbbe0068cd0 con 0x7fbbe006bc40 2024-04-23T18:23:07.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbdcc00640 1 -- 172.21.15.28:0/2421629075 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fbbd0005480 con 0x7fbbe006bc40 2024-04-23T18:23:07.120 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbbc068380 msgr2=0x7fbbbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbbc068380 0x7fbbbc06a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80097c0 tx=0x7fbbc80a6000 comp rx=0 tx=0).stop 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2421629075 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbe006bc40 msgr2=0x7fbbe01f8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbe006bc40 0x7fbbe01f8280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000c460 tx=0x7fbbd000c920 comp rx=0 tx=0).stop 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2421629075 shutdown_connections 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbbc068380 0x7fbbbc06a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbe006c020 0x7fbbe015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbe0144610 0x7fbbe0141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 --2- 172.21.15.28:0/2421629075 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbe006bc40 0x7fbbe01f8280 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2421629075 >> 172.21.15.28:0/2421629075 conn(0x7fbbe00ce7e0 msgr2=0x7fbbe00c9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2421629075 shutdown_connections 2024-04-23T18:23:07.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.128+0000 7fbbe5a00640 1 -- 172.21.15.28:0/2421629075 wait complete. 2024-04-23T18:23:07.141 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T18:23:07.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f9ce00640 1 Processor -- start 2024-04-23T18:23:07.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f9ce00640 1 -- start start 2024-04-23T18:23:07.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f9ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f9814f8d0 0x7f7f98158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f9ce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7f98073050 0x7f7f980c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f9ce00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f98073520 con 0x7f7f980c9e50 2024-04-23T18:23:07.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f9ce00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7f98073da0 con 0x7f7f98073050 2024-04-23T18:23:07.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f9ce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7f980737e0 con 0x7f7f9814f8d0 2024-04-23T18:23:07.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f96800640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7f980c9e50 0x7f7f980c7230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58734/0 (socket says 172.21.15.28:58734) 2024-04-23T18:23:07.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f96800640 1 -- 172.21.15.28:0/3317636902 learned_addr learned my addr 172.21.15.28:0/3317636902 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:07.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f95e00640 1 --2- 172.21.15.28:0/3317636902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f9814f8d0 0x7f7f98158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f95400640 1 --2- 172.21.15.28:0/3317636902 >> v2:172.21.15.137:3300/0 conn(0x7f7f98073050 0x7f7f980c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f94a00640 1 -- 172.21.15.28:0/3317636902 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180383269 0 0) 0x7f7f98073520 con 0x7f7f980c9e50 2024-04-23T18:23:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f94a00640 1 -- 172.21.15.28:0/3317636902 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f7c003530 con 0x7f7f980c9e50 2024-04-23T18:23:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f95e00640 1 -- 172.21.15.28:0/3317636902 >> v2:172.21.15.137:3300/0 conn(0x7f7f98073050 msgr2=0x7f7f980c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f95e00640 1 --2- 172.21.15.28:0/3317636902 >> v2:172.21.15.137:3300/0 conn(0x7f7f98073050 0x7f7f980c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f95e00640 1 -- 172.21.15.28:0/3317636902 >> v1:172.21.15.28:6789/0 conn(0x7f7f980c9e50 legacy=0x7f7f980c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.292+0000 7f7f95e00640 1 -- 172.21.15.28:0/3317636902 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f98073ac0 con 0x7f7f9814f8d0 2024-04-23T18:23:07.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f95e00640 1 --2- 172.21.15.28:0/3317636902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f9814f8d0 0x7f7f98158ee0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f880097c0 tx=0x7f7f8801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e4fc4a6f4e637 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:07.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f94a00640 1 -- 172.21.15.28:0/3317636902 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f880ab600 con 0x7f7f9814f8d0 2024-04-23T18:23:07.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f94a00640 1 -- 172.21.15.28:0/3317636902 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f880b0070 con 0x7f7f9814f8d0 2024-04-23T18:23:07.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f94a00640 1 -- 172.21.15.28:0/3317636902 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f880ab9a0 con 0x7f7f9814f8d0 2024-04-23T18:23:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3317636902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f9814f8d0 msgr2=0x7f7f98158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f9ce00640 1 --2- 172.21.15.28:0/3317636902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f9814f8d0 0x7f7f98158ee0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f880097c0 tx=0x7f7f8801c3e0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3317636902 shutdown_connections 2024-04-23T18:23:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f9ce00640 1 --2- 172.21.15.28:0/3317636902 >> v2:172.21.15.137:3300/0 conn(0x7f7f98073050 0x7f7f980c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f9ce00640 1 --2- 172.21.15.28:0/3317636902 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f9814f8d0 0x7f7f98158ee0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3317636902 >> 172.21.15.28:0/3317636902 conn(0x7f7f980c9330 msgr2=0x7f7f980c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3317636902 shutdown_connections 2024-04-23T18:23:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.296+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3317636902 wait complete. 2024-04-23T18:23:07.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f9ce00640 1 Processor -- start 2024-04-23T18:23:07.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f9ce00640 1 -- start start 2024-04-23T18:23:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f9ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f98073050 0x7f7f980cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f9ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f980c9e50 0x7f7f98145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f9ce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9814f8d0 0x7f7f981456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f9ce00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7f980c7940 con 0x7f7f9814f8d0 2024-04-23T18:23:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f9ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9814fcb0 con 0x7f7f980c9e50 2024-04-23T18:23:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f9ce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f7f980c7ac0 con 0x7f7f98073050 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f96800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9814f8d0 0x7f7f981456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f96800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9814f8d0 0x7f7f981456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41388/0 (socket says 172.21.15.28:41388) 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f96800640 1 -- 172.21.15.28:0/3042782205 learned_addr learned my addr 172.21.15.28:0/3042782205 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f95e00640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f98073050 0x7f7f980cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f95400640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f980c9e50 0x7f7f98145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f96800640 1 -- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f98073050 msgr2=0x7f7f980cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f96800640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f98073050 0x7f7f980cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f96800640 1 -- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f980c9e50 msgr2=0x7f7f98145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f96800640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f980c9e50 0x7f7f98145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f96800640 1 -- 172.21.15.28:0/3042782205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f98147b10 con 0x7f7f9814f8d0 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f96800640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9814f8d0 0x7f7f981456c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000caa0 tx=0x7f7f9000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f8e000640 1 -- 172.21.15.28:0/3042782205 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90017070 con 0x7f7f9814f8d0 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f8e000640 1 -- 172.21.15.28:0/3042782205 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9000ac00 con 0x7f7f9814f8d0 2024-04-23T18:23:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3042782205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f98153a10 con 0x7f7f9814f8d0 2024-04-23T18:23:07.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f8e000640 1 -- 172.21.15.28:0/3042782205 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90012400 con 0x7f7f9814f8d0 2024-04-23T18:23:07.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3042782205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f98148090 con 0x7f7f9814f8d0 2024-04-23T18:23:07.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.300+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3042782205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f98068db0 con 0x7f7f9814f8d0 2024-04-23T18:23:07.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.304+0000 7f7f8e000640 1 -- 172.21.15.28:0/3042782205 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7f9001a070 con 0x7f7f9814f8d0 2024-04-23T18:23:07.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.304+0000 7f7f8e000640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7f780683b0 0x7f7f7806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.304+0000 7f7f8e000640 1 -- 172.21.15.28:0/3042782205 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7f900868e0 con 0x7f7f9814f8d0 2024-04-23T18:23:07.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.304+0000 7f7f95e00640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7f780683b0 0x7f7f7806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.304+0000 7f7f95e00640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7f780683b0 0x7f7f7806a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f880af000 tx=0x7f7f880b6040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:07.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.308+0000 7f7f8e000640 1 -- 172.21.15.28:0/3042782205 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7f90056510 con 0x7f7f9814f8d0 2024-04-23T18:23:07.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.472+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3042782205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7f980c9710 con 0x7f7f9814f8d0 2024-04-23T18:23:07.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.472+0000 7f7f8e000640 1 -- 172.21.15.28:0/3042782205 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f7f9005a810 con 0x7f7f9814f8d0 2024-04-23T18:23:07.467 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:23:07.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7f780683b0 msgr2=0x7f7f7806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7f780683b0 0x7f7f7806a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f880af000 tx=0x7f7f880b6040 comp rx=0 tx=0).stop 2024-04-23T18:23:07.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3042782205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9814f8d0 msgr2=0x7f7f981456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9814f8d0 0x7f7f981456c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000caa0 tx=0x7f7f9000cf60 comp rx=0 tx=0).stop 2024-04-23T18:23:07.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3042782205 shutdown_connections 2024-04-23T18:23:07.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7f780683b0 0x7f7f7806a870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9814f8d0 0x7f7f981456c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f980c9e50 0x7f7f98145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 --2- 172.21.15.28:0/3042782205 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f98073050 0x7f7f980cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3042782205 >> 172.21.15.28:0/3042782205 conn(0x7f7f980c9330 msgr2=0x7f7f9806e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:07.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3042782205 shutdown_connections 2024-04-23T18:23:07.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.476+0000 7f7f9ce00640 1 -- 172.21.15.28:0/3042782205 wait complete. 2024-04-23T18:23:07.489 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T18:23:07.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fe5600640 1 Processor -- start 2024-04-23T18:23:07.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fe5600640 1 -- start start 2024-04-23T18:23:07.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fe5600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4fe00c9e50 0x7f4fe015bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fe5600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe015b520 con 0x7f4fe0152100 2024-04-23T18:23:07.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fe5600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe0071d40 con 0x7f4fe00c8d50 2024-04-23T18:23:07.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fe5600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4fe0072020 con 0x7f4fe00c9e50 2024-04-23T18:23:07.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fdea00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4fe0152100 0x7f4fe0072300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58748/0 (socket says 172.21.15.28:58748) 2024-04-23T18:23:07.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fdea00640 1 -- 172.21.15.28:0/1405118862 learned_addr learned my addr 172.21.15.28:0/1405118862 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:07.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fd6000640 1 --2- 172.21.15.28:0/1405118862 >> v2:172.21.15.137:3300/0 conn(0x7f4fe00c9e50 0x7f4fe015bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320433095 0 0) 0x7f4fe015b520 con 0x7f4fe0152100 2024-04-23T18:23:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc4005740 con 0x7f4fe0152100 2024-04-23T18:23:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374636211 0 0) 0x7f4fe0071d40 con 0x7f4fe00c8d50 2024-04-23T18:23:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe015b520 con 0x7f4fe00c8d50 2024-04-23T18:23:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2045390970 0 0) 0x7f4fc4005740 con 0x7f4fe0152100 2024-04-23T18:23:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 >> v2:172.21.15.137:3300/0 conn(0x7f4fe00c9e50 msgr2=0x7f4fe015bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fde000640 1 --2- 172.21.15.28:0/1405118862 >> v2:172.21.15.137:3300/0 conn(0x7f4fe00c9e50 0x7f4fe015bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 >> v1:172.21.15.137:6789/0 conn(0x7f4fe00c8d50 legacy=0x7f4fe0070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe015b7c0 con 0x7f4fe0152100 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.640+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f4fd0001680 con 0x7f4fe0152100 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 >> v1:172.21.15.28:6789/0 conn(0x7f4fe0152100 legacy=0x7f4fe0072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fde000640 1 --2- 172.21.15.28:0/1405118862 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 0x7f4fc4006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fde000640 1 --2- 172.21.15.28:0/1405118862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fc4006a20 0x7f4fc4006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fde000640 1 --2- 172.21.15.28:0/1405118862 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fc40073e0 0x7f4fc400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe0072020 con 0x7f4fc4005d60 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc400e200 con 0x7f4fc4006a20 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc400e400 con 0x7f4fc40073e0 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fdea00640 1 --2- 172.21.15.28:0/1405118862 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 0x7f4fc4006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fd6000640 1 --2- 172.21.15.28:0/1405118862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fc4006a20 0x7f4fc4006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fdf400640 1 --2- 172.21.15.28:0/1405118862 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fc40073e0 0x7f4fc400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fdea00640 1 -- 172.21.15.28:0/1405118862 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fc40073e0 msgr2=0x7f4fc400dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fdea00640 1 --2- 172.21.15.28:0/1405118862 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fc40073e0 0x7f4fc400dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fdea00640 1 -- 172.21.15.28:0/1405118862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fc4006a20 msgr2=0x7f4fc4006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:07.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fdea00640 1 --2- 172.21.15.28:0/1405118862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fc4006a20 0x7f4fc4006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fdea00640 1 -- 172.21.15.28:0/1405118862 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc4005740 con 0x7f4fc4005d60 2024-04-23T18:23:07.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fdf400640 1 -- 172.21.15.28:0/1405118862 reap_dead start 2024-04-23T18:23:07.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fdea00640 1 --2- 172.21.15.28:0/1405118862 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 0x7f4fc4006180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c190 tx=0x7f4fd001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a0d329b48f399 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:07.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0007cd0 con 0x7f4fc4005d60 2024-04-23T18:23:07.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd00a9020 con 0x7f4fc4005d60 2024-04-23T18:23:07.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.644+0000 7f4fde000640 1 -- 172.21.15.28:0/1405118862 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00a5b20 con 0x7f4fc4005d60 2024-04-23T18:23:07.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 -- 172.21.15.28:0/1405118862 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 msgr2=0x7f4fc4006180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 --2- 172.21.15.28:0/1405118862 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 0x7f4fc4006180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c190 tx=0x7f4fd001cc20 comp rx=0 tx=0).stop 2024-04-23T18:23:07.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 -- 172.21.15.28:0/1405118862 shutdown_connections 2024-04-23T18:23:07.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 --2- 172.21.15.28:0/1405118862 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 0x7f4fc4006180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 -- 172.21.15.28:0/1405118862 >> 172.21.15.28:0/1405118862 conn(0x7f4fe00c9330 msgr2=0x7f4fe00c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:07.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 -- 172.21.15.28:0/1405118862 shutdown_connections 2024-04-23T18:23:07.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 -- 172.21.15.28:0/1405118862 wait complete. 2024-04-23T18:23:07.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 Processor -- start 2024-04-23T18:23:07.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 -- start start 2024-04-23T18:23:07.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 0x7f4fe01f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fe014cf70 0x7f4fe00c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fe014d390 0x7f4fe00c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe015c140 con 0x7f4fc4005d60 2024-04-23T18:23:07.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe015bfc0 con 0x7f4fe014d390 2024-04-23T18:23:07.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fe5600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe015c2c0 con 0x7f4fe014cf70 2024-04-23T18:23:07.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fdea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 0x7f4fe01f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fdea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 0x7f4fe01f13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41410/0 (socket says 172.21.15.28:41410) 2024-04-23T18:23:07.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fdea00640 1 -- 172.21.15.28:0/2002781451 learned_addr learned my addr 172.21.15.28:0/2002781451 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:07.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fd6000640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fe014cf70 0x7f4fe00c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fdf400640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fe014d390 0x7f4fe00c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fdea00640 1 -- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fe014cf70 msgr2=0x7f4fe00c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fdea00640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fe014cf70 0x7f4fe00c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fdea00640 1 -- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fe014d390 msgr2=0x7f4fe00c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fdea00640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fe014d390 0x7f4fe00c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fdea00640 1 -- 172.21.15.28:0/2002781451 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe014ec30 con 0x7f4fc4005d60 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fd6000640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fe014cf70 0x7f4fe00c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.648+0000 7f4fdea00640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 0x7f4fe01f13f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c190 tx=0x7f4fc4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.652+0000 7f4fd7400640 1 -- 172.21.15.28:0/2002781451 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00049f0 con 0x7f4fc4005d60 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.652+0000 7f4fd7400640 1 -- 172.21.15.28:0/2002781451 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd0004b90 con 0x7f4fc4005d60 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.652+0000 7f4fd7400640 1 -- 172.21.15.28:0/2002781451 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00070d0 con 0x7f4fc4005d60 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.652+0000 7f4fe5600640 1 -- 172.21.15.28:0/2002781451 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe014eef0 con 0x7f4fc4005d60 2024-04-23T18:23:07.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.652+0000 7f4fe5600640 1 -- 172.21.15.28:0/2002781451 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe00cb7d0 con 0x7f4fc4005d60 2024-04-23T18:23:07.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.652+0000 7f4fe5600640 1 -- 172.21.15.28:0/2002781451 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe0072a60 con 0x7f4fc4005d60 2024-04-23T18:23:07.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.652+0000 7f4fd7400640 1 -- 172.21.15.28:0/2002781451 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4fd0007270 con 0x7f4fc4005d60 2024-04-23T18:23:07.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.652+0000 7f4fd7400640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4fbc0683b0 0x7f4fbc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.652+0000 7f4fd7400640 1 -- 172.21.15.28:0/2002781451 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4fd0120780 con 0x7f4fc4005d60 2024-04-23T18:23:07.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.652+0000 7f4fd6000640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4fbc0683b0 0x7f4fbc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.656+0000 7f4fd6000640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4fbc0683b0 0x7f4fbc06a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4fe014e4f0 tx=0x7f4fc8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:07.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.656+0000 7f4fd7400640 1 -- 172.21.15.28:0/2002781451 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4fd0016930 con 0x7f4fc4005d60 2024-04-23T18:23:07.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.820+0000 7f4fe5600640 1 -- 172.21.15.28:0/2002781451 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4fe0068db0 con 0x7f4fc4005d60 2024-04-23T18:23:07.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.820+0000 7f4fd7400640 1 -- 172.21.15.28:0/2002781451 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f4fd00f08d0 con 0x7f4fc4005d60 2024-04-23T18:23:07.815 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 -- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4fbc0683b0 msgr2=0x7f4fbc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4fbc0683b0 0x7f4fbc06a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4fe014e4f0 tx=0x7f4fc8008040 comp rx=0 tx=0).stop 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 -- 172.21.15.28:0/2002781451 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 msgr2=0x7f4fe01f13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 0x7f4fe01f13f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c190 tx=0x7f4fc4007a50 comp rx=0 tx=0).stop 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 -- 172.21.15.28:0/2002781451 shutdown_connections 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4fbc0683b0 0x7f4fbc06a870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fe014cf70 0x7f4fe00c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fe014d390 0x7f4fe00c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 --2- 172.21.15.28:0/2002781451 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4fc4005d60 0x7f4fe01f13f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 -- 172.21.15.28:0/2002781451 >> 172.21.15.28:0/2002781451 conn(0x7f4fe00c9330 msgr2=0x7f4fe00c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 -- 172.21.15.28:0/2002781451 shutdown_connections 2024-04-23T18:23:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.824+0000 7f4fe5600640 1 -- 172.21.15.28:0/2002781451 wait complete. 2024-04-23T18:23:07.838 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T18:23:07.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf43e00640 1 Processor -- start 2024-04-23T18:23:07.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf43e00640 1 -- start start 2024-04-23T18:23:07.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf43e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbf44072d80 0x7fbf440ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf43e00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf440c65b0 con 0x7fbf440c98f0 2024-04-23T18:23:07.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf43e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf44153430 con 0x7fbf44153050 2024-04-23T18:23:07.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf43e00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fbf440c5ae0 con 0x7fbf44072d80 2024-04-23T18:23:07.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf3be00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbf44072d80 0x7fbf440ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf43400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbf440c98f0 0x7fbf44163700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58750/0 (socket says 172.21.15.28:58750) 2024-04-23T18:23:07.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf43400640 1 -- 172.21.15.28:0/4032182665 learned_addr learned my addr 172.21.15.28:0/4032182665 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:07.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf3be00640 1 --2- 172.21.15.28:0/4032182665 >> v2:172.21.15.28:3300/0 conn(0x7fbf44072d80 0x7fbf440ce550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41418/0 (socket says 172.21.15.28:41418) 2024-04-23T18:23:07.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf3be00640 1 -- 172.21.15.28:0/4032182665 >> v1:172.21.15.137:6789/0 conn(0x7fbf44153050 legacy=0x7fbf4415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf3be00640 1 -- 172.21.15.28:0/4032182665 >> v1:172.21.15.28:6789/0 conn(0x7fbf440c98f0 legacy=0x7fbf44163700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.988+0000 7fbf3be00640 1 -- 172.21.15.28:0/4032182665 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf440c5d10 con 0x7fbf44072d80 2024-04-23T18:23:07.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.992+0000 7fbf3be00640 1 --2- 172.21.15.28:0/4032182665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf44072d80 0x7fbf440ce550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0097c0 tx=0x7fbf2c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed3d79c109439ac server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:07.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.992+0000 7fbf42000640 1 -- 172.21.15.28:0/4032182665 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0b5070 con 0x7fbf44072d80 2024-04-23T18:23:07.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.992+0000 7fbf42000640 1 -- 172.21.15.28:0/4032182665 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c0a8990 con 0x7fbf44072d80 2024-04-23T18:23:07.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.992+0000 7fbf42000640 1 -- 172.21.15.28:0/4032182665 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0a8d60 con 0x7fbf44072d80 2024-04-23T18:23:07.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.992+0000 7fbf43e00640 1 -- 172.21.15.28:0/4032182665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf44072d80 msgr2=0x7fbf440ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.992+0000 7fbf43e00640 1 --2- 172.21.15.28:0/4032182665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf44072d80 0x7fbf440ce550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0097c0 tx=0x7fbf2c01ec90 comp rx=0 tx=0).stop 2024-04-23T18:23:07.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.992+0000 7fbf43e00640 1 -- 172.21.15.28:0/4032182665 shutdown_connections 2024-04-23T18:23:07.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.992+0000 7fbf43e00640 1 --2- 172.21.15.28:0/4032182665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf44072d80 0x7fbf440ce550 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.992+0000 7fbf43e00640 1 -- 172.21.15.28:0/4032182665 >> 172.21.15.28:0/4032182665 conn(0x7fbf44070970 msgr2=0x7fbf44070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:07.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.992+0000 7fbf43e00640 1 -- 172.21.15.28:0/4032182665 shutdown_connections 2024-04-23T18:23:07.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.992+0000 7fbf43e00640 1 -- 172.21.15.28:0/4032182665 wait complete. 2024-04-23T18:23:07.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf43e00640 1 Processor -- start 2024-04-23T18:23:07.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf43e00640 1 -- start start 2024-04-23T18:23:07.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf43e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf44072d80 0x7fbf44157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf43e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf440c98f0 0x7fbf441e7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf43e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf44153050 0x7fbf441f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf43e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbf440c62d0 con 0x7fbf440c98f0 2024-04-23T18:23:07.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf43e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4415d320 con 0x7fbf44072d80 2024-04-23T18:23:07.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf43e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbf4415c410 con 0x7fbf44153050 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf440c98f0 0x7fbf441e7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf440c98f0 0x7fbf441e7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41422/0 (socket says 172.21.15.28:41422) 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3be00640 1 -- 172.21.15.28:0/3011787614 learned_addr learned my addr 172.21.15.28:0/3011787614 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf42a00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf44072d80 0x7fbf44157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf43400640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf44153050 0x7fbf441f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3be00640 1 -- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf44153050 msgr2=0x7fbf441f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3be00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf44153050 0x7fbf441f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3be00640 1 -- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf44072d80 msgr2=0x7fbf44157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3be00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf44072d80 0x7fbf44157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3be00640 1 -- 172.21.15.28:0/3011787614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf441e2ae0 con 0x7fbf440c98f0 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf42a00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf44072d80 0x7fbf44157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3be00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf440c98f0 0x7fbf441e7b50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c01b8a0 tx=0x7fbf2c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3aa00640 1 -- 172.21.15.28:0/3011787614 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0bf070 con 0x7fbf440c98f0 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3aa00640 1 -- 172.21.15.28:0/3011787614 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c0b0920 con 0x7fbf440c98f0 2024-04-23T18:23:07.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf3aa00640 1 -- 172.21.15.28:0/3011787614 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0b5040 con 0x7fbf440c98f0 2024-04-23T18:23:07.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf43e00640 1 -- 172.21.15.28:0/3011787614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf441e2dc0 con 0x7fbf440c98f0 2024-04-23T18:23:07.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:07.996+0000 7fbf43e00640 1 -- 172.21.15.28:0/3011787614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf441e3380 con 0x7fbf440c98f0 2024-04-23T18:23:07.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.000+0000 7fbf43e00640 1 -- 172.21.15.28:0/3011787614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf440caa00 con 0x7fbf440c98f0 2024-04-23T18:23:07.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.000+0000 7fbf3aa00640 1 -- 172.21.15.28:0/3011787614 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbf2c0b0d10 con 0x7fbf440c98f0 2024-04-23T18:23:07.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.000+0000 7fbf3aa00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbf200683b0 0x7fbf2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:07.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.000+0000 7fbf3aa00640 1 -- 172.21.15.28:0/3011787614 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbf2c123760 con 0x7fbf440c98f0 2024-04-23T18:23:07.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.000+0000 7fbf42a00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbf200683b0 0x7fbf2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:07.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.000+0000 7fbf42a00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbf200683b0 0x7fbf2006a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf34001670 tx=0x7fbf34009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:07.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.004+0000 7fbf3aa00640 1 -- 172.21.15.28:0/3011787614 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbf2c0187f0 con 0x7fbf440c98f0 2024-04-23T18:23:08.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.168+0000 7fbf43e00640 1 -- 172.21.15.28:0/3011787614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbf441590f0 con 0x7fbf440c98f0 2024-04-23T18:23:08.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf3aa00640 1 -- 172.21.15.28:0/3011787614 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7fbf2c0f3940 con 0x7fbf440c98f0 2024-04-23T18:23:08.164 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:23:08.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 -- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbf200683b0 msgr2=0x7fbf2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbf200683b0 0x7fbf2006a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf34001670 tx=0x7fbf34009040 comp rx=0 tx=0).stop 2024-04-23T18:23:08.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 -- 172.21.15.28:0/3011787614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf440c98f0 msgr2=0x7fbf441e7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf440c98f0 0x7fbf441e7b50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c01b8a0 tx=0x7fbf2c01ba30 comp rx=0 tx=0).stop 2024-04-23T18:23:08.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 -- 172.21.15.28:0/3011787614 shutdown_connections 2024-04-23T18:23:08.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbf200683b0 0x7fbf2006a870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbf44153050 0x7fbf441f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf440c98f0 0x7fbf441e7b50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 --2- 172.21.15.28:0/3011787614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf44072d80 0x7fbf44157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 -- 172.21.15.28:0/3011787614 >> 172.21.15.28:0/3011787614 conn(0x7fbf44070970 msgr2=0x7fbf440ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:08.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 -- 172.21.15.28:0/3011787614 shutdown_connections 2024-04-23T18:23:08.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.172+0000 7fbf43e00640 1 -- 172.21.15.28:0/3011787614 wait complete. 2024-04-23T18:23:08.186 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:23:08.314 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-04-23T18:23:08.319+0000 7f925011a640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-23T18:23:08.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.332+0000 7ff786200640 1 Processor -- start 2024-04-23T18:23:08.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.332+0000 7ff786200640 1 -- start start 2024-04-23T18:23:08.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.332+0000 7ff786200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff78006bc40 0x7ff78015b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.332+0000 7ff786200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff78006c020 0x7ff780144070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.332+0000 7ff786200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff780073250 con 0x7ff78006c480 2024-04-23T18:23:08.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.332+0000 7ff786200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff7800707e0 con 0x7ff78006bc40 2024-04-23T18:23:08.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.332+0000 7ff786200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff780073530 con 0x7ff78006c020 2024-04-23T18:23:08.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.332+0000 7ff77fe00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff78006c480 0x7ff780070c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58760/0 (socket says 172.21.15.28:58760) 2024-04-23T18:23:08.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.332+0000 7ff77fe00640 1 -- 172.21.15.28:0/1281805847 learned_addr learned my addr 172.21.15.28:0/1281805847 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:08.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff77f400640 1 --2- 172.21.15.28:0/1281805847 >> v2:172.21.15.137:3300/0 conn(0x7ff78006bc40 0x7ff78015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff777e00640 1 --2- 172.21.15.28:0/1281805847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff78006c020 0x7ff780144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff77ea00640 1 -- 172.21.15.28:0/1281805847 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564380404 0 0) 0x7ff780073250 con 0x7ff78006c480 2024-04-23T18:23:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff77ea00640 1 -- 172.21.15.28:0/1281805847 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff764003530 con 0x7ff78006c480 2024-04-23T18:23:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff777e00640 1 -- 172.21.15.28:0/1281805847 >> v2:172.21.15.137:3300/0 conn(0x7ff78006bc40 msgr2=0x7ff78015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff777e00640 1 --2- 172.21.15.28:0/1281805847 >> v2:172.21.15.137:3300/0 conn(0x7ff78006bc40 0x7ff78015b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff777e00640 1 -- 172.21.15.28:0/1281805847 >> v1:172.21.15.28:6789/0 conn(0x7ff78006c480 legacy=0x7ff780070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff777e00640 1 -- 172.21.15.28:0/1281805847 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff780073810 con 0x7ff78006c020 2024-04-23T18:23:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff777e00640 1 --2- 172.21.15.28:0/1281805847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff78006c020 0x7ff780144070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7680097c0 tx=0x7ff76801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76d42c4c6c01b5bf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff77ea00640 1 -- 172.21.15.28:0/1281805847 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7680b1070 con 0x7ff78006c020 2024-04-23T18:23:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff77ea00640 1 -- 172.21.15.28:0/1281805847 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7680a8050 con 0x7ff78006c020 2024-04-23T18:23:08.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.336+0000 7ff77ea00640 1 -- 172.21.15.28:0/1281805847 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7680ac860 con 0x7ff78006c020 2024-04-23T18:23:08.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 -- 172.21.15.28:0/1281805847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff78006c020 msgr2=0x7ff780144070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 --2- 172.21.15.28:0/1281805847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff78006c020 0x7ff780144070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff7680097c0 tx=0x7ff76801c3e0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 -- 172.21.15.28:0/1281805847 shutdown_connections 2024-04-23T18:23:08.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 --2- 172.21.15.28:0/1281805847 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff78006c020 0x7ff780144070 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 --2- 172.21.15.28:0/1281805847 >> v2:172.21.15.137:3300/0 conn(0x7ff78006bc40 0x7ff78015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 -- 172.21.15.28:0/1281805847 >> 172.21.15.28:0/1281805847 conn(0x7ff7800ce7e0 msgr2=0x7ff7800cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:08.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 -- 172.21.15.28:0/1281805847 shutdown_connections 2024-04-23T18:23:08.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 -- 172.21.15.28:0/1281805847 wait complete. 2024-04-23T18:23:08.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 Processor -- start 2024-04-23T18:23:08.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 -- start start 2024-04-23T18:23:08.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff78006bc40 0x7ff7801408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff78006c020 0x7ff7800c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7800c6320 0x7ff7800c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff7800c9c90 con 0x7ff78006bc40 2024-04-23T18:23:08.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7800c9b10 con 0x7ff7800c6320 2024-04-23T18:23:08.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff786200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff780168220 con 0x7ff78006c020 2024-04-23T18:23:08.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff77f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff78006bc40 0x7ff7801408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff77f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff78006bc40 0x7ff7801408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41434/0 (socket says 172.21.15.28:41434) 2024-04-23T18:23:08.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff77f400640 1 -- 172.21.15.28:0/3227027590 learned_addr learned my addr 172.21.15.28:0/3227027590 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:08.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff77fe00640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7800c6320 0x7ff7800c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff777e00640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff78006c020 0x7ff7800c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff77f400640 1 -- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff78006c020 msgr2=0x7ff7800c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff77f400640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff78006c020 0x7ff7800c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff77f400640 1 -- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7800c6320 msgr2=0x7ff7800c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff77f400640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7800c6320 0x7ff7800c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.340+0000 7ff77f400640 1 -- 172.21.15.28:0/3227027590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7800cadc0 con 0x7ff78006bc40 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.344+0000 7ff77f400640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff78006bc40 0x7ff7801408b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff77000e9e0 tx=0x7ff77000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.344+0000 7ff777400640 1 -- 172.21.15.28:0/3227027590 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770017070 con 0x7ff78006bc40 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.344+0000 7ff777400640 1 -- 172.21.15.28:0/3227027590 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77000c9d0 con 0x7ff78006bc40 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.344+0000 7ff777400640 1 -- 172.21.15.28:0/3227027590 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77000cda0 con 0x7ff78006bc40 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.344+0000 7ff786200640 1 -- 172.21.15.28:0/3227027590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7801f8400 con 0x7ff78006bc40 2024-04-23T18:23:08.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.344+0000 7ff786200640 1 -- 172.21.15.28:0/3227027590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7800c8180 con 0x7ff78006bc40 2024-04-23T18:23:08.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.344+0000 7ff786200640 1 -- 172.21.15.28:0/3227027590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff780068cd0 con 0x7ff78006bc40 2024-04-23T18:23:08.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.344+0000 7ff777400640 1 -- 172.21.15.28:0/3227027590 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff77001a070 con 0x7ff78006bc40 2024-04-23T18:23:08.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.344+0000 7ff777400640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff75c0683b0 0x7ff75c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.344+0000 7ff777400640 1 -- 172.21.15.28:0/3227027590 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff770087120 con 0x7ff78006bc40 2024-04-23T18:23:08.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.344+0000 7ff777e00640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff75c0683b0 0x7ff75c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.348+0000 7ff777e00640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff75c0683b0 0x7ff75c06a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff7680ae000 tx=0x7ff768008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:08.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.348+0000 7ff777400640 1 -- 172.21.15.28:0/3227027590 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff770057300 con 0x7ff78006bc40 2024-04-23T18:23:08.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.548+0000 7ff786200640 1 -- 172.21.15.28:0/3227027590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7800c9740 con 0x7ff78006bc40 2024-04-23T18:23:08.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff777400640 1 -- 172.21.15.28:0/3227027590 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7ff770056c00 con 0x7ff78006bc40 2024-04-23T18:23:08.544 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:08.544 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:23:08.544 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:23:08.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 -- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff75c0683b0 msgr2=0x7ff75c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff75c0683b0 0x7ff75c06a870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff7680ae000 tx=0x7ff768008040 comp rx=0 tx=0).stop 2024-04-23T18:23:08.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 -- 172.21.15.28:0/3227027590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff78006bc40 msgr2=0x7ff7801408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff78006bc40 0x7ff7801408b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff77000e9e0 tx=0x7ff77000eea0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 -- 172.21.15.28:0/3227027590 shutdown_connections 2024-04-23T18:23:08.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff75c0683b0 0x7ff75c06a870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff78006c020 0x7ff7800c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7800c6320 0x7ff7800c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 --2- 172.21.15.28:0/3227027590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff78006bc40 0x7ff7801408b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 -- 172.21.15.28:0/3227027590 >> 172.21.15.28:0/3227027590 conn(0x7ff7800ce7e0 msgr2=0x7ff7800cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:08.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 -- 172.21.15.28:0/3227027590 shutdown_connections 2024-04-23T18:23:08.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.552+0000 7ff786200640 1 -- 172.21.15.28:0/3227027590 wait complete. 2024-04-23T18:23:08.565 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:23:08.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.712+0000 7f3156400640 1 Processor -- start 2024-04-23T18:23:08.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.712+0000 7f3156400640 1 -- start start 2024-04-23T18:23:08.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f3156400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3150151f90 0x7f31500718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f3156400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3150152370 0x7f31500c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f3156400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31500c9de0 con 0x7f3150072080 2024-04-23T18:23:08.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f3156400640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f31500ca080 con 0x7f3150152370 2024-04-23T18:23:08.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f3156400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3150158cf0 con 0x7f3150151f90 2024-04-23T18:23:08.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f314fe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3150152370 0x7f31500c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f314fe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3150152370 0x7f31500c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41448/0 (socket says 172.21.15.28:41448) 2024-04-23T18:23:08.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f314fe00640 1 -- 172.21.15.28:0/2016030149 learned_addr learned my addr 172.21.15.28:0/2016030149 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:08.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f314f400640 1 --2- 172.21.15.28:0/2016030149 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3150151f90 0x7f31500718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f314fe00640 1 -- 172.21.15.28:0/2016030149 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3150151f90 msgr2=0x7f31500718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:08.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f314fe00640 1 --2- 172.21.15.28:0/2016030149 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3150151f90 0x7f31500718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f314fe00640 1 -- 172.21.15.28:0/2016030149 >> v1:172.21.15.137:6789/0 conn(0x7f3150072080 legacy=0x7f315015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.716+0000 7f314fe00640 1 -- 172.21.15.28:0/2016030149 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3150157f30 con 0x7f3150152370 2024-04-23T18:23:08.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f314fe00640 1 --2- 172.21.15.28:0/2016030149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3150152370 0x7f31500c96a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3148009e50 tx=0x7f314801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827d0c09355066fe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:08.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f314ea00640 1 -- 172.21.15.28:0/2016030149 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31480b4070 con 0x7f3150152370 2024-04-23T18:23:08.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f314ea00640 1 -- 172.21.15.28:0/2016030149 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31480af400 con 0x7f3150152370 2024-04-23T18:23:08.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f314ea00640 1 -- 172.21.15.28:0/2016030149 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31480af7d0 con 0x7f3150152370 2024-04-23T18:23:08.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 -- 172.21.15.28:0/2016030149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3150152370 msgr2=0x7f31500c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 --2- 172.21.15.28:0/2016030149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3150152370 0x7f31500c96a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3148009e50 tx=0x7f314801f210 comp rx=0 tx=0).stop 2024-04-23T18:23:08.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 -- 172.21.15.28:0/2016030149 shutdown_connections 2024-04-23T18:23:08.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 --2- 172.21.15.28:0/2016030149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3150152370 0x7f31500c96a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 --2- 172.21.15.28:0/2016030149 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3150151f90 0x7f31500718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 -- 172.21.15.28:0/2016030149 >> 172.21.15.28:0/2016030149 conn(0x7f315006d0a0 msgr2=0x7f31500676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:08.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 -- 172.21.15.28:0/2016030149 shutdown_connections 2024-04-23T18:23:08.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 -- 172.21.15.28:0/2016030149 wait complete. 2024-04-23T18:23:08.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 Processor -- start 2024-04-23T18:23:08.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 -- start start 2024-04-23T18:23:08.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3150072080 0x7f315015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3150151f90 0x7f31501f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3150152370 0x7f31501f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f31501587d0 con 0x7f3150152370 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f31501584f0 con 0x7f3150151f90 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3156400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f315015baa0 con 0x7f3150072080 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f314fe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3150152370 0x7f31501f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f314fe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3150152370 0x7f31501f4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41450/0 (socket says 172.21.15.28:41450) 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f314fe00640 1 -- 172.21.15.28:0/1576237155 learned_addr learned my addr 172.21.15.28:0/1576237155 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f314f400640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3150072080 0x7f315015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.720+0000 7f3147e00640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3150151f90 0x7f31501f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f314fe00640 1 -- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3150072080 msgr2=0x7f315015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f314fe00640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3150072080 0x7f315015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f314fe00640 1 -- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3150151f90 msgr2=0x7f31501f0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f314fe00640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3150151f90 0x7f31501f0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f314fe00640 1 -- 172.21.15.28:0/1576237155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31500c8080 con 0x7f3150152370 2024-04-23T18:23:08.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f3147e00640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3150151f90 0x7f31501f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:08.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f314fe00640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3150152370 0x7f31501f4250 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f314801ce40 tx=0x7f314801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:08.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f3147400640 1 -- 172.21.15.28:0/1576237155 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31480b4040 con 0x7f3150152370 2024-04-23T18:23:08.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f3147400640 1 -- 172.21.15.28:0/1576237155 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31480090d0 con 0x7f3150152370 2024-04-23T18:23:08.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f3147400640 1 -- 172.21.15.28:0/1576237155 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148009510 con 0x7f3150152370 2024-04-23T18:23:08.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f3156400640 1 -- 172.21.15.28:0/1576237155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315014b530 con 0x7f3150152370 2024-04-23T18:23:08.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f3156400640 1 -- 172.21.15.28:0/1576237155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31501528c0 con 0x7f3150152370 2024-04-23T18:23:08.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f3156400640 1 -- 172.21.15.28:0/1576237155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3150068cd0 con 0x7f3150152370 2024-04-23T18:23:08.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.724+0000 7f3147400640 1 -- 172.21.15.28:0/1576237155 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31480c3020 con 0x7f3150152370 2024-04-23T18:23:08.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.728+0000 7f3147400640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f312c0683b0 0x7f312c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:08.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.728+0000 7f3147400640 1 -- 172.21.15.28:0/1576237155 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f31481246c0 con 0x7f3150152370 2024-04-23T18:23:08.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.728+0000 7f314f400640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f312c0683b0 0x7f312c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:08.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.728+0000 7f314f400640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f312c0683b0 0x7f312c06a870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3140009b60 tx=0x7f3140009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:08.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.732+0000 7f3147400640 1 -- 172.21.15.28:0/1576237155 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31480ca020 con 0x7f3150152370 2024-04-23T18:23:08.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.896+0000 7f3156400640 1 -- 172.21.15.28:0/1576237155 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3150150fd0 con 0x7f3150152370 2024-04-23T18:23:08.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.896+0000 7f3147400640 1 -- 172.21.15.28:0/1576237155 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f3148018d70 con 0x7f3150152370 2024-04-23T18:23:08.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:08.891 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":24,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:22:37.816232+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:23:08.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 -- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f312c0683b0 msgr2=0x7f312c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f312c0683b0 0x7f312c06a870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3140009b60 tx=0x7f3140009190 comp rx=0 tx=0).stop 2024-04-23T18:23:08.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 -- 172.21.15.28:0/1576237155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3150152370 msgr2=0x7f31501f4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:08.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3150152370 0x7f31501f4250 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f314801ce40 tx=0x7f314801bfb0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 -- 172.21.15.28:0/1576237155 shutdown_connections 2024-04-23T18:23:08.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f312c0683b0 0x7f312c06a870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3150152370 0x7f31501f4250 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3150151f90 0x7f31501f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 --2- 172.21.15.28:0/1576237155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3150072080 0x7f315015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:08.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 -- 172.21.15.28:0/1576237155 >> 172.21.15.28:0/1576237155 conn(0x7f315006d0a0 msgr2=0x7f3150072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:08.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 -- 172.21.15.28:0/1576237155 shutdown_connections 2024-04-23T18:23:08.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:08.900+0000 7f3156400640 1 -- 172.21.15.28:0/1576237155 wait complete. 2024-04-23T18:23:08.913 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:23:09.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.060+0000 7fb1eb000640 1 Processor -- start 2024-04-23T18:23:09.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.060+0000 7fb1eb000640 1 -- start start 2024-04-23T18:23:09.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.060+0000 7fb1eb000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb1e41531a0 0x7fb1e40c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:09.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.060+0000 7fb1eb000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb1e40c9a00 0x7fb1e4158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:09.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.060+0000 7fb1eb000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e40c3bc0 con 0x7fb1e40c9e70 2024-04-23T18:23:09.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.060+0000 7fb1eb000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e40c4940 con 0x7fb1e41531a0 2024-04-23T18:23:09.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.060+0000 7fb1eb000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e40c6790 con 0x7fb1e40c9a00 2024-04-23T18:23:09.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb1e41531a0 0x7fb1e40c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:09.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb1e41531a0 0x7fb1e40c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55804/0 (socket says 172.21.15.28:55804) 2024-04-23T18:23:09.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e9000640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb1e40c9e70 0x7fb1e4072f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60756/0 (socket says 172.21.15.28:60756) 2024-04-23T18:23:09.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3e00640 1 -- 172.21.15.28:0/1647539741 learned_addr learned my addr 172.21.15.28:0/1647539741 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:09.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1dbe00640 1 --2- 172.21.15.28:0/1647539741 >> v2:172.21.15.137:3300/0 conn(0x7fb1e40c9a00 0x7fb1e4158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:09.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3e00640 1 -- 172.21.15.28:0/1647539741 >> v2:172.21.15.137:3300/0 conn(0x7fb1e40c9a00 msgr2=0x7fb1e4158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:09.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3e00640 1 --2- 172.21.15.28:0/1647539741 >> v2:172.21.15.137:3300/0 conn(0x7fb1e40c9a00 0x7fb1e4158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:09.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3e00640 1 -- 172.21.15.28:0/1647539741 >> v1:172.21.15.28:6789/0 conn(0x7fb1e40c9e70 legacy=0x7fb1e4072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:09.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3e00640 1 -- 172.21.15.28:0/1647539741 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e40c6a70 con 0x7fb1e41531a0 2024-04-23T18:23:09.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3400640 1 -- 172.21.15.28:0/1647539741 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3520816855 0 0) 0x7fb1e40c3bc0 con 0x7fb1e40c9e70 2024-04-23T18:23:09.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3e00640 1 --2- 172.21.15.28:0/1647539741 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1e41531a0 0x7fb1e40c5ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40cd760 tx=0x7fb1d401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdc38032655d419 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:09.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3400640 1 -- 172.21.15.28:0/1647539741 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40b5070 con 0x7fb1e41531a0 2024-04-23T18:23:09.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3400640 1 -- 172.21.15.28:0/1647539741 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d40a8a10 con 0x7fb1e41531a0 2024-04-23T18:23:09.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.064+0000 7fb1e3400640 1 -- 172.21.15.28:0/1647539741 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40a8de0 con 0x7fb1e41531a0 2024-04-23T18:23:09.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 -- 172.21.15.28:0/1647539741 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1e41531a0 msgr2=0x7fb1e40c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:09.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 --2- 172.21.15.28:0/1647539741 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1e41531a0 0x7fb1e40c5ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40cd760 tx=0x7fb1d401ed10 comp rx=0 tx=0).stop 2024-04-23T18:23:09.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 -- 172.21.15.28:0/1647539741 shutdown_connections 2024-04-23T18:23:09.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 --2- 172.21.15.28:0/1647539741 >> v2:172.21.15.137:3300/0 conn(0x7fb1e40c9a00 0x7fb1e4158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:09.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 --2- 172.21.15.28:0/1647539741 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1e41531a0 0x7fb1e40c5ec0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:09.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 -- 172.21.15.28:0/1647539741 >> 172.21.15.28:0/1647539741 conn(0x7fb1e406d0a0 msgr2=0x7fb1e40676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:09.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 -- 172.21.15.28:0/1647539741 shutdown_connections 2024-04-23T18:23:09.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 -- 172.21.15.28:0/1647539741 wait complete. 2024-04-23T18:23:09.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 Processor -- start 2024-04-23T18:23:09.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 -- start start 2024-04-23T18:23:09.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1e40c9a00 0x7fb1e41f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:09.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1e41531a0 0x7fb1e4138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:09.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e41f4e40 0x7fb1e4141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:09.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e40c4420 con 0x7fb1e40c9a00 2024-04-23T18:23:09.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e40c4140 con 0x7fb1e41f4e40 2024-04-23T18:23:09.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1eb000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e4153580 con 0x7fb1e41531a0 2024-04-23T18:23:09.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1e3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1e40c9a00 0x7fb1e41f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:09.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1e3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1e40c9a00 0x7fb1e41f0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55808/0 (socket says 172.21.15.28:55808) 2024-04-23T18:23:09.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1e3e00640 1 -- 172.21.15.28:0/3351385810 learned_addr learned my addr 172.21.15.28:0/3351385810 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:09.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1e9000640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e41f4e40 0x7fb1e4141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:09.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1dbe00640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1e41531a0 0x7fb1e4138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:09.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1e3e00640 1 -- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1e41531a0 msgr2=0x7fb1e4138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:09.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1e3e00640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1e41531a0 0x7fb1e4138970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:09.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1e3e00640 1 -- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e41f4e40 msgr2=0x7fb1e4141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:09.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1e3e00640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e41f4e40 0x7fb1e4141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:09.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.068+0000 7fb1e3e00640 1 -- 172.21.15.28:0/3351385810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e41e4ba0 con 0x7fb1e40c9a00 2024-04-23T18:23:09.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.072+0000 7fb1e3e00640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1e40c9a00 0x7fb1e41f0c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb1d401c940 tx=0x7fb1d401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:09.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.072+0000 7fb1e0c00640 1 -- 172.21.15.28:0/3351385810 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40b5070 con 0x7fb1e40c9a00 2024-04-23T18:23:09.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.072+0000 7fb1e0c00640 1 -- 172.21.15.28:0/3351385810 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d40b0a30 con 0x7fb1e40c9a00 2024-04-23T18:23:09.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.072+0000 7fb1eb000640 1 -- 172.21.15.28:0/3351385810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e41f4360 con 0x7fb1e40c9a00 2024-04-23T18:23:09.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.072+0000 7fb1e0c00640 1 -- 172.21.15.28:0/3351385810 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40b0e20 con 0x7fb1e40c9a00 2024-04-23T18:23:09.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.072+0000 7fb1eb000640 1 -- 172.21.15.28:0/3351385810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e41f4920 con 0x7fb1e40c9a00 2024-04-23T18:23:09.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.072+0000 7fb1eb000640 1 -- 172.21.15.28:0/3351385810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e4068cd0 con 0x7fb1e40c9a00 2024-04-23T18:23:09.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.072+0000 7fb1e0c00640 1 -- 172.21.15.28:0/3351385810 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb1d40b9030 con 0x7fb1e40c9a00 2024-04-23T18:23:09.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.072+0000 7fb1e0c00640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb1c00683b0 0x7fb1c006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:09.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.072+0000 7fb1e0c00640 1 -- 172.21.15.28:0/3351385810 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb1d4123ea0 con 0x7fb1e40c9a00 2024-04-23T18:23:09.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.072+0000 7fb1dbe00640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb1c00683b0 0x7fb1c006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:09.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.076+0000 7fb1dbe00640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb1c00683b0 0x7fb1c006a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb1e41e46d0 tx=0x7fb1cc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:09.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.076+0000 7fb1e0c00640 1 -- 172.21.15.28:0/3351385810 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb1d4018870 con 0x7fb1e40c9a00 2024-04-23T18:23:09.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 -- 172.21.15.28:0/3351385810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1e4068460 con 0x7fb1e40c9a00 2024-04-23T18:23:09.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1e0c00640 1 -- 172.21.15.28:0/3351385810 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7fb1d40f4000 con 0x7fb1e40c9a00 2024-04-23T18:23:09.273 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:09.274 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:23:09.274 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:23:09.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 -- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb1c00683b0 msgr2=0x7fb1c006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:09.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb1c00683b0 0x7fb1c006a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb1e41e46d0 tx=0x7fb1cc008040 comp rx=0 tx=0).stop 2024-04-23T18:23:09.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 -- 172.21.15.28:0/3351385810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1e40c9a00 msgr2=0x7fb1e41f0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:09.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1e40c9a00 0x7fb1e41f0c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb1d401c940 tx=0x7fb1d401bab0 comp rx=0 tx=0).stop 2024-04-23T18:23:09.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 -- 172.21.15.28:0/3351385810 shutdown_connections 2024-04-23T18:23:09.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb1c00683b0 0x7fb1c006a870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:09.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb1e41531a0 0x7fb1e4138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:09.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1e41f4e40 0x7fb1e4141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:09.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 --2- 172.21.15.28:0/3351385810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb1e40c9a00 0x7fb1e41f0c50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:09.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 -- 172.21.15.28:0/3351385810 >> 172.21.15.28:0/3351385810 conn(0x7fb1e406d0a0 msgr2=0x7fb1e40c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:09.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 -- 172.21.15.28:0/3351385810 shutdown_connections 2024-04-23T18:23:09.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:09.280+0000 7fb1eb000640 1 -- 172.21.15.28:0/3351385810 wait complete. 2024-04-23T18:23:09.899 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T18:22:32.759537+0000', 'modified': '2024-04-23T18:23:05.612086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4297, 'mds_1': 4294, 'mds_2': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'e', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.28:6837/1362691862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6836', 'nonce': 1362691862}, {'type': 'v1', 'addr': '172.21.15.28:6837', 'nonce': 1362691862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4294': {'gid': 4294, 'name': 'd', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.137:6838/1110609151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 1110609151}, {'type': 'v1', 'addr': '172.21.15.137:6838', 'nonce': 1110609151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.137:6839/1022932690', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6837', 'nonce': 1022932690}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 1022932690}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4297, 'qdb_cluster': [4281, 4294, 4297]} 2024-04-23T18:23:09.899 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-23T18:23:09.899 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-23T18:23:10.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.048+0000 7fd1d6600640 1 Processor -- start 2024-04-23T18:23:10.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.048+0000 7fd1d6600640 1 -- start start 2024-04-23T18:23:10.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.048+0000 7fd1d6600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1d0073590 0x7fd1d0143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.048+0000 7fd1d6600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd1d015f310 0x7fd1d0144230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.048+0000 7fd1d6600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d00cc210 con 0x7fd1d00731b0 2024-04-23T18:23:10.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.048+0000 7fd1d6600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d015c280 con 0x7fd1d015f310 2024-04-23T18:23:10.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.048+0000 7fd1d6600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d015b3f0 con 0x7fd1d0073590 2024-04-23T18:23:10.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.048+0000 7fd1cf400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd1d00731b0 0x7fd1d015ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60772/0 (socket says 172.21.15.28:60772) 2024-04-23T18:23:10.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.048+0000 7fd1cf400640 1 -- 172.21.15.28:0/2771619342 learned_addr learned my addr 172.21.15.28:0/2771619342 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:10.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.048+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/2771619342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1d0073590 0x7fd1d0143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.048+0000 7fd1cfe00640 1 --2- 172.21.15.28:0/2771619342 >> v2:172.21.15.137:3300/0 conn(0x7fd1d015f310 0x7fd1d0144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1cea00640 1 -- 172.21.15.28:0/2771619342 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219212339 0 0) 0x7fd1d00cc210 con 0x7fd1d00731b0 2024-04-23T18:23:10.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1cea00640 1 -- 172.21.15.28:0/2771619342 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b4003530 con 0x7fd1d00731b0 2024-04-23T18:23:10.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1c7e00640 1 -- 172.21.15.28:0/2771619342 >> v2:172.21.15.137:3300/0 conn(0x7fd1d015f310 msgr2=0x7fd1d0144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/2771619342 >> v2:172.21.15.137:3300/0 conn(0x7fd1d015f310 0x7fd1d0144230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1c7e00640 1 -- 172.21.15.28:0/2771619342 >> v1:172.21.15.28:6789/0 conn(0x7fd1d00731b0 legacy=0x7fd1d015ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1c7e00640 1 -- 172.21.15.28:0/2771619342 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d015b690 con 0x7fd1d0073590 2024-04-23T18:23:10.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/2771619342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1d0073590 0x7fd1d0143cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80097c0 tx=0x7fd1b801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ef71a4b45e393ec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1cea00640 1 -- 172.21.15.28:0/2771619342 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80b5070 con 0x7fd1d0073590 2024-04-23T18:23:10.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1cea00640 1 -- 172.21.15.28:0/2771619342 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b80a8990 con 0x7fd1d0073590 2024-04-23T18:23:10.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1cea00640 1 -- 172.21.15.28:0/2771619342 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80a8d40 con 0x7fd1d0073590 2024-04-23T18:23:10.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1d6600640 1 -- 172.21.15.28:0/2771619342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1d0073590 msgr2=0x7fd1d0143cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.052+0000 7fd1d6600640 1 --2- 172.21.15.28:0/2771619342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1d0073590 0x7fd1d0143cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80097c0 tx=0x7fd1b801ec90 comp rx=0 tx=0).stop 2024-04-23T18:23:10.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 -- 172.21.15.28:0/2771619342 shutdown_connections 2024-04-23T18:23:10.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 --2- 172.21.15.28:0/2771619342 >> v2:172.21.15.137:3300/0 conn(0x7fd1d015f310 0x7fd1d0144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 --2- 172.21.15.28:0/2771619342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1d0073590 0x7fd1d0143cf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 -- 172.21.15.28:0/2771619342 >> 172.21.15.28:0/2771619342 conn(0x7fd1d0070b40 msgr2=0x7fd1d0070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 -- 172.21.15.28:0/2771619342 shutdown_connections 2024-04-23T18:23:10.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 -- 172.21.15.28:0/2771619342 wait complete. 2024-04-23T18:23:10.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 Processor -- start 2024-04-23T18:23:10.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 -- start start 2024-04-23T18:23:10.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1d00731b0 0x7fd1d015db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1d0073590 0x7fd1d01562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d015f310 0x7fd1d014a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d015bf10 con 0x7fd1d015f310 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d015bc30 con 0x7fd1d00731b0 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d00c9490 con 0x7fd1d0073590 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1cfe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d015f310 0x7fd1d014a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1cfe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d015f310 0x7fd1d014a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55812/0 (socket says 172.21.15.28:55812) 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1cfe00640 1 -- 172.21.15.28:0/4144514083 learned_addr learned my addr 172.21.15.28:0/4144514083 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1d0073590 0x7fd1d01562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1cf400640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1d00731b0 0x7fd1d015db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1cfe00640 1 -- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1d0073590 msgr2=0x7fd1d01562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1cfe00640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1d0073590 0x7fd1d01562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1cfe00640 1 -- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1d00731b0 msgr2=0x7fd1d015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1cfe00640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1d00731b0 0x7fd1d015db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1cfe00640 1 -- 172.21.15.28:0/4144514083 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d00ce680 con 0x7fd1d015f310 2024-04-23T18:23:10.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1cfe00640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d015f310 0x7fd1d014a1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009dd0 tx=0x7fd1c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1c7400640 1 -- 172.21.15.28:0/4144514083 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8018020 con 0x7fd1d015f310 2024-04-23T18:23:10.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1c7400640 1 -- 172.21.15.28:0/4144514083 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c8014480 con 0x7fd1d015f310 2024-04-23T18:23:10.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.056+0000 7fd1d6600640 1 -- 172.21.15.28:0/4144514083 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d0156bb0 con 0x7fd1d015f310 2024-04-23T18:23:10.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.060+0000 7fd1c7400640 1 -- 172.21.15.28:0/4144514083 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8014870 con 0x7fd1d015f310 2024-04-23T18:23:10.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.060+0000 7fd1d6600640 1 -- 172.21.15.28:0/4144514083 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d00ced90 con 0x7fd1d015f310 2024-04-23T18:23:10.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.060+0000 7fd1c7400640 1 -- 172.21.15.28:0/4144514083 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd1c801b020 con 0x7fd1d015f310 2024-04-23T18:23:10.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.060+0000 7fd1c7400640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd1ac068380 0x7fd1ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.060+0000 7fd1c7400640 1 -- 172.21.15.28:0/4144514083 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd1c80877b0 con 0x7fd1d015f310 2024-04-23T18:23:10.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 Processor -- start 2024-04-23T18:23:10.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1cf400640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd1ac068380 0x7fd1ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 -- start start 2024-04-23T18:23:10.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5aa94570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1cf400640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd1ac068380 0x7fd1ac06a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0007fd0 tx=0x7fd1c0000bd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5aacf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5aacf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x558d5a8dd420 con 0x558d5aa94ab0 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558d5a877bf0 con 0x558d5aacf5c0 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x558d5a8d93e0 con 0x558d5aa94190 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1c7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5aacf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1c7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5aacf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55822/0 (socket says 172.21.15.28:55822) 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1c7e00640 1 -- 172.21.15.28:0/1045046287 learned_addr learned my addr 172.21.15.28:0/1045046287 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1cf400640 1 --2- 172.21.15.28:0/1045046287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5aa94570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1cfe00640 1 --2- 172.21.15.28:0/1045046287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5aacf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1c7e00640 1 -- 172.21.15.28:0/1045046287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 msgr2=0x558d5aa94570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/1045046287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5aa94570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1c7e00640 1 -- 172.21.15.28:0/1045046287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 msgr2=0x558d5aacf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/1045046287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5aacf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1c7e00640 1 -- 172.21.15.28:0/1045046287 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5a985450 con 0x558d5aa94ab0 2024-04-23T18:23:10.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/1045046287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5aacf080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80097c0 tx=0x7fd1b8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb4a8b5128f6f2e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1bfe00640 1 -- 172.21.15.28:0/1045046287 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80be070 con 0x558d5aa94ab0 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1bfe00640 1 -- 172.21.15.28:0/1045046287 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b8004380 con 0x558d5aa94ab0 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1bfe00640 1 -- 172.21.15.28:0/1045046287 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80b5040 con 0x558d5aa94ab0 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/1045046287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 msgr2=0x558d5aacf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/1045046287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5aacf080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80097c0 tx=0x7fd1b8004740 comp rx=0 tx=0).stop 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/1045046287 shutdown_connections 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/1045046287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5aacf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/1045046287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5aacf080 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/1045046287 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5aa94570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/1045046287 >> 172.21.15.28:0/1045046287 conn(0x558d5aacbe40 msgr2=0x558d5aace260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/1045046287 shutdown_connections 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/1045046287 wait complete. 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 -- start start 2024-04-23T18:23:10.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.064+0000 7fd1d9b3e000 1 Processor -- start 2024-04-23T18:23:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94190 0x558d5aa90bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94ab0 0x558d5aa91110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5aa91650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x558d5a87dec0 con 0x558d5aa94190 2024-04-23T18:23:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558d5a95e120 con 0x558d5aacf5c0 2024-04-23T18:23:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x558d5a8e8350 con 0x558d5aa94ab0 2024-04-23T18:23:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 10 client.0 _ll_register_callbacks cb 0x558d5a8ba4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:10.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1cf400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94190 0x558d5aa90bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1cf400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94190 0x558d5aa90bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55834/0 (socket says 172.21.15.28:55834) 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1cf400640 1 -- 172.21.15.28:0/184038542 learned_addr learned my addr 172.21.15.28:0/184038542 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94ab0 0x558d5aa91110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1cfe00640 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5aa91650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1cf400640 1 -- 172.21.15.28:0/184038542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94ab0 msgr2=0x558d5aa91110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1cf400640 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94ab0 0x558d5aa91110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1cf400640 1 -- 172.21.15.28:0/184038542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 msgr2=0x558d5aa91650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1cf400640 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5aa91650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1cf400640 1 -- 172.21.15.28:0/184038542 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d5a922f80 con 0x558d5aa94190 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1cfe00640 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5aa91650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1cf400640 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94190 0x558d5aa90bd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0006690 tx=0x7fd1c00010b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28f301343015905 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:10.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1bcc00640 1 -- 172.21.15.28:0/184038542 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0021410 con 0x558d5aa94190 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1bcc00640 1 -- 172.21.15.28:0/184038542 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd1c00215b0 con 0x558d5aa94190 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/184038542 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1b8004380 con 0x558d5aa94190 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1bcc00640 1 -- 172.21.15.28:0/184038542 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fd1c002e050 con 0x558d5aa94190 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 10 client.4836 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/184038542 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x558d5a8b6f00 con 0x558d5aa94190 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1bcc00640 1 -- 172.21.15.28:0/184038542 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b8004380 con 0x558d5aa94190 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1bcc00640 1 -- 172.21.15.28:0/184038542 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fd1c0031020 con 0x558d5aa94190 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 10 client.4836 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 10 client.4836 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 20 client.4836 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x558d5aae3d90 0x558d5aae6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 4 client.4836 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:23:10.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/184038542 --> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d5a876bc0 con 0x558d5aae3d90 2024-04-23T18:23:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x558d5aae3d90 0x558d5aae6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x558d5aae3d90 0x558d5aae6180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c4decdabeba99080 server_cookie=5ab662640d13008d in_seq=0 out_seq=0 2024-04-23T18:23:10.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.068+0000 7fd1bcc00640 10 client.4836 ms_handle_connect on v2:172.21.15.28:6836/1362691862 2024-04-23T18:23:10.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.616+0000 7fd1bcc00640 1 -- 172.21.15.28:0/184038542 <== mds.2 v2:172.21.15.28:6836/1362691862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558d5a876bc0 con 0x558d5aae3d90 2024-04-23T18:23:10.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.616+0000 7fd1bcc00640 10 client.4836 handle_command_reply: tid=0 2024-04-23T18:23:10.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.616+0000 7fd1d9b3e000 1 client.4836 shutdown 2024-04-23T18:23:10.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/184038542 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94190 msgr2=0x558d5aa90bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94190 0x558d5aa90bd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0006690 tx=0x7fd1c00010b0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/184038542 shutdown_connections 2024-04-23T18:23:10.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x558d5aae3d90 0x558d5aae6180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94ab0 0x558d5aa91110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5aa91650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/184038542 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94190 0x558d5aa90bd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1bcc00640 0 client.4836 ms_handle_reset on v2:172.21.15.28:6836/1362691862 2024-04-23T18:23:10.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/184038542 >> 172.21.15.28:0/184038542 conn(0x558d5aacbe40 msgr2=0x558d5aacd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/184038542 shutdown_connections 2024-04-23T18:23:10.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/184038542 wait complete. 2024-04-23T18:23:10.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.620+0000 7fd1d9b3e000 20 client.4836 trim_cache size 0 max 16384 2024-04-23T18:23:10.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1d9b3e000 1 Processor -- start 2024-04-23T18:23:10.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1d9b3e000 1 -- start start 2024-04-23T18:23:10.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5aaca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aa94ab0 0x558d5aacaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aacf5c0 0x558d5ab3b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d0150050 con 0x558d5aacf5c0 2024-04-23T18:23:10.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d01fd2b0 con 0x558d5aa94ab0 2024-04-23T18:23:10.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x558d5a8a99e0 con 0x558d5aa94190 2024-04-23T18:23:10.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1cfe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aacf5c0 0x558d5ab3b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1cf400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5aaca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1c7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aa94ab0 0x558d5aacaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1cfe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aacf5c0 0x558d5ab3b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55848/0 (socket says 172.21.15.28:55848) 2024-04-23T18:23:10.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1cfe00640 1 -- 172.21.15.28:0/582034874 learned_addr learned my addr 172.21.15.28:0/582034874 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:10.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1cfe00640 1 -- 172.21.15.28:0/582034874 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 msgr2=0x558d5aaca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1cfe00640 1 --2- 172.21.15.28:0/582034874 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5aaca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1cfe00640 1 -- 172.21.15.28:0/582034874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aa94ab0 msgr2=0x558d5aacaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1cfe00640 1 --2- 172.21.15.28:0/582034874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aa94ab0 0x558d5aacaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1cfe00640 1 -- 172.21.15.28:0/582034874 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5a863e80 con 0x558d5aacf5c0 2024-04-23T18:23:10.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1cfe00640 1 --2- 172.21.15.28:0/582034874 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aacf5c0 0x558d5ab3b2b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8085900 tx=0x7fd1c8087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81833975968de71 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1bf400640 1 -- 172.21.15.28:0/582034874 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8053920 con 0x558d5aacf5c0 2024-04-23T18:23:10.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1bf400640 1 -- 172.21.15.28:0/582034874 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c806f070 con 0x558d5aacf5c0 2024-04-23T18:23:10.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.640+0000 7fd1bf400640 1 -- 172.21.15.28:0/582034874 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c805fbe0 con 0x558d5aacf5c0 2024-04-23T18:23:10.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/582034874 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aacf5c0 msgr2=0x558d5ab3b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/582034874 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aacf5c0 0x558d5ab3b2b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8085900 tx=0x7fd1c8087040 comp rx=0 tx=0).stop 2024-04-23T18:23:10.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/582034874 shutdown_connections 2024-04-23T18:23:10.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/582034874 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aacf5c0 0x558d5ab3b2b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/582034874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aa94ab0 0x558d5aacaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/582034874 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5aaca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/582034874 >> 172.21.15.28:0/582034874 conn(0x558d5aacbe40 msgr2=0x558d5aa8dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/582034874 shutdown_connections 2024-04-23T18:23:10.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/582034874 wait complete. 2024-04-23T18:23:10.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 -- start start 2024-04-23T18:23:10.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 Processor -- start 2024-04-23T18:23:10.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5ab04d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5ab052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5ab05800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x558d5a8e1a50 con 0x558d5aa94ab0 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558d5a8dc730 con 0x558d5aacf5c0 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x558d5a8ea630 con 0x558d5aa94190 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 10 client.0 _ll_register_callbacks cb 0x7fd1c0005a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1c7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5ab052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1c7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5ab052c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55850/0 (socket says 172.21.15.28:55850) 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1c7e00640 1 -- 172.21.15.28:0/3091901165 learned_addr learned my addr 172.21.15.28:0/3091901165 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1cfe00640 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5ab05800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1cf400640 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5ab04d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1c7e00640 1 -- 172.21.15.28:0/3091901165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 msgr2=0x558d5ab04d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5ab04d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1c7e00640 1 -- 172.21.15.28:0/3091901165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 msgr2=0x558d5ab05800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5ab05800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1c7e00640 1 -- 172.21.15.28:0/3091901165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d5a8a5b30 con 0x558d5aa94ab0 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1c7e00640 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5ab052c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1b801c8c0 tx=0x7fd1b801d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86050e4153c3b6cd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1bcc00640 1 -- 172.21.15.28:0/3091901165 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80b5040 con 0x558d5aa94ab0 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1bcc00640 1 -- 172.21.15.28:0/3091901165 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd1b80c4e40 con 0x558d5aa94ab0 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.644+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/3091901165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1c806f070 con 0x558d5aa94ab0 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1bcc00640 1 -- 172.21.15.28:0/3091901165 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fd1b80be040 con 0x558d5aa94ab0 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 10 client.4842 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/3091901165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x558d5a95e5b0 con 0x558d5aa94ab0 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1bcc00640 1 -- 172.21.15.28:0/3091901165 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c806f070 con 0x558d5aa94ab0 2024-04-23T18:23:10.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1bcc00640 1 -- 172.21.15.28:0/3091901165 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fd1b8004360 con 0x558d5aa94ab0 2024-04-23T18:23:10.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 10 client.4842 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:10.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 10 client.4842 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T18:23:10.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 20 client.4842 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:10.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x558d5ab06190 0x558d5ab4cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 4 client.4842 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T18:23:10.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/3091901165 --> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] -- command(tid 0: {"prefix": "status"}) -- 0x558d5a8eae40 con 0x558d5ab06190 2024-04-23T18:23:10.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1cf400640 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x558d5ab06190 0x558d5ab4cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1cf400640 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x558d5ab06190 0x558d5ab4cc40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d17639b10bb5a782 server_cookie=8a2ae57de3d829b1 in_seq=0 out_seq=0 2024-04-23T18:23:10.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1bcc00640 10 client.4842 ms_handle_connect on v2:172.21.15.28:6836/1362691862 2024-04-23T18:23:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1bcc00640 1 -- 172.21.15.28:0/3091901165 <== mds.2 v2:172.21.15.28:6836/1362691862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x558d5a8eae40 con 0x558d5ab06190 2024-04-23T18:23:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1bcc00640 10 client.4842 handle_command_reply: tid=0 2024-04-23T18:23:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 client.4842 shutdown 2024-04-23T18:23:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/3091901165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 msgr2=0x558d5ab052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5ab052c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1b801c8c0 tx=0x7fd1b801d4d0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/3091901165 shutdown_connections 2024-04-23T18:23:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x558d5ab06190 0x558d5ab4cc40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558d5aacf5c0 0x558d5ab05800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558d5aa94ab0 0x558d5ab052c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1bcc00640 0 client.4842 ms_handle_reset on v2:172.21.15.28:6836/1362691862 2024-04-23T18:23:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 --2- 172.21.15.28:0/3091901165 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558d5aa94190 0x558d5ab04d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/3091901165 >> 172.21.15.28:0/3091901165 conn(0x558d5aacbe40 msgr2=0x558d5aac9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/3091901165 shutdown_connections 2024-04-23T18:23:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 1 -- 172.21.15.28:0/3091901165 wait complete. 2024-04-23T18:23:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d9b3e000 20 client.4842 trim_cache size 0 max 16384 2024-04-23T18:23:10.645 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:23:10.645 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "d84cc156-ceaf-4cae-a89c-ee7e55af72c5", 2024-04-23T18:23:10.646 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 2, 2024-04-23T18:23:10.646 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4281, 2024-04-23T18:23:10.646 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-04-23T18:23:10.646 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-04-23T18:23:10.646 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-04-23T18:23:10.646 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 10.061936326, 2024-04-23T18:23:10.646 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 15, 2024-04-23T18:23:10.646 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 24, 2024-04-23T18:23:10.646 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T18:23:10.646 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 44.279072919000001 2024-04-23T18:23:10.646 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:23:10.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 -- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd1ac068380 msgr2=0x7fd1ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd1ac068380 0x7fd1ac06a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0007fd0 tx=0x7fd1c0000bd0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 -- 172.21.15.28:0/4144514083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d015f310 msgr2=0x7fd1d014a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d015f310 0x7fd1d014a1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009dd0 tx=0x7fd1c800c490 comp rx=0 tx=0).stop 2024-04-23T18:23:10.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 -- 172.21.15.28:0/4144514083 shutdown_connections 2024-04-23T18:23:10.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd1ac068380 0x7fd1ac06a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd1d0073590 0x7fd1d01562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd1d015f310 0x7fd1d014a1a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 --2- 172.21.15.28:0/4144514083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1d00731b0 0x7fd1d015db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 -- 172.21.15.28:0/4144514083 >> 172.21.15.28:0/4144514083 conn(0x7fd1d0070b40 msgr2=0x7fd1d00c98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 -- 172.21.15.28:0/4144514083 shutdown_connections 2024-04-23T18:23:10.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.648+0000 7fd1d6600640 1 -- 172.21.15.28:0/4144514083 wait complete. 2024-04-23T18:23:10.664 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-23T18:23:10.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.812+0000 7f5998a00640 1 Processor -- start 2024-04-23T18:23:10.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5998a00640 1 -- start start 2024-04-23T18:23:10.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5998a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f599415d260 0x7f599415f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5998a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f599406ea00 0x7f599406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5998a00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599415b4a0 con 0x7f59940c87f0 2024-04-23T18:23:10.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5998a00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f599415f7c0 con 0x7f599406ea00 2024-04-23T18:23:10.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5998a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f599415b740 con 0x7f599415d260 2024-04-23T18:23:10.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5991e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f59940c87f0 0x7f599415cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60778/0 (socket says 172.21.15.28:60778) 2024-04-23T18:23:10.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5991e00640 1 -- 172.21.15.28:0/2930587772 learned_addr learned my addr 172.21.15.28:0/2930587772 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:10.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5992800640 1 --2- 172.21.15.28:0/2930587772 >> v2:172.21.15.28:3300/0 conn(0x7f599406ea00 0x7f599406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5989400640 1 --2- 172.21.15.28:0/2930587772 >> v2:172.21.15.137:3300/0 conn(0x7f599415d260 0x7f599415f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5991400640 1 -- 172.21.15.28:0/2930587772 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2989479399 0 0) 0x7f599415b4a0 con 0x7f59940c87f0 2024-04-23T18:23:10.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5992800640 1 -- 172.21.15.28:0/2930587772 >> v2:172.21.15.137:3300/0 conn(0x7f599415d260 msgr2=0x7f599415f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5992800640 1 --2- 172.21.15.28:0/2930587772 >> v2:172.21.15.137:3300/0 conn(0x7f599415d260 0x7f599415f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5992800640 1 -- 172.21.15.28:0/2930587772 >> v1:172.21.15.28:6789/0 conn(0x7f59940c87f0 legacy=0x7f599415cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.816+0000 7f5992800640 1 -- 172.21.15.28:0/2930587772 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599415ba20 con 0x7f599406ea00 2024-04-23T18:23:10.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5992800640 1 --2- 172.21.15.28:0/2930587772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f599406ea00 0x7f599406ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f599406ffc0 tx=0x7f598c01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85ae4b56d525af8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5991400640 1 -- 172.21.15.28:0/2930587772 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c0b4070 con 0x7f599406ea00 2024-04-23T18:23:10.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5991400640 1 -- 172.21.15.28:0/2930587772 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598c0af600 con 0x7f599406ea00 2024-04-23T18:23:10.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5991400640 1 -- 172.21.15.28:0/2930587772 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c0af9d0 con 0x7f599406ea00 2024-04-23T18:23:10.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5998a00640 1 -- 172.21.15.28:0/2930587772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f599406ea00 msgr2=0x7f599406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5998a00640 1 --2- 172.21.15.28:0/2930587772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f599406ea00 0x7f599406ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f599406ffc0 tx=0x7f598c01f110 comp rx=0 tx=0).stop 2024-04-23T18:23:10.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5998a00640 1 -- 172.21.15.28:0/2930587772 shutdown_connections 2024-04-23T18:23:10.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5998a00640 1 --2- 172.21.15.28:0/2930587772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f599406ea00 0x7f599406ede0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5998a00640 1 --2- 172.21.15.28:0/2930587772 >> v2:172.21.15.137:3300/0 conn(0x7f599415d260 0x7f599415f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5998a00640 1 -- 172.21.15.28:0/2930587772 >> 172.21.15.28:0/2930587772 conn(0x7f5994072f30 msgr2=0x7f5994073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5998a00640 1 -- 172.21.15.28:0/2930587772 shutdown_connections 2024-04-23T18:23:10.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5998a00640 1 -- 172.21.15.28:0/2930587772 wait complete. 2024-04-23T18:23:10.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.820+0000 7f5998a00640 1 Processor -- start 2024-04-23T18:23:10.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5998a00640 1 -- start start 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5998a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f599406ea00 0x7f59940c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5998a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59940c87f0 0x7f599414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5998a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f599415d260 0x7f599414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5998a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f59940c8bd0 con 0x7f599406ea00 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5998a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f599415bfe0 con 0x7f599415d260 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5998a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f59940c8d50 con 0x7f59940c87f0 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5991e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f599406ea00 0x7f59940c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5991e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f599406ea00 0x7f59940c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55860/0 (socket says 172.21.15.28:55860) 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5991e00640 1 -- 172.21.15.28:0/3517668413 learned_addr learned my addr 172.21.15.28:0/3517668413 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5989400640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59940c87f0 0x7f599414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5992800640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f599415d260 0x7f599414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5991e00640 1 -- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59940c87f0 msgr2=0x7f599414c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5991e00640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59940c87f0 0x7f599414c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5991e00640 1 -- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f599415d260 msgr2=0x7f599414cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5991e00640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f599415d260 0x7f599414cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5991e00640 1 -- 172.21.15.28:0/3517668413 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59940c59b0 con 0x7f599406ea00 2024-04-23T18:23:10.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5989400640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59940c87f0 0x7f599414c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:10.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5991e00640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f599406ea00 0x7f59940c7840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f598400c580 tx=0x7f598400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f598aa00640 1 -- 172.21.15.28:0/3517668413 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5984017070 con 0x7f599406ea00 2024-04-23T18:23:10.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f598aa00640 1 -- 172.21.15.28:0/3517668413 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5984005d10 con 0x7f599406ea00 2024-04-23T18:23:10.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f598aa00640 1 -- 172.21.15.28:0/3517668413 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5984007330 con 0x7f599406ea00 2024-04-23T18:23:10.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5998a00640 1 -- 172.21.15.28:0/3517668413 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59941518c0 con 0x7f599406ea00 2024-04-23T18:23:10.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.824+0000 7f5998a00640 1 -- 172.21.15.28:0/3517668413 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59940cc900 con 0x7f599406ea00 2024-04-23T18:23:10.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f598aa00640 1 -- 172.21.15.28:0/3517668413 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f598401a070 con 0x7f599406ea00 2024-04-23T18:23:10.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f598aa00640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5970068380 0x7f597006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f598aa00640 1 -- 172.21.15.28:0/3517668413 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5984086130 con 0x7f599406ea00 2024-04-23T18:23:10.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5989400640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5970068380 0x7f597006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f599be0d000 1 Processor -- start 2024-04-23T18:23:10.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f599be0d000 1 -- start start 2024-04-23T18:23:10.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5989400640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5970068380 0x7f597006a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f59940cc120 tx=0x7f597c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f599be0d000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea353a190 0x562ea353a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f599be0d000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea3575080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f599be0d000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea35755c0 0x562ea35759a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f599be0d000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x562ea3383420 con 0x562ea353aab0 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f599be0d000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562ea331dbf0 con 0x562ea35755c0 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f599be0d000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x562ea337f3e0 con 0x562ea353a190 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5989400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea3575080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5989400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea3575080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55866/0 (socket says 172.21.15.28:55866) 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5989400640 1 -- 172.21.15.28:0/733996707 learned_addr learned my addr 172.21.15.28:0/733996707 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5992800640 1 --2- 172.21.15.28:0/733996707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea35755c0 0x562ea35759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5991e00640 1 --2- 172.21.15.28:0/733996707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea353a190 0x562ea353a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5989400640 1 -- 172.21.15.28:0/733996707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea353a190 msgr2=0x562ea353a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5989400640 1 --2- 172.21.15.28:0/733996707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea353a190 0x562ea353a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5989400640 1 -- 172.21.15.28:0/733996707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea35755c0 msgr2=0x562ea35759a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5989400640 1 --2- 172.21.15.28:0/733996707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea35755c0 0x562ea35759a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5989400640 1 -- 172.21.15.28:0/733996707 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ea342b450 con 0x562ea353aab0 2024-04-23T18:23:10.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5992800640 1 --2- 172.21.15.28:0/733996707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea35755c0 0x562ea35759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:10.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.828+0000 7f5989400640 1 --2- 172.21.15.28:0/733996707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea3575080 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f597c004380 tx=0x7f597c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dfb0b71e1983b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5982a00640 1 -- 172.21.15.28:0/733996707 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c027070 con 0x562ea353aab0 2024-04-23T18:23:10.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5982a00640 1 -- 172.21.15.28:0/733996707 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c01d050 con 0x562ea353aab0 2024-04-23T18:23:10.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5982a00640 1 -- 172.21.15.28:0/733996707 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c009760 con 0x562ea353aab0 2024-04-23T18:23:10.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 -- 172.21.15.28:0/733996707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 msgr2=0x562ea3575080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 --2- 172.21.15.28:0/733996707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea3575080 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f597c004380 tx=0x7f597c014000 comp rx=0 tx=0).stop 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 -- 172.21.15.28:0/733996707 shutdown_connections 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 --2- 172.21.15.28:0/733996707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea35755c0 0x562ea35759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 --2- 172.21.15.28:0/733996707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea3575080 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 --2- 172.21.15.28:0/733996707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea353a190 0x562ea353a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 -- 172.21.15.28:0/733996707 >> 172.21.15.28:0/733996707 conn(0x562ea3571e40 msgr2=0x562ea3574260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 -- 172.21.15.28:0/733996707 shutdown_connections 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 -- 172.21.15.28:0/733996707 wait complete. 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 -- start start 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 Processor -- start 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea3536be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea353aab0 0x562ea3537120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea35755c0 0x562ea3537660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x562ea3323ec0 con 0x562ea35755c0 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562ea3404120 con 0x562ea353a190 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x562ea338e350 con 0x562ea353aab0 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f599be0d000 10 client.0 _ll_register_callbacks cb 0x562ea33604d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5992800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea35755c0 0x562ea3537660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5992800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea35755c0 0x562ea3537660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55878/0 (socket says 172.21.15.28:55878) 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5992800640 1 -- 172.21.15.28:0/1657036519 learned_addr learned my addr 172.21.15.28:0/1657036519 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5991e00640 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea3536be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5989400640 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea353aab0 0x562ea3537120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5992800640 1 -- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea353aab0 msgr2=0x562ea3537120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5992800640 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea353aab0 0x562ea3537120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5992800640 1 -- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 msgr2=0x562ea3536be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5992800640 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea3536be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5992800640 1 -- 172.21.15.28:0/1657036519 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ea33c8f80 con 0x562ea35755c0 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5989400640 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea353aab0 0x562ea3537120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5992800640 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea35755c0 0x562ea3537660 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f598c01bd20 tx=0x7f598c01d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461193783f8c5728 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.832+0000 7f5977400640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:10.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f5977400640 1 -- 172.21.15.28:0/1657036519 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c0c0030 con 0x562ea35755c0 2024-04-23T18:23:10.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f5977400640 1 -- 172.21.15.28:0/1657036519 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f598c004040 con 0x562ea35755c0 2024-04-23T18:23:10.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f599be0d000 1 -- 172.21.15.28:0/1657036519 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f597c01d050 con 0x562ea35755c0 2024-04-23T18:23:10.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f5977400640 1 -- 172.21.15.28:0/1657036519 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f598c0cc050 con 0x562ea35755c0 2024-04-23T18:23:10.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f599be0d000 10 client.4857 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:10.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f599be0d000 1 -- 172.21.15.28:0/1657036519 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x562ea335cf00 con 0x562ea35755c0 2024-04-23T18:23:10.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f5977400640 1 -- 172.21.15.28:0/1657036519 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c01d050 con 0x562ea35755c0 2024-04-23T18:23:10.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f5977400640 1 -- 172.21.15.28:0/1657036519 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f598c0cf020 con 0x562ea35755c0 2024-04-23T18:23:10.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f599be0d000 10 client.4857 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:10.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f599be0d000 10 client.4857 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T18:23:10.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f599be0d000 20 client.4857 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:10.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f599be0d000 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562ea3589d90 0x562ea358c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f599be0d000 4 client.4857 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:23:10.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f599be0d000 1 -- 172.21.15.28:0/1657036519 --> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ea331cbc0 con 0x562ea3589d90 2024-04-23T18:23:10.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f5991e00640 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562ea3589d90 0x562ea358c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f5991e00640 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562ea3589d90 0x562ea358c180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7a01d9043697ce32 server_cookie=cba527c26119671a in_seq=0 out_seq=0 2024-04-23T18:23:10.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.836+0000 7f5977400640 10 client.4857 ms_handle_connect on v2:172.21.15.137:6836/1110609151 2024-04-23T18:23:10.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f5977400640 1 -- 172.21.15.28:0/1657036519 <== mds.1 v2:172.21.15.137:6836/1110609151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562ea331cbc0 con 0x562ea3589d90 2024-04-23T18:23:10.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f5977400640 10 client.4857 handle_command_reply: tid=0 2024-04-23T18:23:10.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 1 client.4857 shutdown 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 1 -- 172.21.15.28:0/1657036519 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea35755c0 msgr2=0x562ea3537660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea35755c0 0x562ea3537660 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f598c01bd20 tx=0x7f598c01d950 comp rx=0 tx=0).stop 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 1 -- 172.21.15.28:0/1657036519 shutdown_connections 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562ea3589d90 0x562ea358c180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea353aab0 0x562ea3537120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea35755c0 0x562ea3537660 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f5977400640 0 client.4857 ms_handle_reset on v2:172.21.15.137:6836/1110609151 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 1 --2- 172.21.15.28:0/1657036519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea3536be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 1 -- 172.21.15.28:0/1657036519 >> 172.21.15.28:0/1657036519 conn(0x562ea3571e40 msgr2=0x562ea35731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 1 -- 172.21.15.28:0/1657036519 shutdown_connections 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 1 -- 172.21.15.28:0/1657036519 wait complete. 2024-04-23T18:23:10.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.840+0000 7f599be0d000 20 client.4857 trim_cache size 0 max 16384 2024-04-23T18:23:10.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.856+0000 7f599be0d000 1 Processor -- start 2024-04-23T18:23:10.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.856+0000 7f599be0d000 1 -- start start 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.856+0000 7f599be0d000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea356fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.856+0000 7f599be0d000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35703d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.856+0000 7f599be0d000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea35755c0 0x562ea358c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.856+0000 7f599be0d000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f59941fcb90 con 0x562ea353aab0 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.856+0000 7f599be0d000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f59941fd100 con 0x562ea353a190 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.856+0000 7f599be0d000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x562ea334f9e0 con 0x562ea35755c0 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.856+0000 7f5989400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.856+0000 7f5989400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55890/0 (socket says 172.21.15.28:55890) 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.856+0000 7f5989400640 1 -- 172.21.15.28:0/632003074 learned_addr learned my addr 172.21.15.28:0/632003074 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5992800640 1 --2- 172.21.15.28:0/632003074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea35755c0 0x562ea358c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5991e00640 1 --2- 172.21.15.28:0/632003074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea356fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5989400640 1 -- 172.21.15.28:0/632003074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea35755c0 msgr2=0x562ea358c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5989400640 1 --2- 172.21.15.28:0/632003074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea35755c0 0x562ea358c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5989400640 1 -- 172.21.15.28:0/632003074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 msgr2=0x562ea356fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5989400640 1 --2- 172.21.15.28:0/632003074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea356fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5989400640 1 -- 172.21.15.28:0/632003074 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ea3309e80 con 0x562ea353aab0 2024-04-23T18:23:10.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5989400640 1 --2- 172.21.15.28:0/632003074 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35703d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f597c008010 tx=0x7f597c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e6177e9e8c41f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5982000640 1 -- 172.21.15.28:0/632003074 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c027070 con 0x562ea353aab0 2024-04-23T18:23:10.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5982000640 1 -- 172.21.15.28:0/632003074 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c031070 con 0x562ea353aab0 2024-04-23T18:23:10.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5982000640 1 -- 172.21.15.28:0/632003074 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c003ba0 con 0x562ea353aab0 2024-04-23T18:23:10.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 -- 172.21.15.28:0/632003074 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 msgr2=0x562ea35703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 --2- 172.21.15.28:0/632003074 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35703d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f597c008010 tx=0x7f597c016000 comp rx=0 tx=0).stop 2024-04-23T18:23:10.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 -- 172.21.15.28:0/632003074 shutdown_connections 2024-04-23T18:23:10.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 --2- 172.21.15.28:0/632003074 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea35755c0 0x562ea358c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 --2- 172.21.15.28:0/632003074 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35703d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 --2- 172.21.15.28:0/632003074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea356fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 -- 172.21.15.28:0/632003074 >> 172.21.15.28:0/632003074 conn(0x562ea3571e40 msgr2=0x562ea3533cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 -- 172.21.15.28:0/632003074 shutdown_connections 2024-04-23T18:23:10.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 -- 172.21.15.28:0/632003074 wait complete. 2024-04-23T18:23:10.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 -- start start 2024-04-23T18:23:10.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 Processor -- start 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea358e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35aad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea35755c0 0x562ea35ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x562ea3387a50 con 0x562ea353aab0 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562ea3382730 con 0x562ea353a190 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x562ea3390630 con 0x562ea35755c0 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f599be0d000 10 client.0 _ll_register_callbacks cb 0x7f598c0b2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5989400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5989400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35aad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55896/0 (socket says 172.21.15.28:55896) 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5989400640 1 -- 172.21.15.28:0/1293678741 learned_addr learned my addr 172.21.15.28:0/1293678741 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5991e00640 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea358e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5992800640 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea35755c0 0x562ea35ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5989400640 1 -- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea35755c0 msgr2=0x562ea35ab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.860+0000 7f5989400640 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea35755c0 0x562ea35ab2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5989400640 1 -- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 msgr2=0x562ea358e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5989400640 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea358e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5989400640 1 -- 172.21.15.28:0/1293678741 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ea334bb30 con 0x562ea353aab0 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5991e00640 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea358e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5989400640 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35aad80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f597c000c10 tx=0x7f597c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e95c350da47bca server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5977400640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5977400640 1 -- 172.21.15.28:0/1293678741 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c03a060 con 0x562ea353aab0 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5977400640 1 -- 172.21.15.28:0/1293678741 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f597c015690 con 0x562ea353aab0 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 -- 172.21.15.28:0/1293678741 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f597c031070 con 0x562ea353aab0 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5977400640 1 -- 172.21.15.28:0/1293678741 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f597c040050 con 0x562ea353aab0 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 10 client.4863 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 -- 172.21.15.28:0/1293678741 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x562ea34045b0 con 0x562ea353aab0 2024-04-23T18:23:10.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5977400640 1 -- 172.21.15.28:0/1293678741 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c031070 con 0x562ea353aab0 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5977400640 1 -- 172.21.15.28:0/1293678741 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f597c043020 con 0x562ea353aab0 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 10 client.4863 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 10 client.4863 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 20 client.4863 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562ea35ea170 0x562ea35ea550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 4 client.4863 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 -- 172.21.15.28:0/1293678741 --> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] -- command(tid 0: {"prefix": "status"}) -- 0x562ea3390e40 con 0x562ea35ea170 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5991e00640 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562ea35ea170 0x562ea35ea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5991e00640 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562ea35ea170 0x562ea35ea550 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c99321140e782b09 server_cookie=40fc261dd0656648 in_seq=0 out_seq=0 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5977400640 10 client.4863 ms_handle_connect on v2:172.21.15.137:6836/1110609151 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5977400640 1 -- 172.21.15.28:0/1293678741 <== mds.1 v2:172.21.15.137:6836/1110609151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x562ea3390e40 con 0x562ea35ea170 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5977400640 10 client.4863 handle_command_reply: tid=0 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 client.4863 shutdown 2024-04-23T18:23:10.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 -- 172.21.15.28:0/1293678741 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 msgr2=0x562ea35aad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35aad80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f597c000c10 tx=0x7f597c0046d0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 -- 172.21.15.28:0/1293678741 shutdown_connections 2024-04-23T18:23:10.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562ea35ea170 0x562ea35ea550 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562ea35755c0 0x562ea35ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562ea353aab0 0x562ea35aad80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5977400640 0 client.4863 ms_handle_reset on v2:172.21.15.137:6836/1110609151 2024-04-23T18:23:10.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 --2- 172.21.15.28:0/1293678741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562ea353a190 0x562ea358e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 -- 172.21.15.28:0/1293678741 >> 172.21.15.28:0/1293678741 conn(0x562ea3571e40 msgr2=0x562ea356f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 -- 172.21.15.28:0/1293678741 shutdown_connections 2024-04-23T18:23:10.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 1 -- 172.21.15.28:0/1293678741 wait complete. 2024-04-23T18:23:10.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f599be0d000 20 client.4863 trim_cache size 0 max 16384 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "d84cc156-ceaf-4cae-a89c-ee7e55af72c5", 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 1, 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4294, 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 15.378319968, 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 15, 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 24, 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 44.929242369000001 2024-04-23T18:23:10.863 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:23:10.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 -- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5970068380 msgr2=0x7f597006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5970068380 0x7f597006a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f59940cc120 tx=0x7f597c008040 comp rx=0 tx=0).stop 2024-04-23T18:23:10.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 -- 172.21.15.28:0/3517668413 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f599406ea00 msgr2=0x7f59940c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:10.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f599406ea00 0x7f59940c7840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f598400c580 tx=0x7f598400ca40 comp rx=0 tx=0).stop 2024-04-23T18:23:10.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 -- 172.21.15.28:0/3517668413 shutdown_connections 2024-04-23T18:23:10.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5970068380 0x7f597006a840 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f59940c87f0 0x7f599414c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f599415d260 0x7f599414cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 --2- 172.21.15.28:0/3517668413 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f599406ea00 0x7f59940c7840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:10.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 -- 172.21.15.28:0/3517668413 >> 172.21.15.28:0/3517668413 conn(0x7f5994072f30 msgr2=0x7f599415ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:10.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 -- 172.21.15.28:0/3517668413 shutdown_connections 2024-04-23T18:23:10.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:10.864+0000 7f5998a00640 1 -- 172.21.15.28:0/3517668413 wait complete. 2024-04-23T18:23:10.879 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-23T18:23:11.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f494a000640 1 Processor -- start 2024-04-23T18:23:11.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f494a000640 1 -- start start 2024-04-23T18:23:11.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f494a000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f49440cc4e0 0x7f49440cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f494a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49440c75a0 0x7f49440c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f494a000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4944158190 con 0x7f4944151fe0 2024-04-23T18:23:11.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f494a000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f49440c7f30 con 0x7f49440cc4e0 2024-04-23T18:23:11.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f494a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4944158d10 con 0x7f49440c75a0 2024-04-23T18:23:11.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f493be00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f49440cc4e0 0x7f49440cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f493be00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f49440cc4e0 0x7f49440cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55910/0 (socket says 172.21.15.28:55910) 2024-04-23T18:23:11.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f493be00640 1 -- 172.21.15.28:0/2238773265 learned_addr learned my addr 172.21.15.28:0/2238773265 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:11.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f4943e00640 1 --2- 172.21.15.28:0/2238773265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49440c75a0 0x7f49440c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f493be00640 1 -- 172.21.15.28:0/2238773265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49440c75a0 msgr2=0x7f49440c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:11.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f493be00640 1 --2- 172.21.15.28:0/2238773265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49440c75a0 0x7f49440c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f493be00640 1 -- 172.21.15.28:0/2238773265 >> v1:172.21.15.28:6789/0 conn(0x7f4944151fe0 legacy=0x7f49440c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f4942a00640 1 -- 172.21.15.28:0/2238773265 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799877647 0 0) 0x7f4944158190 con 0x7f4944151fe0 2024-04-23T18:23:11.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.028+0000 7f493be00640 1 -- 172.21.15.28:0/2238773265 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4944158470 con 0x7f49440cc4e0 2024-04-23T18:23:11.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f493be00640 1 --2- 172.21.15.28:0/2238773265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49440cc4e0 0x7f49440cc930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f492c009870 tx=0x7f492c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62801d6988172a47 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:11.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f4942a00640 1 -- 172.21.15.28:0/2238773265 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c0b1070 con 0x7f49440cc4e0 2024-04-23T18:23:11.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f4942a00640 1 -- 172.21.15.28:0/2238773265 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492c0ac620 con 0x7f49440cc4e0 2024-04-23T18:23:11.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f4942a00640 1 -- 172.21.15.28:0/2238773265 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c0ac9f0 con 0x7f49440cc4e0 2024-04-23T18:23:11.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f494a000640 1 -- 172.21.15.28:0/2238773265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49440cc4e0 msgr2=0x7f49440cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f494a000640 1 --2- 172.21.15.28:0/2238773265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49440cc4e0 0x7f49440cc930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f492c009870 tx=0x7f492c01c4d0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f494a000640 1 -- 172.21.15.28:0/2238773265 shutdown_connections 2024-04-23T18:23:11.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f494a000640 1 --2- 172.21.15.28:0/2238773265 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49440c75a0 0x7f49440c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f494a000640 1 --2- 172.21.15.28:0/2238773265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f49440cc4e0 0x7f49440cc930 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f494a000640 1 -- 172.21.15.28:0/2238773265 >> 172.21.15.28:0/2238773265 conn(0x7f4944075e30 msgr2=0x7f49440676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:11.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f494a000640 1 -- 172.21.15.28:0/2238773265 shutdown_connections 2024-04-23T18:23:11.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f494a000640 1 -- 172.21.15.28:0/2238773265 wait complete. 2024-04-23T18:23:11.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f494a000640 1 Processor -- start 2024-04-23T18:23:11.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.032+0000 7f494a000640 1 -- start start 2024-04-23T18:23:11.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f494a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49440c75a0 0x7f49441546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f494a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49440cc4e0 0x7f4944153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f494a000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4944151fe0 0x7f4944073470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f494a000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f49440c5490 con 0x7f4944151fe0 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f494a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49441523c0 con 0x7f49440cc4e0 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f494a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f49440c5610 con 0x7f49440c75a0 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f4943e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4944151fe0 0x7f4944073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f4943e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4944151fe0 0x7f4944073470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55912/0 (socket says 172.21.15.28:55912) 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f4943e00640 1 -- 172.21.15.28:0/3673788037 learned_addr learned my addr 172.21.15.28:0/3673788037 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f493be00640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49440cc4e0 0x7f4944153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f4943400640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49440c75a0 0x7f49441546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f4943e00640 1 -- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49440c75a0 msgr2=0x7f49441546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f4943e00640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49440c75a0 0x7f49441546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f4943e00640 1 -- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49440cc4e0 msgr2=0x7f4944153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f4943e00640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49440cc4e0 0x7f4944153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f4943e00640 1 -- 172.21.15.28:0/3673788037 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4944154f90 con 0x7f4944151fe0 2024-04-23T18:23:11.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f4943e00640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4944151fe0 0x7f4944073470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f493c007e60 tx=0x7f493c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:11.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f493b400640 1 -- 172.21.15.28:0/3673788037 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c014420 con 0x7f4944151fe0 2024-04-23T18:23:11.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f493b400640 1 -- 172.21.15.28:0/3673788037 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493c019070 con 0x7f4944151fe0 2024-04-23T18:23:11.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f493b400640 1 -- 172.21.15.28:0/3673788037 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c014820 con 0x7f4944151fe0 2024-04-23T18:23:11.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f494a000640 1 -- 172.21.15.28:0/3673788037 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4944155270 con 0x7f4944151fe0 2024-04-23T18:23:11.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f494a000640 1 -- 172.21.15.28:0/3673788037 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4944152b70 con 0x7f4944151fe0 2024-04-23T18:23:11.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.036+0000 7f493b400640 1 -- 172.21.15.28:0/3673788037 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f493c0149c0 con 0x7f4944151fe0 2024-04-23T18:23:11.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f493b400640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4920068380 0x7f492006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f493b400640 1 -- 172.21.15.28:0/3673788037 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f493c087530 con 0x7f4944151fe0 2024-04-23T18:23:11.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f4943400640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4920068380 0x7f492006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f494d1ff000 1 Processor -- start 2024-04-23T18:23:11.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f494d1ff000 1 -- start start 2024-04-23T18:23:11.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f4943400640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4920068380 0x7f492006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4934000f70 tx=0x7f4934009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:11.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c1643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c168460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c1689a0 0x55883c168d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f494d1ff000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55883bf76420 con 0x55883c168080 2024-04-23T18:23:11.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f494d1ff000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55883bf10bf0 con 0x55883c1689a0 2024-04-23T18:23:11.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f494d1ff000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55883bf723e0 con 0x55883c163fd0 2024-04-23T18:23:11.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f493be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c168460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f493be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c168460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55918/0 (socket says 172.21.15.28:55918) 2024-04-23T18:23:11.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f493be00640 1 -- 172.21.15.28:0/155360661 learned_addr learned my addr 172.21.15.28:0/155360661 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:11.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f4943e00640 1 --2- 172.21.15.28:0/155360661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c1689a0 0x55883c168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f4943400640 1 --2- 172.21.15.28:0/155360661 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c1643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f493be00640 1 -- 172.21.15.28:0/155360661 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 msgr2=0x55883c1643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:11.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f493be00640 1 --2- 172.21.15.28:0/155360661 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c1643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f493be00640 1 -- 172.21.15.28:0/155360661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c1689a0 msgr2=0x55883c168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:11.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f493be00640 1 --2- 172.21.15.28:0/155360661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c1689a0 0x55883c168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f493be00640 1 -- 172.21.15.28:0/155360661 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55883c01e450 con 0x55883c168080 2024-04-23T18:23:11.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f493be00640 1 --2- 172.21.15.28:0/155360661 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c168460 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f492c01a100 tx=0x7f492c0a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33e41280b590233 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:11.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f4933e00640 1 -- 172.21.15.28:0/155360661 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c0b1040 con 0x55883c168080 2024-04-23T18:23:11.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f4933e00640 1 -- 172.21.15.28:0/155360661 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492c0ac560 con 0x55883c168080 2024-04-23T18:23:11.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f4933e00640 1 -- 172.21.15.28:0/155360661 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c0ac910 con 0x55883c168080 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f494d1ff000 1 -- 172.21.15.28:0/155360661 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 msgr2=0x55883c168460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.040+0000 7f494d1ff000 1 --2- 172.21.15.28:0/155360661 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c168460 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f492c01a100 tx=0x7f492c0a7000 comp rx=0 tx=0).stop 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 -- 172.21.15.28:0/155360661 shutdown_connections 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 --2- 172.21.15.28:0/155360661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c1689a0 0x55883c168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 --2- 172.21.15.28:0/155360661 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c168460 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 --2- 172.21.15.28:0/155360661 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c1643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 -- 172.21.15.28:0/155360661 >> 172.21.15.28:0/155360661 conn(0x55883c164e40 msgr2=0x55883c167260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 -- 172.21.15.28:0/155360661 shutdown_connections 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 -- 172.21.15.28:0/155360661 wait complete. 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 -- start start 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 Processor -- start 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c16b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c168080 0x55883c16b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c1689a0 0x55883c16bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55883bf16ec0 con 0x55883c1689a0 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55883bff7120 con 0x55883c168080 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55883bf81350 con 0x55883c163fd0 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 10 client.0 _ll_register_callbacks cb 0x55883bf534d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4943e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c1689a0 0x55883c16bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4943e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c1689a0 0x55883c16bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55928/0 (socket says 172.21.15.28:55928) 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4943e00640 1 -- 172.21.15.28:0/1213750953 learned_addr learned my addr 172.21.15.28:0/1213750953 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4943400640 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c16b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f493be00640 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c168080 0x55883c16b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4943e00640 1 -- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 msgr2=0x55883c16b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:11.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4943e00640 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c16b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4943e00640 1 -- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c168080 msgr2=0x55883c16b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4943e00640 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c168080 0x55883c16b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4943e00640 1 -- 172.21.15.28:0/1213750953 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883bfbbf80 con 0x55883c1689a0 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4943e00640 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c1689a0 0x55883c16bd50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f493c007e30 tx=0x7f493c057160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84853436783b4ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4930c00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4930c00640 1 -- 172.21.15.28:0/1213750953 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c053710 con 0x55883c1689a0 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4930c00640 1 -- 172.21.15.28:0/1213750953 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f493c0870c0 con 0x55883c1689a0 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 -- 172.21.15.28:0/1213750953 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f492c0ac560 con 0x55883c1689a0 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4930c00640 1 -- 172.21.15.28:0/1213750953 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f493c0538b0 con 0x55883c1689a0 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 10 client.4878 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 -- 172.21.15.28:0/1213750953 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55883bf4ff00 con 0x55883c1689a0 2024-04-23T18:23:11.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4930c00640 1 -- 172.21.15.28:0/1213750953 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492c0ac560 con 0x55883c1689a0 2024-04-23T18:23:11.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f4930c00640 1 -- 172.21.15.28:0/1213750953 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f493c05f7f0 con 0x55883c1689a0 2024-04-23T18:23:11.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 10 client.4878 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:11.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 10 client.4878 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T18:23:11.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 20 client.4878 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:11.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55883c16c760 0x55883c1835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 4 client.4878 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:23:11.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.044+0000 7f494d1ff000 1 -- 172.21.15.28:0/1213750953 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55883bf0fbc0 con 0x55883c16c760 2024-04-23T18:23:11.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f4943400640 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55883c16c760 0x55883c1835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f4943400640 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55883c16c760 0x55883c1835e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27a643eb8ad1d08b server_cookie=fbab8bca8822dc52 in_seq=0 out_seq=0 2024-04-23T18:23:11.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f4930c00640 10 client.4878 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f4930c00640 1 -- 172.21.15.28:0/1213750953 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55883bf0fbc0 con 0x55883c16c760 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f4930c00640 10 client.4878 handle_command_reply: tid=0 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 1 client.4878 shutdown 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 1 -- 172.21.15.28:0/1213750953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c1689a0 msgr2=0x55883c16bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c1689a0 0x55883c16bd50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f493c007e30 tx=0x7f493c057160 comp rx=0 tx=0).stop 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 1 -- 172.21.15.28:0/1213750953 shutdown_connections 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55883c16c760 0x55883c1835e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c1689a0 0x55883c16bd50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c168080 0x55883c16b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 1 --2- 172.21.15.28:0/1213750953 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c16b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f4930c00640 0 client.4878 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:11.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 1 -- 172.21.15.28:0/1213750953 >> 172.21.15.28:0/1213750953 conn(0x55883c164e40 msgr2=0x55883c167230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:11.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 1 -- 172.21.15.28:0/1213750953 shutdown_connections 2024-04-23T18:23:11.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 1 -- 172.21.15.28:0/1213750953 wait complete. 2024-04-23T18:23:11.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.048+0000 7f494d1ff000 20 client.4878 trim_cache size 0 max 16384 2024-04-23T18:23:11.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 Processor -- start 2024-04-23T18:23:11.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 -- start start 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c164e40 0x55883c14d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c12cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c168080 0x55883c12d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f49441433b0 con 0x55883c164e40 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49441fbc90 con 0x55883c168080 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55883bf429e0 con 0x55883c163fd0 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4943400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c164e40 0x55883c14d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4943400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c164e40 0x55883c14d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55934/0 (socket says 172.21.15.28:55934) 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4943400640 1 -- 172.21.15.28:0/2880403739 learned_addr learned my addr 172.21.15.28:0/2880403739 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f493be00640 1 --2- 172.21.15.28:0/2880403739 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c12cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4943e00640 1 --2- 172.21.15.28:0/2880403739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c168080 0x55883c12d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4943400640 1 -- 172.21.15.28:0/2880403739 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 msgr2=0x55883c12cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:11.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4943400640 1 --2- 172.21.15.28:0/2880403739 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c12cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4943400640 1 -- 172.21.15.28:0/2880403739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c168080 msgr2=0x55883c12d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:11.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4943400640 1 --2- 172.21.15.28:0/2880403739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c168080 0x55883c12d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4943400640 1 -- 172.21.15.28:0/2880403739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55883befce80 con 0x55883c164e40 2024-04-23T18:23:11.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f493be00640 1 --2- 172.21.15.28:0/2880403739 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c12cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:11.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4943e00640 1 --2- 172.21.15.28:0/2880403739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c168080 0x55883c12d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:11.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4943400640 1 --2- 172.21.15.28:0/2880403739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c164e40 0x55883c14d770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4934001e00 tx=0x7f4934012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df5f42b650d343c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:11.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4933400640 1 -- 172.21.15.28:0/2880403739 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934005450 con 0x55883c164e40 2024-04-23T18:23:11.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4933400640 1 -- 172.21.15.28:0/2880403739 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4934026440 con 0x55883c164e40 2024-04-23T18:23:11.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f4933400640 1 -- 172.21.15.28:0/2880403739 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49340265f0 con 0x55883c164e40 2024-04-23T18:23:11.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 -- 172.21.15.28:0/2880403739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c164e40 msgr2=0x55883c14d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 --2- 172.21.15.28:0/2880403739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c164e40 0x55883c14d770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4934001e00 tx=0x7f4934012000 comp rx=0 tx=0).stop 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 -- 172.21.15.28:0/2880403739 shutdown_connections 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 --2- 172.21.15.28:0/2880403739 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c163fd0 0x55883c12cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 --2- 172.21.15.28:0/2880403739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c168080 0x55883c12d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 --2- 172.21.15.28:0/2880403739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c164e40 0x55883c14d770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 -- 172.21.15.28:0/2880403739 >> 172.21.15.28:0/2880403739 conn(0x55883c167a20 msgr2=0x55883c12c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 -- 172.21.15.28:0/2880403739 shutdown_connections 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.068+0000 7f494d1ff000 1 -- 172.21.15.28:0/2880403739 wait complete. 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 -- start start 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 Processor -- start 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c163fd0 0x55883c1de940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c164e40 0x55883c1dee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c184630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55883bf7aa50 con 0x55883c168080 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55883bf75730 con 0x55883c163fd0 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55883bf83630 con 0x55883c164e40 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 10 client.0 _ll_register_callbacks cb 0x7f493c053400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4943e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c184630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4943e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c184630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55950/0 (socket says 172.21.15.28:55950) 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4943e00640 1 -- 172.21.15.28:0/2034128412 learned_addr learned my addr 172.21.15.28:0/2034128412 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f493be00640 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c164e40 0x55883c1dee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4943400640 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c163fd0 0x55883c1de940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4943e00640 1 -- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c164e40 msgr2=0x55883c1dee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4943e00640 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c164e40 0x55883c1dee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4943e00640 1 -- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c163fd0 msgr2=0x55883c1de940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4943e00640 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c163fd0 0x55883c1de940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4943e00640 1 -- 172.21.15.28:0/2034128412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883bf3eb30 con 0x55883c168080 2024-04-23T18:23:11.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f493be00640 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c164e40 0x55883c1dee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:11.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4943e00640 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c184630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f493c00e9b0 tx=0x7f493c0855e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ea6d7621cac30e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:11.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4930c00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:11.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4930c00640 1 -- 172.21.15.28:0/2034128412 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c053710 con 0x55883c168080 2024-04-23T18:23:11.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4930c00640 1 -- 172.21.15.28:0/2034128412 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f493c085170 con 0x55883c168080 2024-04-23T18:23:11.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 -- 172.21.15.28:0/2034128412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4934026440 con 0x55883c168080 2024-04-23T18:23:11.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4930c00640 1 -- 172.21.15.28:0/2034128412 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f493c014cb0 con 0x55883c168080 2024-04-23T18:23:11.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 10 client.4884 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:11.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 -- 172.21.15.28:0/2034128412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55883bff75b0 con 0x55883c168080 2024-04-23T18:23:11.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4930c00640 1 -- 172.21.15.28:0/2034128412 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4934026440 con 0x55883c168080 2024-04-23T18:23:11.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4930c00640 1 -- 172.21.15.28:0/2034128412 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f493c0564f0 con 0x55883c168080 2024-04-23T18:23:11.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 10 client.4884 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:11.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 10 client.4884 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T18:23:11.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 20 client.4884 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:11.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55883c1689a0 0x55883c185340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 4 client.4884 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T18:23:11.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f494d1ff000 1 -- 172.21.15.28:0/2034128412 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "status"}) -- 0x55883bf83e40 con 0x55883c1689a0 2024-04-23T18:23:11.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.072+0000 7f4943400640 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55883c1689a0 0x55883c185340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f4943400640 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55883c1689a0 0x55883c185340 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad14663f783acb95 server_cookie=6330f47eb948ad3 in_seq=0 out_seq=0 2024-04-23T18:23:11.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f4930c00640 10 client.4884 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:11.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f4930c00640 1 -- 172.21.15.28:0/2034128412 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55883bf83e40 con 0x55883c1689a0 2024-04-23T18:23:11.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f4930c00640 10 client.4884 handle_command_reply: tid=0 2024-04-23T18:23:11.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 1 client.4884 shutdown 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 1 -- 172.21.15.28:0/2034128412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 msgr2=0x55883c184630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c184630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f493c00e9b0 tx=0x7f493c0855e0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 1 -- 172.21.15.28:0/2034128412 shutdown_connections 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55883c1689a0 0x55883c185340 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55883c164e40 0x55883c1dee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55883c168080 0x55883c184630 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 1 --2- 172.21.15.28:0/2034128412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883c163fd0 0x55883c1de940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f4930c00640 0 client.4884 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 1 -- 172.21.15.28:0/2034128412 >> 172.21.15.28:0/2034128412 conn(0x55883c167a20 msgr2=0x55883c12cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 1 -- 172.21.15.28:0/2034128412 shutdown_connections 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 1 -- 172.21.15.28:0/2034128412 wait complete. 2024-04-23T18:23:11.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494d1ff000 20 client.4884 trim_cache size 0 max 16384 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "d84cc156-ceaf-4cae-a89c-ee7e55af72c5", 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4297, 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 37.705795647000002, 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 15, 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 24, 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T18:23:11.074 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 45.139149357000001 2024-04-23T18:23:11.075 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:23:11.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 -- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4920068380 msgr2=0x7f492006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4920068380 0x7f492006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4934000f70 tx=0x7f4934009040 comp rx=0 tx=0).stop 2024-04-23T18:23:11.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 -- 172.21.15.28:0/3673788037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4944151fe0 msgr2=0x7f4944073470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4944151fe0 0x7f4944073470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f493c007e60 tx=0x7f493c00e4b0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 -- 172.21.15.28:0/3673788037 shutdown_connections 2024-04-23T18:23:11.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4920068380 0x7f492006a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4944151fe0 0x7f4944073470 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49440cc4e0 0x7f4944153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 --2- 172.21.15.28:0/3673788037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f49440c75a0 0x7f49441546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 -- 172.21.15.28:0/3673788037 >> 172.21.15.28:0/3673788037 conn(0x7f4944075e30 msgr2=0x7f49440c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:11.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 -- 172.21.15.28:0/3673788037 shutdown_connections 2024-04-23T18:23:11.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.076+0000 7f494a000640 1 -- 172.21.15.28:0/3673788037 wait complete. 2024-04-23T18:23:11.089 INFO:teuthology.run_tasks:Running task sequential... 2024-04-23T18:23:11.099 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-23T18:23:11.099 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-23T18:23:11.099 INFO:teuthology.task.print:Enabling mgr modules 2024-04-23T18:23:11.099 INFO:teuthology.run_tasks:Running task kclient... 2024-04-23T18:23:11.111 INFO:tasks.kclient:Mounting kernel clients... 2024-04-23T18:23:11.111 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-23T18:23:11.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:23:11.112 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-04-23T18:23:11.121 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-23T18:23:11.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:23:11.122 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T18:23:11.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:23:11.184 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link delete ceph-brx 2024-04-23T18:23:11.386 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-23T18:23:11.386 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-23T18:23:11.386 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T18:23:11.387 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-23T18:23:11.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.532+0000 7fe744600640 1 Processor -- start 2024-04-23T18:23:11.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.532+0000 7fe744600640 1 -- start start 2024-04-23T18:23:11.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe744600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe73c067940 0x7fe73c15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe744600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe73c0c8030 0x7fe73c072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe744600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73c15e800 con 0x7fe73c067d20 2024-04-23T18:23:11.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe744600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe73c071d80 con 0x7fe73c067940 2024-04-23T18:23:11.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe744600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe73c15eaa0 con 0x7fe73c0c8030 2024-04-23T18:23:11.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe741c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe73c067940 0x7fe73c15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe741200640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe73c067d20 0x7fe73c144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60804/0 (socket says 172.21.15.28:60804) 2024-04-23T18:23:11.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe741200640 1 -- 172.21.15.28:0/1972671383 learned_addr learned my addr 172.21.15.28:0/1972671383 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:11.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe742600640 1 --2- 172.21.15.28:0/1972671383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe73c0c8030 0x7fe73c072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe741c00640 1 -- 172.21.15.28:0/1972671383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe73c0c8030 msgr2=0x7fe73c072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:11.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe741c00640 1 --2- 172.21.15.28:0/1972671383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe73c0c8030 0x7fe73c072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe741c00640 1 -- 172.21.15.28:0/1972671383 >> v1:172.21.15.28:6789/0 conn(0x7fe73c067d20 legacy=0x7fe73c144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe73be00640 1 -- 172.21.15.28:0/1972671383 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183922169 0 0) 0x7fe73c15e800 con 0x7fe73c067d20 2024-04-23T18:23:11.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.536+0000 7fe741c00640 1 -- 172.21.15.28:0/1972671383 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c0cab10 con 0x7fe73c067940 2024-04-23T18:23:11.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe741c00640 1 --2- 172.21.15.28:0/1972671383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe73c067940 0x7fe73c15bc90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe73c071f00 tx=0x7fe73001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541153f8aafbcc29 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:11.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe73be00640 1 -- 172.21.15.28:0/1972671383 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300b0070 con 0x7fe73c067940 2024-04-23T18:23:11.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe73be00640 1 -- 172.21.15.28:0/1972671383 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7300ab600 con 0x7fe73c067940 2024-04-23T18:23:11.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe73be00640 1 -- 172.21.15.28:0/1972671383 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300ab9d0 con 0x7fe73c067940 2024-04-23T18:23:11.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 -- 172.21.15.28:0/1972671383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe73c067940 msgr2=0x7fe73c15bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 --2- 172.21.15.28:0/1972671383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe73c067940 0x7fe73c15bc90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe73c071f00 tx=0x7fe73001c3f0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 -- 172.21.15.28:0/1972671383 shutdown_connections 2024-04-23T18:23:11.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 --2- 172.21.15.28:0/1972671383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe73c0c8030 0x7fe73c072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 --2- 172.21.15.28:0/1972671383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe73c067940 0x7fe73c15bc90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 -- 172.21.15.28:0/1972671383 >> 172.21.15.28:0/1972671383 conn(0x7fe73c06f970 msgr2=0x7fe73c06fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:11.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 -- 172.21.15.28:0/1972671383 shutdown_connections 2024-04-23T18:23:11.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 -- 172.21.15.28:0/1972671383 wait complete. 2024-04-23T18:23:11.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 Processor -- start 2024-04-23T18:23:11.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 -- start start 2024-04-23T18:23:11.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe73c067940 0x7fe73c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c067d20 0x7fe73c1f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe73c0c8030 0x7fe73c0c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c072b60 con 0x7fe73c067940 2024-04-23T18:23:11.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c15f5e0 con 0x7fe73c067d20 2024-04-23T18:23:11.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe744600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe73c144760 con 0x7fe73c0c8030 2024-04-23T18:23:11.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe741c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe73c067940 0x7fe73c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe741c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe73c067940 0x7fe73c0c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55964/0 (socket says 172.21.15.28:55964) 2024-04-23T18:23:11.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe741c00640 1 -- 172.21.15.28:0/3585912924 learned_addr learned my addr 172.21.15.28:0/3585912924 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe742600640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe73c0c8030 0x7fe73c0c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe741200640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c067d20 0x7fe73c1f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe741c00640 1 -- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe73c0c8030 msgr2=0x7fe73c0c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe741c00640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe73c0c8030 0x7fe73c0c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.540+0000 7fe741c00640 1 -- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c067d20 msgr2=0x7fe73c1f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe741c00640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c067d20 0x7fe73c1f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe741c00640 1 -- 172.21.15.28:0/3585912924 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c1ed1f0 con 0x7fe73c067940 2024-04-23T18:23:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe741200640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c067d20 0x7fe73c1f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe741c00640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe73c067940 0x7fe73c0c98f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe73001a020 tx=0x7fe730019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:11.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe739600640 1 -- 172.21.15.28:0/3585912924 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300b0040 con 0x7fe73c067940 2024-04-23T18:23:11.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe739600640 1 -- 172.21.15.28:0/3585912924 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7300b43f0 con 0x7fe73c067940 2024-04-23T18:23:11.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe739600640 1 -- 172.21.15.28:0/3585912924 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300b47c0 con 0x7fe73c067940 2024-04-23T18:23:11.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe744600640 1 -- 172.21.15.28:0/3585912924 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73c1ed4d0 con 0x7fe73c067940 2024-04-23T18:23:11.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe744600640 1 -- 172.21.15.28:0/3585912924 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73c1eda90 con 0x7fe73c067940 2024-04-23T18:23:11.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe744600640 1 -- 172.21.15.28:0/3585912924 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73c068cd0 con 0x7fe73c067940 2024-04-23T18:23:11.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe739600640 1 -- 172.21.15.28:0/3585912924 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe7300b4960 con 0x7fe73c067940 2024-04-23T18:23:11.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe739600640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe71c068380 0x7fe71c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:11.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe739600640 1 -- 172.21.15.28:0/3585912924 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe7301208b0 con 0x7fe73c067940 2024-04-23T18:23:11.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.544+0000 7fe741200640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe71c068380 0x7fe71c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:11.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.548+0000 7fe741200640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe71c068380 0x7fe71c06a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0c9880 tx=0x7fe728009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:11.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.548+0000 7fe739600640 1 -- 172.21.15.28:0/3585912924 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe730016070 con 0x7fe73c067940 2024-04-23T18:23:11.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.752+0000 7fe744600640 1 -- 172.21.15.28:0/3585912924 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe73c0caf60 con 0x7fe73c067940 2024-04-23T18:23:11.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.752+0000 7fe739600640 1 -- 172.21.15.28:0/3585912924 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+88 (secure 0 0 0) 0x7fe73011ee20 con 0x7fe73c067940 2024-04-23T18:23:11.746 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-23T18:23:11.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.752+0000 7fe744600640 1 -- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe71c068380 msgr2=0x7fe71c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.752+0000 7fe744600640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe71c068380 0x7fe71c06a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0c9880 tx=0x7fe728009040 comp rx=0 tx=0).stop 2024-04-23T18:23:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.752+0000 7fe744600640 1 -- 172.21.15.28:0/3585912924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe73c067940 msgr2=0x7fe73c0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.752+0000 7fe744600640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe73c067940 0x7fe73c0c98f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe73001a020 tx=0x7fe730019190 comp rx=0 tx=0).stop 2024-04-23T18:23:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.752+0000 7fe744600640 1 -- 172.21.15.28:0/3585912924 shutdown_connections 2024-04-23T18:23:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.756+0000 7fe744600640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe71c068380 0x7fe71c06a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.756+0000 7fe744600640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe73c0c8030 0x7fe73c0c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.756+0000 7fe744600640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c067d20 0x7fe73c1f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.756+0000 7fe744600640 1 --2- 172.21.15.28:0/3585912924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe73c067940 0x7fe73c0c98f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.756+0000 7fe744600640 1 -- 172.21.15.28:0/3585912924 >> 172.21.15.28:0/3585912924 conn(0x7fe73c06f970 msgr2=0x7fe73c1596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.756+0000 7fe744600640 1 -- 172.21.15.28:0/3585912924 shutdown_connections 2024-04-23T18:23:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11.756+0000 7fe744600640 1 -- 172.21.15.28:0/3585912924 wait complete. 2024-04-23T18:23:11.766 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-23T18:23:11.766 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-23T18:23:11.766 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi028.front.sepia.ceph.com 2024-04-23T18:23:11.766 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-23T18:23:11.766 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T18:23:11.766 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-23T18:23:11.767 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-23T18:23:11.767 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-23T18:23:11.767 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-23T18:23:11.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:23:11.767 DEBUG:teuthology.orchestra.run.smithi028:> ip addr 2024-04-23T18:23:11.775 INFO:teuthology.orchestra.run.smithi028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout: inet 127.0.0.1/8 scope host lo 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 ::1/128 scope host 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3c brd ff:ff:ff:ff:ff:ff 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f0 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.21.15.28/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft 42408sec preferred_lft 42408sec 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout: inet6 fe80::ae1f:6bff:fea5:ca3c/64 scope link 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-04-23T18:23:11.776 INFO:teuthology.orchestra.run.smithi028.stdout:3: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:16 brd ff:ff:ff:ff:ff:ff 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f0 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 0c:c4:7a:6b:ee:17 brd ff:ff:ff:ff:ff:ff 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp7s0f1 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether ac:1f:6b:a5:ca:3d brd ff:ff:ff:ff:ff:ff 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout: altname enp1s0f1 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout: link/ether 02:42:b1:95:a8:69 brd ff:ff:ff:ff:ff:ff 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-23T18:23:11.777 INFO:teuthology.orchestra.run.smithi028.stdout: valid_lft forever preferred_lft forever 2024-04-23T18:23:11.778 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-23T18:23:11.778 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T18:23:11.778 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-04-23T18:23:11.779 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add name ceph-brx type bridge 2024-04-23T18:23:11.779 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr flush dev ceph-brx 2024-04-23T18:23:11.779 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set ceph-brx up 2024-04-23T18:23:11.779 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-23T18:23:11.779 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-04-23T18:23:11.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T18:23:11.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:23:11.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:23:11.934 DEBUG:teuthology.orchestra.run.smithi028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-23T18:23:11.953 INFO:teuthology.orchestra.run.smithi028.stdout:1 2024-04-23T18:23:11.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:23:11.955 DEBUG:teuthology.orchestra.run.smithi028:> route 2024-04-23T18:23:12.012 INFO:teuthology.orchestra.run.smithi028.stdout:Kernel IP routing table 2024-04-23T18:23:12.013 INFO:teuthology.orchestra.run.smithi028.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-23T18:23:12.013 INFO:teuthology.orchestra.run.smithi028.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-23T18:23:12.013 INFO:teuthology.orchestra.run.smithi028.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-23T18:23:12.013 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-23T18:23:12.013 INFO:teuthology.orchestra.run.smithi028.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-23T18:23:12.013 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T18:23:12.013 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-04-23T18:23:12.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-23T18:23:12.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-23T18:23:12.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-23T18:23:12.014 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-04-23T18:23:12.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T18:23:12.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:23:12.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:23:12.156 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-04-23T18:23:12.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:23:12.165 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list-id 2024-04-23T18:23:12.222 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T18:23:12.222 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-04-23T18:23:12.222 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T18:23:12.222 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-23T18:23:12.222 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-04-23T18:23:12.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T18:23:12.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:23:12.348 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-23T18:23:12.348 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T18:23:12.348 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-04-23T18:23:12.348 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-23T18:23:12.348 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-23T18:23:12.348 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-23T18:23:12.348 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-23T18:23:12.349 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-23T18:23:12.349 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-04-23T18:23:12.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T18:23:12.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:23:12.536 DEBUG:teuthology.orchestra.run.smithi028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T18:23:12.536 DEBUG:teuthology.orchestra.run.smithi028:> set -e 2024-04-23T18:23:12.536 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set brx.0 up 2024-04-23T18:23:12.536 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link set dev brx.0 master ceph-brx 2024-04-23T18:23:12.536 DEBUG:teuthology.orchestra.run.smithi028:> ') 2024-04-23T18:23:12.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T18:23:12.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:23:12.622 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T18:23:12.622 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-23T18:23:12.675 INFO:teuthology.orchestra.run.smithi028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-23T18:23:12.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T18:23:12.676 DEBUG:teuthology.orchestra.run.smithi028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-23T18:23:12.727 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-23T18:23:12.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:23:12.727 DEBUG:teuthology.orchestra.run.smithi028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-23T18:23:12.816 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-23T18:23:12.816 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-23T18:23:13.443 INFO:teuthology.orchestra.run.smithi028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-23T18:23:13.443 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-23T18:23:13.443 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-04-23T18:23:13.443 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: trying mount with new device syntax: 0@d84cc156-ceaf-4cae-a89c-ee7e55af72c5.cephfs=/ 2024-04-23T18:23:13.443 INFO:teuthology.orchestra.run.smithi028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.28:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-04-23T18:23:13.447 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-23T18:23:13.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:23:13.447 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-23T18:23:13.468 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T18:23:13.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T18:23:13.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:23:13.578 INFO:teuthology.orchestra.run.smithi028.stdout:client4896 2024-04-23T18:23:13.578 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:23:13.578 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T18:23:13.587 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T18:23:13.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T18:23:13.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:23:13.691 INFO:teuthology.orchestra.run.smithi028.stdout:client4896 2024-04-23T18:23:13.691 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-23T18:23:13.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T18:23:13.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:23:13.754 INFO:teuthology.orchestra.run.smithi028.stdout:client4896 2024-04-23T18:23:13.754 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d84cc156-ceaf-4cae-a89c-ee7e55af72c5.client4896/status') 2024-04-23T18:23:13.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T18:23:13.815 INFO:teuthology.orchestra.run.smithi028.stdout:instance: client.4896 (3)192.168.0.1:0/1348361242 2024-04-23T18:23:13.815 INFO:teuthology.orchestra.run.smithi028.stdout:blocklisted: false 2024-04-23T18:23:13.815 INFO:teuthology.orchestra.run.smithi028.stderr:0+1 records in 2024-04-23T18:23:13.816 INFO:teuthology.orchestra.run.smithi028.stderr:0+1 records out 2024-04-23T18:23:13.816 INFO:teuthology.orchestra.run.smithi028.stderr:69 bytes copied, 5.5638e-05 s, 1.2 MB/s 2024-04-23T18:23:13.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T18:23:13.824 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-23T18:23:13.837 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:23:13.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31c6200640 1 Processor -- start 2024-04-23T18:23:13.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31c6200640 1 -- start start 2024-04-23T18:23:13.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31c6200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f31c0151f90 0x7f31c00718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:13.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31c6200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f31c0072080 0x7f31c00c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:13.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31c6200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c00c9de0 con 0x7f31c0152370 2024-04-23T18:23:13.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31c6200640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f31c00ca080 con 0x7f31c0072080 2024-04-23T18:23:13.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31c6200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f31c0158cf0 con 0x7f31c0151f90 2024-04-23T18:23:13.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31b6a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f31c0072080 0x7f31c00c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:13.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31b6a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f31c0072080 0x7f31c00c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55968/0 (socket says 172.21.15.28:55968) 2024-04-23T18:23:13.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31bfe00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f31c0152370 0x7f31c015b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60818/0 (socket says 172.21.15.28:60818) 2024-04-23T18:23:13.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31b6a00640 1 -- 172.21.15.28:0/3425770730 learned_addr learned my addr 172.21.15.28:0/3425770730 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:13.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.983+0000 7f31bf400640 1 --2- 172.21.15.28:0/3425770730 >> v2:172.21.15.137:3300/0 conn(0x7f31c0151f90 0x7f31c00718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:13.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31b6a00640 1 -- 172.21.15.28:0/3425770730 >> v2:172.21.15.137:3300/0 conn(0x7f31c0151f90 msgr2=0x7f31c00718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:13.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31b6a00640 1 --2- 172.21.15.28:0/3425770730 >> v2:172.21.15.137:3300/0 conn(0x7f31c0151f90 0x7f31c00718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:13.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31b6a00640 1 -- 172.21.15.28:0/3425770730 >> v1:172.21.15.28:6789/0 conn(0x7f31c0152370 legacy=0x7f31c015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:13.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31b6a00640 1 -- 172.21.15.28:0/3425770730 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c0157f30 con 0x7f31c0072080 2024-04-23T18:23:13.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31bea00640 1 -- 172.21.15.28:0/3425770730 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3762623458 0 0) 0x7f31c00c9de0 con 0x7f31c0152370 2024-04-23T18:23:13.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31bf400640 1 --2- 172.21.15.28:0/3425770730 >> v2:172.21.15.137:3300/0 conn(0x7f31c0151f90 0x7f31c00718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:13.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31b6a00640 1 --2- 172.21.15.28:0/3425770730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31c0072080 0x7f31c00c96a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31c00c8fd0 tx=0x7f31a801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a781c285d3b830 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:13.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31bea00640 1 -- 172.21.15.28:0/3425770730 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a80b4070 con 0x7f31c0072080 2024-04-23T18:23:13.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31bea00640 1 -- 172.21.15.28:0/3425770730 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a80af400 con 0x7f31c0072080 2024-04-23T18:23:13.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31bea00640 1 -- 172.21.15.28:0/3425770730 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a80af7d0 con 0x7f31c0072080 2024-04-23T18:23:13.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31c6200640 1 -- 172.21.15.28:0/3425770730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31c0072080 msgr2=0x7f31c00c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:13.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31c6200640 1 --2- 172.21.15.28:0/3425770730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31c0072080 0x7f31c00c96a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31c00c8fd0 tx=0x7f31a801f1e0 comp rx=0 tx=0).stop 2024-04-23T18:23:13.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31c6200640 1 -- 172.21.15.28:0/3425770730 shutdown_connections 2024-04-23T18:23:13.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31c6200640 1 --2- 172.21.15.28:0/3425770730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31c0072080 0x7f31c00c96a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:13.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31c6200640 1 --2- 172.21.15.28:0/3425770730 >> v2:172.21.15.137:3300/0 conn(0x7f31c0151f90 0x7f31c00718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:13.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31c6200640 1 -- 172.21.15.28:0/3425770730 >> 172.21.15.28:0/3425770730 conn(0x7f31c006d0a0 msgr2=0x7f31c00676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:13.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31c6200640 1 -- 172.21.15.28:0/3425770730 shutdown_connections 2024-04-23T18:23:13.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.987+0000 7f31c6200640 1 -- 172.21.15.28:0/3425770730 wait complete. 2024-04-23T18:23:13.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31c6200640 1 Processor -- start 2024-04-23T18:23:13.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31c6200640 1 -- start start 2024-04-23T18:23:13.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31c6200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31c0072080 0x7f31c014adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:13.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31c6200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c0151f90 0x7f31c014bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:13.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31c6200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31c0152370 0x7f31c0072460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:13.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31c6200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f31c01587d0 con 0x7f31c0072080 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31c6200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f31c01584f0 con 0x7f31c0151f90 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31c6200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f31c015baa0 con 0x7f31c0152370 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31bf400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31c0072080 0x7f31c014adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31bf400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31c0072080 0x7f31c014adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55970/0 (socket says 172.21.15.28:55970) 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31bf400640 1 -- 172.21.15.28:0/4072285360 learned_addr learned my addr 172.21.15.28:0/4072285360 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31b6a00640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c0151f90 0x7f31c014bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31bfe00640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31c0152370 0x7f31c0072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31bf400640 1 -- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31c0152370 msgr2=0x7f31c0072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31bf400640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31c0152370 0x7f31c0072460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31bf400640 1 -- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c0151f90 msgr2=0x7f31c014bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31bf400640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c0151f90 0x7f31c014bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:13.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31bf400640 1 -- 172.21.15.28:0/4072285360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c00caf00 con 0x7f31c0072080 2024-04-23T18:23:13.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31bf400640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31c0072080 0x7f31c014adc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f31b000e840 tx=0x7f31b000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:13.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31b7e00640 1 -- 172.21.15.28:0/4072285360 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0017070 con 0x7f31c0072080 2024-04-23T18:23:13.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31b7e00640 1 -- 172.21.15.28:0/4072285360 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b000c8d0 con 0x7f31c0072080 2024-04-23T18:23:13.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31b7e00640 1 -- 172.21.15.28:0/4072285360 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b000f040 con 0x7f31c0072080 2024-04-23T18:23:13.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31c6200640 1 -- 172.21.15.28:0/4072285360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c00ca660 con 0x7f31c0072080 2024-04-23T18:23:13.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.991+0000 7f31c6200640 1 -- 172.21.15.28:0/4072285360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c00cac20 con 0x7f31c0072080 2024-04-23T18:23:13.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.995+0000 7f31c6200640 1 -- 172.21.15.28:0/4072285360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c0068cd0 con 0x7f31c0072080 2024-04-23T18:23:13.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.995+0000 7f31b7e00640 1 -- 172.21.15.28:0/4072285360 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31b001a070 con 0x7f31c0072080 2024-04-23T18:23:13.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.995+0000 7f31b7e00640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f319c0683b0 0x7f319c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:13.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.995+0000 7f31b7e00640 1 -- 172.21.15.28:0/4072285360 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7f31b00869e0 con 0x7f31c0072080 2024-04-23T18:23:13.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.995+0000 7f31b6a00640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f319c0683b0 0x7f319c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:13.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.995+0000 7f31b6a00640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f319c0683b0 0x7f319c06a870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f31a80b1000 tx=0x7f31a80aa000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:13.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:13.999+0000 7f31b7e00640 1 -- 172.21.15.28:0/4072285360 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31b0056b00 con 0x7f31c0072080 2024-04-23T18:23:14.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.167+0000 7f31c6200640 1 -- 172.21.15.28:0/4072285360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31c00c4420 con 0x7f31c0072080 2024-04-23T18:23:14.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31b7e00640 1 -- 172.21.15.28:0/4072285360 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18891 (secure 0 0 0) 0x7f31b0056400 con 0x7f31c0072080 2024-04-23T18:23:14.164 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:14.164 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":25,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:23:13.690179+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:23:14.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 -- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f319c0683b0 msgr2=0x7f319c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f319c0683b0 0x7f319c06a870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f31a80b1000 tx=0x7f31a80aa000 comp rx=0 tx=0).stop 2024-04-23T18:23:14.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 -- 172.21.15.28:0/4072285360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31c0072080 msgr2=0x7f31c014adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31c0072080 0x7f31c014adc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f31b000e840 tx=0x7f31b000ed00 comp rx=0 tx=0).stop 2024-04-23T18:23:14.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 -- 172.21.15.28:0/4072285360 shutdown_connections 2024-04-23T18:23:14.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f319c0683b0 0x7f319c06a870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31c0152370 0x7f31c0072460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31c0151f90 0x7f31c014bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 --2- 172.21.15.28:0/4072285360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f31c0072080 0x7f31c014adc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 -- 172.21.15.28:0/4072285360 >> 172.21.15.28:0/4072285360 conn(0x7f31c006d0a0 msgr2=0x7f31c00c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:14.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 -- 172.21.15.28:0/4072285360 shutdown_connections 2024-04-23T18:23:14.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.171+0000 7f31c6200640 1 -- 172.21.15.28:0/4072285360 wait complete. 2024-04-23T18:23:14.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T18:22:19.363864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T18:22:31.040656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T18:22:31.703845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T18:22:35.387908+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T18:23:14.186 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T18:23:14.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.335+0000 7f42dd800640 1 Processor -- start 2024-04-23T18:23:14.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.335+0000 7f42dd800640 1 -- start start 2024-04-23T18:23:14.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.335+0000 7f42dd800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f42d814f8d0 0x7f42d8158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.335+0000 7f42dd800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d8073520 con 0x7f42d8073050 2024-04-23T18:23:14.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.335+0000 7f42dd800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d80737e0 con 0x7f42d80c9e50 2024-04-23T18:23:14.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.335+0000 7f42dd800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f42d8073da0 con 0x7f42d814f8d0 2024-04-23T18:23:14.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.335+0000 7f42ce000640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f42d8073050 0x7f42d80c7230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60830/0 (socket says 172.21.15.28:60830) 2024-04-23T18:23:14.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.335+0000 7f42ce000640 1 -- 172.21.15.28:0/2509138109 learned_addr learned my addr 172.21.15.28:0/2509138109 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.335+0000 7f42d6a00640 1 --2- 172.21.15.28:0/2509138109 >> v2:172.21.15.137:3300/0 conn(0x7f42d814f8d0 0x7f42d8158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.335+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286714284 0 0) 0x7f42d8073520 con 0x7f42d8073050 2024-04-23T18:23:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42bc003530 con 0x7f42d8073050 2024-04-23T18:23:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2617194626 0 0) 0x7f42bc003530 con 0x7f42d8073050 2024-04-23T18:23:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 >> v2:172.21.15.137:3300/0 conn(0x7f42d814f8d0 msgr2=0x7f42d8158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 --2- 172.21.15.28:0/2509138109 >> v2:172.21.15.137:3300/0 conn(0x7f42d814f8d0 0x7f42d8158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 >> v1:172.21.15.137:6789/0 conn(0x7f42d80c9e50 legacy=0x7f42d8163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d8073ac0 con 0x7f42d8073050 2024-04-23T18:23:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f42c0001680 con 0x7f42d8073050 2024-04-23T18:23:14.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6a00640 1 --2- 172.21.15.28:0/2509138109 >> v2:172.21.15.137:3300/0 conn(0x7f42d814f8d0 0x7f42d8158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 >> v1:172.21.15.28:6789/0 conn(0x7f42d8073050 legacy=0x7f42d80c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 --2- 172.21.15.28:0/2509138109 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42bc0039c0 0x7f42bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 --2- 172.21.15.28:0/2509138109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42bc004810 0x7f42bc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 --2- 172.21.15.28:0/2509138109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42bc0052f0 0x7f42bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f42d8073da0 con 0x7f42bc004810 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc00c1c0 con 0x7f42bc0052f0 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f42bc00c3c0 con 0x7f42bc0039c0 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42ce000640 1 --2- 172.21.15.28:0/2509138109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42bc004810 0x7f42bc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d7400640 1 --2- 172.21.15.28:0/2509138109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42bc0052f0 0x7f42bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d6a00640 1 --2- 172.21.15.28:0/2509138109 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42bc0039c0 0x7f42bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42ce000640 1 -- 172.21.15.28:0/2509138109 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42bc0039c0 msgr2=0x7f42bc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:14.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42ce000640 1 --2- 172.21.15.28:0/2509138109 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42bc0039c0 0x7f42bc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42ce000640 1 -- 172.21.15.28:0/2509138109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42bc0052f0 msgr2=0x7f42bc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:14.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42ce000640 1 --2- 172.21.15.28:0/2509138109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42bc0052f0 0x7f42bc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42ce000640 1 -- 172.21.15.28:0/2509138109 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc003530 con 0x7f42bc004810 2024-04-23T18:23:14.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42d7400640 1 -- 172.21.15.28:0/2509138109 reap_dead start 2024-04-23T18:23:14.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.339+0000 7f42ce000640 1 --2- 172.21.15.28:0/2509138109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42bc004810 0x7f42bc004c90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f42d8073450 tx=0x7f42c001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ce302ff0442e8c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:14.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0007d20 con 0x7f42bc004810 2024-04-23T18:23:14.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c00a9070 con 0x7f42bc004810 2024-04-23T18:23:14.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42d6000640 1 -- 172.21.15.28:0/2509138109 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00a5d90 con 0x7f42bc004810 2024-04-23T18:23:14.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 -- 172.21.15.28:0/2509138109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42bc004810 msgr2=0x7f42bc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 --2- 172.21.15.28:0/2509138109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42bc004810 0x7f42bc004c90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f42d8073450 tx=0x7f42c001cbf0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 -- 172.21.15.28:0/2509138109 shutdown_connections 2024-04-23T18:23:14.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 --2- 172.21.15.28:0/2509138109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42bc004810 0x7f42bc004c90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 -- 172.21.15.28:0/2509138109 >> 172.21.15.28:0/2509138109 conn(0x7f42d80c9330 msgr2=0x7f42d80c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:14.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 -- 172.21.15.28:0/2509138109 shutdown_connections 2024-04-23T18:23:14.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 -- 172.21.15.28:0/2509138109 wait complete. 2024-04-23T18:23:14.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 Processor -- start 2024-04-23T18:23:14.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 -- start start 2024-04-23T18:23:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42bc004810 0x7f42d814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42d81410b0 0x7f42d8141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42d8141e20 0x7f42d81422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f42d8072e50 con 0x7f42d8141e20 2024-04-23T18:23:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42d81592f0 con 0x7f42bc004810 2024-04-23T18:23:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42dd800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f42d80c7a40 con 0x7f42d81410b0 2024-04-23T18:23:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42d7400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42d8141e20 0x7f42d81422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42d7400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42d8141e20 0x7f42d81422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55998/0 (socket says 172.21.15.28:55998) 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42d7400640 1 -- 172.21.15.28:0/1656935585 learned_addr learned my addr 172.21.15.28:0/1656935585 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42d6a00640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42bc004810 0x7f42d814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.343+0000 7f42ce000640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42d81410b0 0x7f42d8141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42d7400640 1 -- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42d81410b0 msgr2=0x7f42d8141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42d7400640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42d81410b0 0x7f42d8141510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42d7400640 1 -- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42bc004810 msgr2=0x7f42d814e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42d7400640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42bc004810 0x7f42d814e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42d7400640 1 -- 172.21.15.28:0/1656935585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d81427e0 con 0x7f42d8141e20 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42d7400640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42d8141e20 0x7f42d81422a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f42d80765c0 tx=0x7f42d000e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42cf400640 1 -- 172.21.15.28:0/1656935585 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0019070 con 0x7f42d8141e20 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42cf400640 1 -- 172.21.15.28:0/1656935585 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d0006d70 con 0x7f42d8141e20 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42dd800640 1 -- 172.21.15.28:0/1656935585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d81f04c0 con 0x7f42d8141e20 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42cf400640 1 -- 172.21.15.28:0/1656935585 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0003ba0 con 0x7f42d8141e20 2024-04-23T18:23:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42dd800640 1 -- 172.21.15.28:0/1656935585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d81f0a80 con 0x7f42d8141e20 2024-04-23T18:23:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42dd800640 1 -- 172.21.15.28:0/1656935585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d8068db0 con 0x7f42d8141e20 2024-04-23T18:23:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42cf400640 1 -- 172.21.15.28:0/1656935585 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f42d001c070 con 0x7f42d8141e20 2024-04-23T18:23:14.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42cf400640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f42b40683b0 0x7f42b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42cf400640 1 -- 172.21.15.28:0/1656935585 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7f42d00860e0 con 0x7f42d8141e20 2024-04-23T18:23:14.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.347+0000 7f42d6a00640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f42b40683b0 0x7f42b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.351+0000 7f42d6a00640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f42b40683b0 0x7f42b406a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f42d806a3e0 tx=0x7f42c8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:14.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.351+0000 7f42cf400640 1 -- 172.21.15.28:0/1656935585 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f42d81427e0 con 0x7f42d8141e20 2024-04-23T18:23:14.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 -- 172.21.15.28:0/1656935585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f42d8149230 con 0x7f42d8141e20 2024-04-23T18:23:14.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42cf400640 1 -- 172.21.15.28:0/1656935585 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f42d0055bb0 con 0x7f42d8141e20 2024-04-23T18:23:14.513 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-04-23T18:23:14.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 -- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f42b40683b0 msgr2=0x7f42b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f42b40683b0 0x7f42b406a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f42d806a3e0 tx=0x7f42c8008040 comp rx=0 tx=0).stop 2024-04-23T18:23:14.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 -- 172.21.15.28:0/1656935585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42d8141e20 msgr2=0x7f42d81422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42d8141e20 0x7f42d81422a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f42d80765c0 tx=0x7f42d000e920 comp rx=0 tx=0).stop 2024-04-23T18:23:14.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 -- 172.21.15.28:0/1656935585 shutdown_connections 2024-04-23T18:23:14.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f42b40683b0 0x7f42b406a870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f42d81410b0 0x7f42d8141510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42d8141e20 0x7f42d81422a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 --2- 172.21.15.28:0/1656935585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42bc004810 0x7f42d814e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 -- 172.21.15.28:0/1656935585 >> 172.21.15.28:0/1656935585 conn(0x7f42d80c9330 msgr2=0x7f42d80c3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:14.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 -- 172.21.15.28:0/1656935585 shutdown_connections 2024-04-23T18:23:14.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.519+0000 7f42dd800640 1 -- 172.21.15.28:0/1656935585 wait complete. 2024-04-23T18:23:14.533 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T18:23:14.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.683+0000 7f041fc00640 1 Processor -- start 2024-04-23T18:23:14.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.683+0000 7f041fc00640 1 -- start start 2024-04-23T18:23:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.683+0000 7f041fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f041814f8d0 0x7f0418158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041fc00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0418073520 con 0x7f04180c9e50 2024-04-23T18:23:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041fc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04180737e0 con 0x7f0418073050 2024-04-23T18:23:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0418073da0 con 0x7f041814f8d0 2024-04-23T18:23:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041dc00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f04180c9e50 0x7f0418163860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60836/0 (socket says 172.21.15.28:60836) 2024-04-23T18:23:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041dc00640 1 -- 172.21.15.28:0/706628626 learned_addr learned my addr 172.21.15.28:0/706628626 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041d200640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f041814f8d0 0x7f0418158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668399801 0 0) 0x7f0418073520 con 0x7f04180c9e50 2024-04-23T18:23:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03fc003530 con 0x7f04180c9e50 2024-04-23T18:23:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 192181330 0 0) 0x7f04180737e0 con 0x7f0418073050 2024-04-23T18:23:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0418073520 con 0x7f0418073050 2024-04-23T18:23:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4095045048 0 0) 0x7f03fc003530 con 0x7f04180c9e50 2024-04-23T18:23:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f041814f8d0 msgr2=0x7f0418158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f041814f8d0 0x7f0418158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 >> v1:172.21.15.137:6789/0 conn(0x7f0418073050 legacy=0x7f04180c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0418073ac0 con 0x7f04180c9e50 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f0410001a00 con 0x7f04180c9e50 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 >> v1:172.21.15.28:6789/0 conn(0x7f04180c9e50 legacy=0x7f0418163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03fc003b80 0x7f03fc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03fc004810 0x7f03fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03fc0051d0 0x7f03fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0418073da0 con 0x7f03fc0051d0 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc00c040 con 0x7f03fc003b80 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f03fc00c240 con 0x7f03fc004810 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041dc00640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03fc0051d0 0x7f03fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041d200640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03fc003b80 0x7f03fc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f040fe00640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03fc004810 0x7f03fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041dc00640 1 -- 172.21.15.28:0/706628626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03fc004810 msgr2=0x7f03fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041dc00640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03fc004810 0x7f03fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041dc00640 1 -- 172.21.15.28:0/706628626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03fc003b80 msgr2=0x7f03fc003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041dc00640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03fc003b80 0x7f03fc003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.687+0000 7f041dc00640 1 -- 172.21.15.28:0/706628626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03fc003530 con 0x7f03fc0051d0 2024-04-23T18:23:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f041dc00640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03fc0051d0 0x7f03fc00b9d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f041000a7c0 tx=0x7f041001d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48317bb9309ebf20 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041000a410 con 0x7f03fc0051d0 2024-04-23T18:23:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04100ad630 con 0x7f03fc0051d0 2024-04-23T18:23:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f0417e00640 1 -- 172.21.15.28:0/706628626 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04100ada20 con 0x7f03fc0051d0 2024-04-23T18:23:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f041fc00640 1 -- 172.21.15.28:0/706628626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03fc0051d0 msgr2=0x7f03fc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f041fc00640 1 --2- 172.21.15.28:0/706628626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03fc0051d0 0x7f03fc00b9d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f041000a7c0 tx=0x7f041001d2c0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f041dc00640 1 -- 172.21.15.28:0/706628626 reap_dead start 2024-04-23T18:23:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f041fc00640 1 -- 172.21.15.28:0/706628626 shutdown_connections 2024-04-23T18:23:14.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f041fc00640 1 -- 172.21.15.28:0/706628626 >> 172.21.15.28:0/706628626 conn(0x7f04180c9330 msgr2=0x7f04180c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:14.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f041fc00640 1 -- 172.21.15.28:0/706628626 shutdown_connections 2024-04-23T18:23:14.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f041fc00640 1 -- 172.21.15.28:0/706628626 wait complete. 2024-04-23T18:23:14.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f041fc00640 1 Processor -- start 2024-04-23T18:23:14.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.691+0000 7f041fc00640 1 -- start start 2024-04-23T18:23:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f041fc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03fc0051d0 0x7f041814dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f041fc00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f041813ccb0 0x7f041814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f041fc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0418139f80 0x7f04181f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f041fc00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0418153580 con 0x7f041813ccb0 2024-04-23T18:23:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f041fc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04180c63e0 con 0x7f0418139f80 2024-04-23T18:23:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f041fc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f041814fcb0 con 0x7f03fc0051d0 2024-04-23T18:23:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f040fe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f041813ccb0 0x7f041814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f040fe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f041813ccb0 0x7f041814e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56012/0 (socket says 172.21.15.28:56012) 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f040fe00640 1 -- 172.21.15.28:0/2383176404 learned_addr learned my addr 172.21.15.28:0/2383176404 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f041d200640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03fc0051d0 0x7f041814dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f041dc00640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0418139f80 0x7f04181f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f040fe00640 1 -- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03fc0051d0 msgr2=0x7f041814dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f040fe00640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03fc0051d0 0x7f041814dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f040fe00640 1 -- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0418139f80 msgr2=0x7f04181f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f040fe00640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0418139f80 0x7f04181f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f040fe00640 1 -- 172.21.15.28:0/2383176404 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041814ec70 con 0x7f041813ccb0 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f040fe00640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f041813ccb0 0x7f041814e560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0400012860 tx=0x7f0400012c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f0415600640 1 -- 172.21.15.28:0/2383176404 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400010bd0 con 0x7f041813ccb0 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f0415600640 1 -- 172.21.15.28:0/2383176404 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040001b070 con 0x7f041813ccb0 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f0415600640 1 -- 172.21.15.28:0/2383176404 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400016480 con 0x7f041813ccb0 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f041fc00640 1 -- 172.21.15.28:0/2383176404 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041814ef50 con 0x7f041813ccb0 2024-04-23T18:23:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f041fc00640 1 -- 172.21.15.28:0/2383176404 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f041814c790 con 0x7f041813ccb0 2024-04-23T18:23:14.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f041fc00640 1 -- 172.21.15.28:0/2383176404 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0418068db0 con 0x7f041813ccb0 2024-04-23T18:23:14.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.695+0000 7f0415600640 1 -- 172.21.15.28:0/2383176404 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0400016620 con 0x7f041813ccb0 2024-04-23T18:23:14.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.699+0000 7f0415600640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f03f4068380 0x7f03f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:14.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.699+0000 7f0415600640 1 -- 172.21.15.28:0/2383176404 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7f040008a600 con 0x7f041813ccb0 2024-04-23T18:23:14.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.699+0000 7f041d200640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f03f4068380 0x7f03f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:14.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.699+0000 7f041d200640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f03f4068380 0x7f03f406a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f04180ca3f0 tx=0x7f0408008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:14.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.703+0000 7f0415600640 1 -- 172.21.15.28:0/2383176404 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f040005a720 con 0x7f041813ccb0 2024-04-23T18:23:14.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.879+0000 7f041fc00640 1 -- 172.21.15.28:0/2383176404 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0418140460 con 0x7f041813ccb0 2024-04-23T18:23:14.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f0415600640 1 -- 172.21.15.28:0/2383176404 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f040005a020 con 0x7f041813ccb0 2024-04-23T18:23:14.876 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:23:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 -- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f03f4068380 msgr2=0x7f03f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f03f4068380 0x7f03f406a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f04180ca3f0 tx=0x7f0408008040 comp rx=0 tx=0).stop 2024-04-23T18:23:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 -- 172.21.15.28:0/2383176404 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f041813ccb0 msgr2=0x7f041814e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f041813ccb0 0x7f041814e560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0400012860 tx=0x7f0400012c60 comp rx=0 tx=0).stop 2024-04-23T18:23:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 -- 172.21.15.28:0/2383176404 shutdown_connections 2024-04-23T18:23:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f03f4068380 0x7f03f406a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0418139f80 0x7f04181f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f041813ccb0 0x7f041814e560 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 --2- 172.21.15.28:0/2383176404 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f03fc0051d0 0x7f041814dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 -- 172.21.15.28:0/2383176404 >> 172.21.15.28:0/2383176404 conn(0x7f04180c9330 msgr2=0x7f0418159290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 -- 172.21.15.28:0/2383176404 shutdown_connections 2024-04-23T18:23:14.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:14.883+0000 7f041fc00640 1 -- 172.21.15.28:0/2383176404 wait complete. 2024-04-23T18:23:14.897 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T18:23:15.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a4800640 1 Processor -- start 2024-04-23T18:23:15.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a4800640 1 -- start start 2024-04-23T18:23:15.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a4800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c152de0 0x7fe29c0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a4800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe29c0c6770 con 0x7fe29c0c89d0 2024-04-23T18:23:15.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a4800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe29c1590a0 con 0x7fe29c0c6220 2024-04-23T18:23:15.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a4800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe29c159e60 con 0x7fe29c152de0 2024-04-23T18:23:15.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a2800640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe29c0c89d0 0x7fe29c0c91e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60852/0 (socket says 172.21.15.28:60852) 2024-04-23T18:23:15.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a2800640 1 -- 172.21.15.28:0/2603804089 learned_addr learned my addr 172.21.15.28:0/2603804089 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:15.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a1e00640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c152de0 0x7fe29c0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2218423943 0 0) 0x7fe29c0c6770 con 0x7fe29c0c89d0 2024-04-23T18:23:15.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe284003530 con 0x7fe29c0c89d0 2024-04-23T18:23:15.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2336165264 0 0) 0x7fe29c1590a0 con 0x7fe29c0c6220 2024-04-23T18:23:15.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe29c0c6770 con 0x7fe29c0c6220 2024-04-23T18:23:15.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1839556883 0 0) 0x7fe284003530 con 0x7fe29c0c89d0 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c152de0 msgr2=0x7fe29c0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c152de0 0x7fe29c0c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 >> v1:172.21.15.137:6789/0 conn(0x7fe29c0c6220 legacy=0x7fe29c15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c159380 con 0x7fe29c0c89d0 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7fe298001a00 con 0x7fe29c0c89d0 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 >> v1:172.21.15.28:6789/0 conn(0x7fe29c0c89d0 legacy=0x7fe29c0c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c152de0 0x7fe284003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 0x7fe284004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe284004d50 0x7fe2840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c159e60 con 0x7fe2840040e0 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe28400bab0 con 0x7fe284004d50 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.047+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe28400bcb0 con 0x7fe29c152de0 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a1400640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 0x7fe284004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a1e00640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c152de0 0x7fe284003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a2800640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe284004d50 0x7fe2840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a1400640 1 -- 172.21.15.28:0/2603804089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c152de0 msgr2=0x7fe284003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:15.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a1400640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c152de0 0x7fe284003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a1400640 1 -- 172.21.15.28:0/2603804089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe284004d50 msgr2=0x7fe2840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:15.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a1400640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe284004d50 0x7fe2840051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a1400640 1 -- 172.21.15.28:0/2603804089 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe284003530 con 0x7fe2840040e0 2024-04-23T18:23:15.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a1400640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 0x7fe284004810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0018d0 tx=0x7fe28c01c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b6af280c73864b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:15.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c001520 con 0x7fe2840040e0 2024-04-23T18:23:15.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28c0050d0 con 0x7fe2840040e0 2024-04-23T18:23:15.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.051+0000 7fe2a0a00640 1 -- 172.21.15.28:0/2603804089 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c003600 con 0x7fe2840040e0 2024-04-23T18:23:15.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 -- 172.21.15.28:0/2603804089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 msgr2=0x7fe284004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 --2- 172.21.15.28:0/2603804089 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 0x7fe284004810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0018d0 tx=0x7fe28c01c580 comp rx=0 tx=0).stop 2024-04-23T18:23:15.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a2800640 1 -- 172.21.15.28:0/2603804089 reap_dead start 2024-04-23T18:23:15.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 -- 172.21.15.28:0/2603804089 shutdown_connections 2024-04-23T18:23:15.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 -- 172.21.15.28:0/2603804089 >> 172.21.15.28:0/2603804089 conn(0x7fe29c0ce7e0 msgr2=0x7fe29c0cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:15.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 -- 172.21.15.28:0/2603804089 shutdown_connections 2024-04-23T18:23:15.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 -- 172.21.15.28:0/2603804089 wait complete. 2024-04-23T18:23:15.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 Processor -- start 2024-04-23T18:23:15.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 -- start start 2024-04-23T18:23:15.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 0x7fe29c0c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c06d790 0x7fe29c0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29c1f1520 0x7fe29c1f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c15cb90 con 0x7fe2840040e0 2024-04-23T18:23:15.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c159940 con 0x7fe29c1f1520 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a4800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe29c156d00 con 0x7fe29c06d790 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a1e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 0x7fe29c0c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a1e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 0x7fe29c0c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56020/0 (socket says 172.21.15.28:56020) 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a1e00640 1 -- 172.21.15.28:0/3866111960 learned_addr learned my addr 172.21.15.28:0/3866111960 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a2800640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29c1f1520 0x7fe29c1f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a1400640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c06d790 0x7fe29c0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a1e00640 1 -- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c06d790 msgr2=0x7fe29c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a1e00640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c06d790 0x7fe29c0cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a1e00640 1 -- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29c1f1520 msgr2=0x7fe29c1f19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a1e00640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29c1f1520 0x7fe29c1f19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a1e00640 1 -- 172.21.15.28:0/3866111960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c1f1020 con 0x7fe2840040e0 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.055+0000 7fe2a2800640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29c1f1520 0x7fe29c1f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:15.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.059+0000 7fe2a1e00640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 0x7fe29c0c94f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe2900119d0 tx=0x7fe290011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:15.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.059+0000 7fe296000640 1 -- 172.21.15.28:0/3866111960 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29000faf0 con 0x7fe2840040e0 2024-04-23T18:23:15.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.059+0000 7fe296000640 1 -- 172.21.15.28:0/3866111960 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29000fc90 con 0x7fe2840040e0 2024-04-23T18:23:15.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.059+0000 7fe296000640 1 -- 172.21.15.28:0/3866111960 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290014440 con 0x7fe2840040e0 2024-04-23T18:23:15.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.059+0000 7fe2a4800640 1 -- 172.21.15.28:0/3866111960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29c156f30 con 0x7fe2840040e0 2024-04-23T18:23:15.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.059+0000 7fe2a4800640 1 -- 172.21.15.28:0/3866111960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe29c06c3d0 con 0x7fe2840040e0 2024-04-23T18:23:15.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.059+0000 7fe2a4800640 1 -- 172.21.15.28:0/3866111960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe29c068db0 con 0x7fe2840040e0 2024-04-23T18:23:15.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.059+0000 7fe296000640 1 -- 172.21.15.28:0/3866111960 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe290012040 con 0x7fe2840040e0 2024-04-23T18:23:15.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.059+0000 7fe296000640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe2800683b0 0x7fe28006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.059+0000 7fe296000640 1 -- 172.21.15.28:0/3866111960 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe2900873c0 con 0x7fe2840040e0 2024-04-23T18:23:15.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.063+0000 7fe2a1400640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe2800683b0 0x7fe28006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.063+0000 7fe2a1400640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe2800683b0 0x7fe28006a870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0ad000 tx=0x7fe28c0a6040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:15.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.067+0000 7fe296000640 1 -- 172.21.15.28:0/3866111960 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe290019030 con 0x7fe2840040e0 2024-04-23T18:23:15.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.231+0000 7fe2a4800640 1 -- 172.21.15.28:0/3866111960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe29c151cc0 con 0x7fe2840040e0 2024-04-23T18:23:15.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.231+0000 7fe296000640 1 -- 172.21.15.28:0/3866111960 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fe2900575a0 con 0x7fe2840040e0 2024-04-23T18:23:15.227 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2024-04-23T18:23:15.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 -- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe2800683b0 msgr2=0x7fe28006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe2800683b0 0x7fe28006a870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0ad000 tx=0x7fe28c0a6040 comp rx=0 tx=0).stop 2024-04-23T18:23:15.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 -- 172.21.15.28:0/3866111960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 msgr2=0x7fe29c0c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 0x7fe29c0c94f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe2900119d0 tx=0x7fe290011e90 comp rx=0 tx=0).stop 2024-04-23T18:23:15.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 -- 172.21.15.28:0/3866111960 shutdown_connections 2024-04-23T18:23:15.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe2800683b0 0x7fe28006a870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe29c06d790 0x7fe29c0cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe29c1f1520 0x7fe29c1f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 --2- 172.21.15.28:0/3866111960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2840040e0 0x7fe29c0c94f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 -- 172.21.15.28:0/3866111960 >> 172.21.15.28:0/3866111960 conn(0x7fe29c0ce7e0 msgr2=0x7fe29c0cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:15.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 -- 172.21.15.28:0/3866111960 shutdown_connections 2024-04-23T18:23:15.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.235+0000 7fe2a4800640 1 -- 172.21.15.28:0/3866111960 wait complete. 2024-04-23T18:23:15.248 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T18:23:15.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.395+0000 7f304ac00640 1 Processor -- start 2024-04-23T18:23:15.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f304ac00640 1 -- start start 2024-04-23T18:23:15.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f304ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30441551b0 0x7f304415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f304ac00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f30440ca3e0 0x7f304406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f304ac00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30440ca870 con 0x7f30440c9fc0 2024-04-23T18:23:15.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f304ac00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f304415bbe0 con 0x7f30440ca3e0 2024-04-23T18:23:15.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f304ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f304415aff0 con 0x7f30441551b0 2024-04-23T18:23:15.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f3048c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f30440ca3e0 0x7f304406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f3048c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f30440ca3e0 0x7f304406b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56026/0 (socket says 172.21.15.28:56026) 2024-04-23T18:23:15.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f3048c00640 1 -- 172.21.15.28:0/3854340467 learned_addr learned my addr 172.21.15.28:0/3854340467 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:15.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f303b400640 1 --1- 172.21.15.28:0/3854340467 >> v1:172.21.15.28:6789/0 conn(0x7f30440c9fc0 0x7f3044073710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60856/0 (socket says 172.21.15.28:60856) 2024-04-23T18:23:15.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f3043e00640 1 --2- 172.21.15.28:0/3854340467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30441551b0 0x7f304415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f3048c00640 1 -- 172.21.15.28:0/3854340467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30441551b0 msgr2=0x7f304415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:15.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f3048c00640 1 --2- 172.21.15.28:0/3854340467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30441551b0 0x7f304415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f3048c00640 1 -- 172.21.15.28:0/3854340467 >> v1:172.21.15.28:6789/0 conn(0x7f30440c9fc0 legacy=0x7f3044073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f3048c00640 1 -- 172.21.15.28:0/3854340467 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304406c530 con 0x7f30440ca3e0 2024-04-23T18:23:15.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f3043400640 1 -- 172.21.15.28:0/3854340467 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3895449487 0 0) 0x7f3034001120 con 0x7f30440c9fc0 2024-04-23T18:23:15.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.399+0000 7f3043e00640 1 --2- 172.21.15.28:0/3854340467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30441551b0 0x7f304415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:15.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f3048c00640 1 --2- 172.21.15.28:0/3854340467 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30440ca3e0 0x7f304406b9e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f303c009e50 tx=0x7f303c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9206a7eb9ddcf14 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:15.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f3043400640 1 -- 172.21.15.28:0/3854340467 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c0a5700 con 0x7f30440ca3e0 2024-04-23T18:23:15.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f3043400640 1 -- 172.21.15.28:0/3854340467 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f303c0a58a0 con 0x7f30440ca3e0 2024-04-23T18:23:15.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f3043400640 1 -- 172.21.15.28:0/3854340467 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c0a5c70 con 0x7f30440ca3e0 2024-04-23T18:23:15.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f304ac00640 1 -- 172.21.15.28:0/3854340467 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30440ca3e0 msgr2=0x7f304406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f304ac00640 1 --2- 172.21.15.28:0/3854340467 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30440ca3e0 0x7f304406b9e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f303c009e50 tx=0x7f303c01ca30 comp rx=0 tx=0).stop 2024-04-23T18:23:15.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f304ac00640 1 -- 172.21.15.28:0/3854340467 shutdown_connections 2024-04-23T18:23:15.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f304ac00640 1 --2- 172.21.15.28:0/3854340467 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30440ca3e0 0x7f304406b9e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f304ac00640 1 --2- 172.21.15.28:0/3854340467 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30441551b0 0x7f304415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f304ac00640 1 -- 172.21.15.28:0/3854340467 >> 172.21.15.28:0/3854340467 conn(0x7f30440676e0 msgr2=0x7f3044067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:15.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f304ac00640 1 -- 172.21.15.28:0/3854340467 shutdown_connections 2024-04-23T18:23:15.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f304ac00640 1 -- 172.21.15.28:0/3854340467 wait complete. 2024-04-23T18:23:15.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f304ac00640 1 Processor -- start 2024-04-23T18:23:15.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.403+0000 7f304ac00640 1 -- start start 2024-04-23T18:23:15.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f304ac00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30440c9fc0 0x7f3044074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f304ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30440ca3e0 0x7f30440cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f304ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30441551b0 0x7f3044152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f304ac00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3044155710 con 0x7f30440c9fc0 2024-04-23T18:23:15.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f304ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3044155590 con 0x7f30440ca3e0 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f304ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3044073e20 con 0x7f30441551b0 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3043e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30440c9fc0 0x7f3044074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3043e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30440c9fc0 0x7f3044074290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56028/0 (socket says 172.21.15.28:56028) 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3043e00640 1 -- 172.21.15.28:0/798965412 learned_addr learned my addr 172.21.15.28:0/798965412 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3048c00640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30441551b0 0x7f3044152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f303b400640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30440ca3e0 0x7f30440cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3043e00640 1 -- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30441551b0 msgr2=0x7f3044152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3043e00640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30441551b0 0x7f3044152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3043e00640 1 -- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30440ca3e0 msgr2=0x7f30440cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3043e00640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30440ca3e0 0x7f30440cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3043e00640 1 -- 172.21.15.28:0/798965412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304415ca60 con 0x7f30440c9fc0 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3043e00640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30440c9fc0 0x7f3044074290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f302c00d830 tx=0x7f302c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3040c00640 1 -- 172.21.15.28:0/798965412 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c00b6c0 con 0x7f30440c9fc0 2024-04-23T18:23:15.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3040c00640 1 -- 172.21.15.28:0/798965412 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302c019070 con 0x7f30440c9fc0 2024-04-23T18:23:15.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3040c00640 1 -- 172.21.15.28:0/798965412 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c00baa0 con 0x7f30440c9fc0 2024-04-23T18:23:15.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f304ac00640 1 -- 172.21.15.28:0/798965412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30441f7c60 con 0x7f30440c9fc0 2024-04-23T18:23:15.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f304ac00640 1 -- 172.21.15.28:0/798965412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30441f7f00 con 0x7f30440c9fc0 2024-04-23T18:23:15.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f304ac00640 1 -- 172.21.15.28:0/798965412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3044068db0 con 0x7f30440c9fc0 2024-04-23T18:23:15.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.407+0000 7f3040c00640 1 -- 172.21.15.28:0/798965412 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f302c01e460 con 0x7f30440c9fc0 2024-04-23T18:23:15.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.411+0000 7f3040c00640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3020068380 0x7f302006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.411+0000 7f3040c00640 1 -- 172.21.15.28:0/798965412 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f302c087540 con 0x7f30440c9fc0 2024-04-23T18:23:15.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.411+0000 7f303b400640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3020068380 0x7f302006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.411+0000 7f303b400640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3020068380 0x7f302006a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3034007fd0 tx=0x7f3034007980 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:15.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.415+0000 7f3040c00640 1 -- 172.21.15.28:0/798965412 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f302c0575d0 con 0x7f30440c9fc0 2024-04-23T18:23:15.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.575+0000 7f304ac00640 1 -- 172.21.15.28:0/798965412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f304413ea30 con 0x7f30440c9fc0 2024-04-23T18:23:15.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f3040c00640 1 -- 172.21.15.28:0/798965412 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f302c056ed0 con 0x7f30440c9fc0 2024-04-23T18:23:15.572 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:23:15.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 -- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3020068380 msgr2=0x7f302006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3020068380 0x7f302006a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3034007fd0 tx=0x7f3034007980 comp rx=0 tx=0).stop 2024-04-23T18:23:15.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 -- 172.21.15.28:0/798965412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30440c9fc0 msgr2=0x7f3044074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30440c9fc0 0x7f3044074290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f302c00d830 tx=0x7f302c00dcf0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 -- 172.21.15.28:0/798965412 shutdown_connections 2024-04-23T18:23:15.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3020068380 0x7f302006a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f30441551b0 0x7f3044152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30440ca3e0 0x7f30440cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 --2- 172.21.15.28:0/798965412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30440c9fc0 0x7f3044074290 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 -- 172.21.15.28:0/798965412 >> 172.21.15.28:0/798965412 conn(0x7f30440676e0 msgr2=0x7f3044070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:15.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 -- 172.21.15.28:0/798965412 shutdown_connections 2024-04-23T18:23:15.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.579+0000 7f304ac00640 1 -- 172.21.15.28:0/798965412 wait complete. 2024-04-23T18:23:15.593 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:23:15.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.739+0000 7fb715600640 1 Processor -- start 2024-04-23T18:23:15.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.739+0000 7fb715600640 1 -- start start 2024-04-23T18:23:15.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb715600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb710151f90 0x7fb7100718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb715600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb710152370 0x7fb7100c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb715600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7100c9de0 con 0x7fb710072080 2024-04-23T18:23:15.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb715600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fb7100ca080 con 0x7fb710152370 2024-04-23T18:23:15.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb715600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb710158cf0 con 0x7fb710151f90 2024-04-23T18:23:15.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb70f400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb710152370 0x7fb7100c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb70f400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb710152370 0x7fb7100c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56030/0 (socket says 172.21.15.28:56030) 2024-04-23T18:23:15.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb70f400640 1 -- 172.21.15.28:0/134479097 learned_addr learned my addr 172.21.15.28:0/134479097 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:15.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb70ea00640 1 --2- 172.21.15.28:0/134479097 >> v2:172.21.15.137:3300/0 conn(0x7fb710151f90 0x7fb7100718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb70f400640 1 -- 172.21.15.28:0/134479097 >> v2:172.21.15.137:3300/0 conn(0x7fb710151f90 msgr2=0x7fb7100718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:15.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb70f400640 1 --2- 172.21.15.28:0/134479097 >> v2:172.21.15.137:3300/0 conn(0x7fb710151f90 0x7fb7100718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb70f400640 1 -- 172.21.15.28:0/134479097 >> v1:172.21.15.137:6789/0 conn(0x7fb710072080 legacy=0x7fb71015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.743+0000 7fb70f400640 1 -- 172.21.15.28:0/134479097 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb710157f30 con 0x7fb710152370 2024-04-23T18:23:15.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb70f400640 1 --2- 172.21.15.28:0/134479097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb710152370 0x7fb7100c96a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb7100c8fd0 tx=0x7fb70801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b26a7e66134717 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:15.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb70e000640 1 -- 172.21.15.28:0/134479097 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7080b4070 con 0x7fb710152370 2024-04-23T18:23:15.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb70e000640 1 -- 172.21.15.28:0/134479097 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7080af400 con 0x7fb710152370 2024-04-23T18:23:15.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb70e000640 1 -- 172.21.15.28:0/134479097 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7080af7d0 con 0x7fb710152370 2024-04-23T18:23:15.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb715600640 1 -- 172.21.15.28:0/134479097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb710152370 msgr2=0x7fb7100c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb715600640 1 --2- 172.21.15.28:0/134479097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb710152370 0x7fb7100c96a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb7100c8fd0 tx=0x7fb70801f1e0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb715600640 1 -- 172.21.15.28:0/134479097 shutdown_connections 2024-04-23T18:23:15.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb715600640 1 --2- 172.21.15.28:0/134479097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb710152370 0x7fb7100c96a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb715600640 1 --2- 172.21.15.28:0/134479097 >> v2:172.21.15.137:3300/0 conn(0x7fb710151f90 0x7fb7100718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb715600640 1 -- 172.21.15.28:0/134479097 >> 172.21.15.28:0/134479097 conn(0x7fb71006d0a0 msgr2=0x7fb7100676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:15.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb715600640 1 -- 172.21.15.28:0/134479097 shutdown_connections 2024-04-23T18:23:15.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb715600640 1 -- 172.21.15.28:0/134479097 wait complete. 2024-04-23T18:23:15.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb715600640 1 Processor -- start 2024-04-23T18:23:15.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.747+0000 7fb715600640 1 -- start start 2024-04-23T18:23:15.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb715600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb710072080 0x7fb710159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb715600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb710151f90 0x7fb71014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb715600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb710152370 0x7fb71014b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb715600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb7101587d0 con 0x7fb710151f90 2024-04-23T18:23:15.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb715600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7101584f0 con 0x7fb710152370 2024-04-23T18:23:15.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb715600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fb71015baa0 con 0x7fb710072080 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb706000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb710151f90 0x7fb71014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb706000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb710151f90 0x7fb71014d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56036/0 (socket says 172.21.15.28:56036) 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb706000640 1 -- 172.21.15.28:0/4093042591 learned_addr learned my addr 172.21.15.28:0/4093042591 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb70f400640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb710152370 0x7fb71014b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb70ea00640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb710072080 0x7fb710159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb706000640 1 -- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb710072080 msgr2=0x7fb710159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb706000640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb710072080 0x7fb710159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb706000640 1 -- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb710152370 msgr2=0x7fb71014b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb706000640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb710152370 0x7fb71014b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb706000640 1 -- 172.21.15.28:0/4093042591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71014b9b0 con 0x7fb710151f90 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb706000640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb710151f90 0x7fb71014d550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c420 tx=0x7fb6f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:15.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb707400640 1 -- 172.21.15.28:0/4093042591 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80052d0 con 0x7fb710151f90 2024-04-23T18:23:15.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb707400640 1 -- 172.21.15.28:0/4093042591 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f8005470 con 0x7fb710151f90 2024-04-23T18:23:15.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb715600640 1 -- 172.21.15.28:0/4093042591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71014eb90 con 0x7fb710151f90 2024-04-23T18:23:15.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb707400640 1 -- 172.21.15.28:0/4093042591 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8007260 con 0x7fb710151f90 2024-04-23T18:23:15.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb715600640 1 -- 172.21.15.28:0/4093042591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7101f4ba0 con 0x7fb710151f90 2024-04-23T18:23:15.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb715600640 1 -- 172.21.15.28:0/4093042591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb710068cd0 con 0x7fb710151f90 2024-04-23T18:23:15.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.751+0000 7fb707400640 1 -- 172.21.15.28:0/4093042591 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6f8007400 con 0x7fb710151f90 2024-04-23T18:23:15.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.755+0000 7fb707400640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb6ec068380 0x7fb6ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:15.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.755+0000 7fb707400640 1 -- 172.21.15.28:0/4093042591 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb6f8086240 con 0x7fb710151f90 2024-04-23T18:23:15.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.755+0000 7fb70ea00640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb6ec068380 0x7fb6ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:15.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.755+0000 7fb70ea00640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb6ec068380 0x7fb6ec06a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb700007a60 tx=0x7fb700008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:15.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.759+0000 7fb707400640 1 -- 172.21.15.28:0/4093042591 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6f8055da0 con 0x7fb710151f90 2024-04-23T18:23:15.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.923+0000 7fb715600640 1 -- 172.21.15.28:0/4093042591 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7100c4420 con 0x7fb710151f90 2024-04-23T18:23:15.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb707400640 1 -- 172.21.15.28:0/4093042591 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18891 (secure 0 0 0) 0x7fb6f805a0a0 con 0x7fb710151f90 2024-04-23T18:23:15.920 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:15.921 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:23:14.705611+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 -- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb6ec068380 msgr2=0x7fb6ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb6ec068380 0x7fb6ec06a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb700007a60 tx=0x7fb700008040 comp rx=0 tx=0).stop 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 -- 172.21.15.28:0/4093042591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb710151f90 msgr2=0x7fb71014d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb710151f90 0x7fb71014d550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c420 tx=0x7fb6f800c8e0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 -- 172.21.15.28:0/4093042591 shutdown_connections 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fb6ec068380 0x7fb6ec06a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb710152370 0x7fb71014b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb710151f90 0x7fb71014d550 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 --2- 172.21.15.28:0/4093042591 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb710072080 0x7fb710159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 -- 172.21.15.28:0/4093042591 >> 172.21.15.28:0/4093042591 conn(0x7fb71006d0a0 msgr2=0x7fb7100c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 -- 172.21.15.28:0/4093042591 shutdown_connections 2024-04-23T18:23:15.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:15.927+0000 7fb715600640 1 -- 172.21.15.28:0/4093042591 wait complete. 2024-04-23T18:23:15.943 INFO:tasks.quiescer.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T18:22:19.363864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T18:22:31.040656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T18:22:31.703845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T18:22:35.387908+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T18:23:15.943 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T18:23:16.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.091+0000 7feccf600640 1 Processor -- start 2024-04-23T18:23:16.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.091+0000 7feccf600640 1 -- start start 2024-04-23T18:23:16.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7feccf600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fecc80c8be0 0x7fecc815e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7feccf600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fecc80711f0 0x7fecc815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7feccf600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc80c7ce0 con 0x7fecc8155330 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7feccf600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fecc80c82a0 con 0x7fecc80711f0 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7feccf600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fecc80c7fc0 con 0x7fecc80c8be0 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7feccd600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fecc80711f0 0x7fecc815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7fecccc00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fecc8155330 0x7fecc806d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60860/0 (socket says 172.21.15.28:60860) 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7fecccc00640 1 -- 172.21.15.28:0/821038179 learned_addr learned my addr 172.21.15.28:0/821038179 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7fecbfe00640 1 --2- 172.21.15.28:0/821038179 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fecc80c8be0 0x7fecc815e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7feccd600640 1 -- 172.21.15.28:0/821038179 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fecc80c8be0 msgr2=0x7fecc815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7feccd600640 1 --2- 172.21.15.28:0/821038179 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fecc80c8be0 0x7fecc815e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7feccd600640 1 -- 172.21.15.28:0/821038179 >> v1:172.21.15.28:6789/0 conn(0x7fecc8155330 legacy=0x7fecc806d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7feccd600640 1 -- 172.21.15.28:0/821038179 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc806cad0 con 0x7fecc80711f0 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7fecbfe00640 1 --2- 172.21.15.28:0/821038179 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fecc80c8be0 0x7fecc815e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:16.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7fecc7e00640 1 -- 172.21.15.28:0/821038179 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3423978143 0 0) 0x7fecc80c7ce0 con 0x7fecc8155330 2024-04-23T18:23:16.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7feccd600640 1 --2- 172.21.15.28:0/821038179 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc80711f0 0x7fecc815ece0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009d90 tx=0x7fecc001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b780aebfe4a18ceb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:16.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.095+0000 7fecc7e00640 1 -- 172.21.15.28:0/821038179 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc00b4070 con 0x7fecc80711f0 2024-04-23T18:23:16.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7fecc7e00640 1 -- 172.21.15.28:0/821038179 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc00af600 con 0x7fecc80711f0 2024-04-23T18:23:16.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7fecc7e00640 1 -- 172.21.15.28:0/821038179 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc00af9d0 con 0x7fecc80711f0 2024-04-23T18:23:16.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 -- 172.21.15.28:0/821038179 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc80711f0 msgr2=0x7fecc815ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 --2- 172.21.15.28:0/821038179 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc80711f0 0x7fecc815ece0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009d90 tx=0x7fecc001f150 comp rx=0 tx=0).stop 2024-04-23T18:23:16.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 -- 172.21.15.28:0/821038179 shutdown_connections 2024-04-23T18:23:16.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 --2- 172.21.15.28:0/821038179 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc80711f0 0x7fecc815ece0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 --2- 172.21.15.28:0/821038179 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fecc80c8be0 0x7fecc815e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 -- 172.21.15.28:0/821038179 >> 172.21.15.28:0/821038179 conn(0x7fecc80c9330 msgr2=0x7fecc80c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:16.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 -- 172.21.15.28:0/821038179 shutdown_connections 2024-04-23T18:23:16.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 -- 172.21.15.28:0/821038179 wait complete. 2024-04-23T18:23:16.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 Processor -- start 2024-04-23T18:23:16.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 -- start start 2024-04-23T18:23:16.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fecc80711f0 0x7fecc81584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc80c8be0 0x7fecc814a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecc8155330 0x7fecc81f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fecc8155710 con 0x7fecc80c8be0 2024-04-23T18:23:16.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fecc80c90b0 con 0x7fecc8155330 2024-04-23T18:23:16.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccf600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fecc8155890 con 0x7fecc80711f0 2024-04-23T18:23:16.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7fecbfe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc80c8be0 0x7fecc814a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7fecbfe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc80c8be0 0x7fecc814a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56046/0 (socket says 172.21.15.28:56046) 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7fecbfe00640 1 -- 172.21.15.28:0/3148339492 learned_addr learned my addr 172.21.15.28:0/3148339492 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7fecccc00640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fecc80711f0 0x7fecc81584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccd600640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecc8155330 0x7fecc81f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7fecbfe00640 1 -- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fecc80711f0 msgr2=0x7fecc81584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7fecbfe00640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fecc80711f0 0x7fecc81584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7fecbfe00640 1 -- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecc8155330 msgr2=0x7fecc81f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7fecbfe00640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecc8155330 0x7fecc81f0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7fecbfe00640 1 -- 172.21.15.28:0/3148339492 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc814e500 con 0x7fecc80c8be0 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.099+0000 7feccd600640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecc8155330 0x7fecc81f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.103+0000 7fecbfe00640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc80c8be0 0x7fecc814a250 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fecb000e810 tx=0x7fecb000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.103+0000 7fecc5600640 1 -- 172.21.15.28:0/3148339492 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0017070 con 0x7fecc80c8be0 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.103+0000 7fecc5600640 1 -- 172.21.15.28:0/3148339492 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb000c6d0 con 0x7fecc80c8be0 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.103+0000 7fecc5600640 1 -- 172.21.15.28:0/3148339492 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb000f040 con 0x7fecc80c8be0 2024-04-23T18:23:16.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.103+0000 7feccf600640 1 -- 172.21.15.28:0/3148339492 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc814dc60 con 0x7fecc80c8be0 2024-04-23T18:23:16.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.103+0000 7feccf600640 1 -- 172.21.15.28:0/3148339492 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc814e220 con 0x7fecc80c8be0 2024-04-23T18:23:16.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.103+0000 7feccf600640 1 -- 172.21.15.28:0/3148339492 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc8068db0 con 0x7fecc80c8be0 2024-04-23T18:23:16.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.103+0000 7fecc5600640 1 -- 172.21.15.28:0/3148339492 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fecb001a070 con 0x7fecc80c8be0 2024-04-23T18:23:16.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.103+0000 7fecc5600640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7feca4068380 0x7feca406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.103+0000 7fecc5600640 1 -- 172.21.15.28:0/3148339492 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fecb0086910 con 0x7fecc80c8be0 2024-04-23T18:23:16.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.103+0000 7fecccc00640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7feca4068380 0x7feca406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.107+0000 7fecccc00640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7feca4068380 0x7feca406a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fecb8000f70 tx=0x7fecb8007df0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:16.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.107+0000 7fecc5600640 1 -- 172.21.15.28:0/3148339492 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fecb00563e0 con 0x7fecc80c8be0 2024-04-23T18:23:16.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.275+0000 7feccf600640 1 -- 172.21.15.28:0/3148339492 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fecc8071c30 con 0x7fecc80c8be0 2024-04-23T18:23:16.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.275+0000 7fecc5600640 1 -- 172.21.15.28:0/3148339492 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fecb005a6e0 con 0x7fecc80c8be0 2024-04-23T18:23:16.270 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-04-23T18:23:16.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 -- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7feca4068380 msgr2=0x7feca406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7feca4068380 0x7feca406a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fecb8000f70 tx=0x7fecb8007df0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 -- 172.21.15.28:0/3148339492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc80c8be0 msgr2=0x7fecc814a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc80c8be0 0x7fecc814a250 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fecb000e810 tx=0x7fecb000ecd0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 -- 172.21.15.28:0/3148339492 shutdown_connections 2024-04-23T18:23:16.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7feca4068380 0x7feca406a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fecc8155330 0x7fecc81f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecc80c8be0 0x7fecc814a250 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 --2- 172.21.15.28:0/3148339492 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fecc80711f0 0x7fecc81584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 -- 172.21.15.28:0/3148339492 >> 172.21.15.28:0/3148339492 conn(0x7fecc80c9330 msgr2=0x7fecc814fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:16.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 -- 172.21.15.28:0/3148339492 shutdown_connections 2024-04-23T18:23:16.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.279+0000 7feccf600640 1 -- 172.21.15.28:0/3148339492 wait complete. 2024-04-23T18:23:16.291 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T18:23:16.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.439+0000 7f6bb6800640 1 Processor -- start 2024-04-23T18:23:16.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.439+0000 7f6bb6800640 1 -- start start 2024-04-23T18:23:16.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6bb6800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6bb0073050 0x7f6bb0158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6bb6800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb00c9e50 0x7f6bb00c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6bb6800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb0073520 con 0x7f6bb014f8d0 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6bb6800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb0073da0 con 0x7f6bb0073050 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6bb6800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb00737e0 con 0x7f6bb00c9e50 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6ba6a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6bb0073050 0x7f6bb0158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6ba6a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6bb0073050 0x7f6bb0158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56062/0 (socket says 172.21.15.28:56062) 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6ba6a00640 1 -- 172.21.15.28:0/1169325891 learned_addr learned my addr 172.21.15.28:0/1169325891 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6baf400640 1 --1- 172.21.15.28:0/1169325891 >> v1:172.21.15.28:6789/0 conn(0x7f6bb014f8d0 0x7f6bb00c7230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60876/0 (socket says 172.21.15.28:60876) 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6bafe00640 1 --2- 172.21.15.28:0/1169325891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb00c9e50 0x7f6bb00c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6ba6a00640 1 -- 172.21.15.28:0/1169325891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb00c9e50 msgr2=0x7f6bb00c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6ba6a00640 1 --2- 172.21.15.28:0/1169325891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb00c9e50 0x7f6bb00c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6ba6a00640 1 -- 172.21.15.28:0/1169325891 >> v1:172.21.15.28:6789/0 conn(0x7f6bb014f8d0 legacy=0x7f6bb00c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6ba6a00640 1 -- 172.21.15.28:0/1169325891 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb0073ac0 con 0x7f6bb0073050 2024-04-23T18:23:16.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6ba6a00640 1 --2- 172.21.15.28:0/1169325891 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bb0073050 0x7f6bb0158ee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009870 tx=0x7f6b9801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602b58affaeb1c1e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:16.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.443+0000 7f6baea00640 1 -- 172.21.15.28:0/1169325891 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b980aa620 con 0x7f6bb0073050 2024-04-23T18:23:16.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6baea00640 1 -- 172.21.15.28:0/1169325891 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b980af070 con 0x7f6bb0073050 2024-04-23T18:23:16.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6baea00640 1 -- 172.21.15.28:0/1169325891 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b980aa9e0 con 0x7f6bb0073050 2024-04-23T18:23:16.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6bb6800640 1 -- 172.21.15.28:0/1169325891 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bb0073050 msgr2=0x7f6bb0158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6bb6800640 1 --2- 172.21.15.28:0/1169325891 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bb0073050 0x7f6bb0158ee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009870 tx=0x7f6b9801c4a0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6bb6800640 1 -- 172.21.15.28:0/1169325891 shutdown_connections 2024-04-23T18:23:16.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6bb6800640 1 --2- 172.21.15.28:0/1169325891 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb00c9e50 0x7f6bb00c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6bb6800640 1 --2- 172.21.15.28:0/1169325891 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bb0073050 0x7f6bb0158ee0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6bb6800640 1 -- 172.21.15.28:0/1169325891 >> 172.21.15.28:0/1169325891 conn(0x7f6bb00c9330 msgr2=0x7f6bb00c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:16.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6bb6800640 1 -- 172.21.15.28:0/1169325891 shutdown_connections 2024-04-23T18:23:16.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6bb6800640 1 -- 172.21.15.28:0/1169325891 wait complete. 2024-04-23T18:23:16.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6bb6800640 1 Processor -- start 2024-04-23T18:23:16.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.447+0000 7f6bb6800640 1 -- start start 2024-04-23T18:23:16.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6bb6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bb0073050 0x7f6bb014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6bb6800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bb00c9e50 0x7f6bb0151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6bb6800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb014f8d0 0x7f6bb0152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6bb6800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb00c7940 con 0x7f6bb00c9e50 2024-04-23T18:23:16.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6bb6800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb014fcb0 con 0x7f6bb0073050 2024-04-23T18:23:16.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6bb6800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb00c7ac0 con 0x7f6bb014f8d0 2024-04-23T18:23:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba6a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bb00c9e50 0x7f6bb0151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba6a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bb00c9e50 0x7f6bb0151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56064/0 (socket says 172.21.15.28:56064) 2024-04-23T18:23:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba6a00640 1 -- 172.21.15.28:0/1856379322 learned_addr learned my addr 172.21.15.28:0/1856379322 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6baf400640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bb0073050 0x7f6bb014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6bafe00640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb014f8d0 0x7f6bb0152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba6a00640 1 -- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb014f8d0 msgr2=0x7f6bb0152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba6a00640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb014f8d0 0x7f6bb0152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba6a00640 1 -- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bb0073050 msgr2=0x7f6bb014e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba6a00640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bb0073050 0x7f6bb014e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba6a00640 1 -- 172.21.15.28:0/1856379322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb0159240 con 0x7f6bb00c9e50 2024-04-23T18:23:16.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba6a00640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bb00c9e50 0x7f6bb0151ef0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b980ac040 tx=0x7f6b9801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:16.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba7e00640 1 -- 172.21.15.28:0/1856379322 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b980aad90 con 0x7f6bb00c9e50 2024-04-23T18:23:16.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba7e00640 1 -- 172.21.15.28:0/1856379322 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b980bd3f0 con 0x7f6bb00c9e50 2024-04-23T18:23:16.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6ba7e00640 1 -- 172.21.15.28:0/1856379322 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b980bd7e0 con 0x7f6bb00c9e50 2024-04-23T18:23:16.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6bb6800640 1 -- 172.21.15.28:0/1856379322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb0158c80 con 0x7f6bb00c9e50 2024-04-23T18:23:16.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.451+0000 7f6bb6800640 1 -- 172.21.15.28:0/1856379322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb0151410 con 0x7f6bb00c9e50 2024-04-23T18:23:16.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.455+0000 7f6bb6800640 1 -- 172.21.15.28:0/1856379322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb0068db0 con 0x7f6bb00c9e50 2024-04-23T18:23:16.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.455+0000 7f6ba7e00640 1 -- 172.21.15.28:0/1856379322 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b980b33f0 con 0x7f6bb00c9e50 2024-04-23T18:23:16.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.455+0000 7f6ba7e00640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6b8c068380 0x7f6b8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.455+0000 7f6ba7e00640 1 -- 172.21.15.28:0/1856379322 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6b981209d0 con 0x7f6bb00c9e50 2024-04-23T18:23:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.455+0000 7f6baf400640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6b8c068380 0x7f6b8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.459+0000 7f6baf400640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6b8c068380 0x7f6b8c06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0000f70 tx=0x7f6ba0007e90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:16.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.459+0000 7f6ba7e00640 1 -- 172.21.15.28:0/1856379322 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6bb0159240 con 0x7f6bb00c9e50 2024-04-23T18:23:16.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.623+0000 7f6bb6800640 1 -- 172.21.15.28:0/1856379322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6bb00c6be0 con 0x7f6bb00c9e50 2024-04-23T18:23:16.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.623+0000 7f6ba7e00640 1 -- 172.21.15.28:0/1856379322 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f6b98016150 con 0x7f6bb00c9e50 2024-04-23T18:23:16.619 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:23:16.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 -- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6b8c068380 msgr2=0x7f6b8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6b8c068380 0x7f6b8c06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0000f70 tx=0x7f6ba0007e90 comp rx=0 tx=0).stop 2024-04-23T18:23:16.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 -- 172.21.15.28:0/1856379322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bb00c9e50 msgr2=0x7f6bb0151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bb00c9e50 0x7f6bb0151ef0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b980ac040 tx=0x7f6b9801ace0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 -- 172.21.15.28:0/1856379322 shutdown_connections 2024-04-23T18:23:16.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6b8c068380 0x7f6b8c06a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6bb014f8d0 0x7f6bb0152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6bb00c9e50 0x7f6bb0151ef0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 --2- 172.21.15.28:0/1856379322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6bb0073050 0x7f6bb014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 -- 172.21.15.28:0/1856379322 >> 172.21.15.28:0/1856379322 conn(0x7f6bb00c9330 msgr2=0x7f6bb014a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:16.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 -- 172.21.15.28:0/1856379322 shutdown_connections 2024-04-23T18:23:16.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.627+0000 7f6bb6800640 1 -- 172.21.15.28:0/1856379322 wait complete. 2024-04-23T18:23:16.641 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T18:23:16.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05eb600640 1 Processor -- start 2024-04-23T18:23:16.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05eb600640 1 -- start start 2024-04-23T18:23:16.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05eb600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05e406d690 0x7f05e406f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05eb600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e415c7d0 con 0x7f05e41533e0 2024-04-23T18:23:16.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05eb600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e406e790 con 0x7f05e40cde20 2024-04-23T18:23:16.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05eb600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05e406ea70 con 0x7f05e406d690 2024-04-23T18:23:16.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e8c00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f05e41533e0 0x7f05e40c6a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60882/0 (socket says 172.21.15.28:60882) 2024-04-23T18:23:16.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e8c00640 1 -- 172.21.15.28:0/2096527322 learned_addr learned my addr 172.21.15.28:0/2096527322 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:16.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3e00640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05e406d690 0x7f05e406f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 269530366 0 0) 0x7f05e415c7d0 con 0x7f05e41533e0 2024-04-23T18:23:16.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05cc003530 con 0x7f05e41533e0 2024-04-23T18:23:16.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1440730458 0 0) 0x7f05cc003530 con 0x7f05e41533e0 2024-04-23T18:23:16.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05e406d690 msgr2=0x7f05e406f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:16.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05e406d690 0x7f05e406f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 >> v1:172.21.15.137:6789/0 conn(0x7f05e40cde20 legacy=0x7f05e4163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e415ca40 con 0x7f05e41533e0 2024-04-23T18:23:16.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f05d8001680 con 0x7f05e41533e0 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 >> v1:172.21.15.28:6789/0 conn(0x7f05e41533e0 legacy=0x7f05e40c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05cc0039f0 0x7f05cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05cc004810 0x7f05cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05e406d690 0x7f05cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f05e406ea70 con 0x7f05cc004810 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc00bb10 con 0x7f05cc0039f0 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05cc00bd10 con 0x7f05e406d690 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3e00640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05cc004810 0x7f05cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e9600640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05e406d690 0x7f05cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e8c00640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05cc0039f0 0x7f05cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3e00640 1 -- 172.21.15.28:0/2096527322 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05e406d690 msgr2=0x7f05cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3e00640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05e406d690 0x7f05cc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3e00640 1 -- 172.21.15.28:0/2096527322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05cc0039f0 msgr2=0x7f05cc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:16.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3e00640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05cc0039f0 0x7f05cc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.791+0000 7f05e3e00640 1 -- 172.21.15.28:0/2096527322 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc003530 con 0x7f05cc004810 2024-04-23T18:23:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.795+0000 7f05e3e00640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05cc004810 0x7f05cc004c90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009ab0 tx=0x7f05d001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d6dcfbe53338 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.795+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d00b2070 con 0x7f05cc004810 2024-04-23T18:23:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.795+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d00a5620 con 0x7f05cc004810 2024-04-23T18:23:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.795+0000 7f05e3400640 1 -- 172.21.15.28:0/2096527322 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d00096b0 con 0x7f05cc004810 2024-04-23T18:23:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.795+0000 7f05eb600640 1 -- 172.21.15.28:0/2096527322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05cc004810 msgr2=0x7f05cc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.795+0000 7f05eb600640 1 --2- 172.21.15.28:0/2096527322 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05cc004810 0x7f05cc004c90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009ab0 tx=0x7f05d001ca30 comp rx=0 tx=0).stop 2024-04-23T18:23:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.795+0000 7f05e9600640 1 -- 172.21.15.28:0/2096527322 reap_dead start 2024-04-23T18:23:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.795+0000 7f05eb600640 1 -- 172.21.15.28:0/2096527322 shutdown_connections 2024-04-23T18:23:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.795+0000 7f05eb600640 1 -- 172.21.15.28:0/2096527322 >> 172.21.15.28:0/2096527322 conn(0x7f05e406c1d0 msgr2=0x7f05e40cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.795+0000 7f05eb600640 1 -- 172.21.15.28:0/2096527322 shutdown_connections 2024-04-23T18:23:16.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.795+0000 7f05eb600640 1 -- 172.21.15.28:0/2096527322 wait complete. 2024-04-23T18:23:16.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05eb600640 1 Processor -- start 2024-04-23T18:23:16.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05eb600640 1 -- start start 2024-04-23T18:23:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05eb600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05cc004810 0x7f05e40cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05eb600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05e4159db0 0x7f05e4157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05eb600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e4157570 0x7f05e41f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05eb600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41537c0 con 0x7f05e4159db0 2024-04-23T18:23:16.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05eb600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05e406ed50 con 0x7f05e4157570 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05eb600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f05e4153940 con 0x7f05cc004810 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05e4159db0 0x7f05e4157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05e4159db0 0x7f05e4157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56084/0 (socket says 172.21.15.28:56084) 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e3e00640 1 -- 172.21.15.28:0/2784041483 learned_addr learned my addr 172.21.15.28:0/2784041483 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e9600640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e4157570 0x7f05e41f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e8c00640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05cc004810 0x7f05e40cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e3e00640 1 -- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05cc004810 msgr2=0x7f05e40cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e3e00640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05cc004810 0x7f05e40cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e3e00640 1 -- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e4157570 msgr2=0x7f05e41f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e3e00640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e4157570 0x7f05e41f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e3e00640 1 -- 172.21.15.28:0/2784041483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e41ef960 con 0x7f05e4159db0 2024-04-23T18:23:16.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e3e00640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05e4159db0 0x7f05e4157030 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009ab0 tx=0x7f05cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:16.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e0c00640 1 -- 172.21.15.28:0/2784041483 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d00bd070 con 0x7f05e4159db0 2024-04-23T18:23:16.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e0c00640 1 -- 172.21.15.28:0/2784041483 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d0004030 con 0x7f05e4159db0 2024-04-23T18:23:16.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05e0c00640 1 -- 172.21.15.28:0/2784041483 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d00b2040 con 0x7f05e4159db0 2024-04-23T18:23:16.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05eb600640 1 -- 172.21.15.28:0/2784041483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e40cd140 con 0x7f05e4159db0 2024-04-23T18:23:16.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.799+0000 7f05eb600640 1 -- 172.21.15.28:0/2784041483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e40cd700 con 0x7f05e4159db0 2024-04-23T18:23:16.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.803+0000 7f05eb600640 1 -- 172.21.15.28:0/2784041483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e4068db0 con 0x7f05e4159db0 2024-04-23T18:23:16.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.803+0000 7f05e0c00640 1 -- 172.21.15.28:0/2784041483 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05d0003620 con 0x7f05e4159db0 2024-04-23T18:23:16.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.803+0000 7f05e0c00640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05c4068380 0x7f05c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.803+0000 7f05e0c00640 1 -- 172.21.15.28:0/2784041483 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f05d0120b60 con 0x7f05e4159db0 2024-04-23T18:23:16.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.803+0000 7f05e8c00640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05c4068380 0x7f05c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:16.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.803+0000 7f05e8c00640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05c4068380 0x7f05c406a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f05d8001ce0 tx=0x7f05d8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:16.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.807+0000 7f05e0c00640 1 -- 172.21.15.28:0/2784041483 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f05d0016740 con 0x7f05e4159db0 2024-04-23T18:23:16.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 -- 172.21.15.28:0/2784041483 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f05e4071fa0 con 0x7f05e4159db0 2024-04-23T18:23:16.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05e0c00640 1 -- 172.21.15.28:0/2784041483 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f05d00f06d0 con 0x7f05e4159db0 2024-04-23T18:23:16.969 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2024-04-23T18:23:16.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 -- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05c4068380 msgr2=0x7f05c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05c4068380 0x7f05c406a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f05d8001ce0 tx=0x7f05d8009040 comp rx=0 tx=0).stop 2024-04-23T18:23:16.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 -- 172.21.15.28:0/2784041483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05e4159db0 msgr2=0x7f05e4157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:16.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05e4159db0 0x7f05e4157030 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009ab0 tx=0x7f05cc005840 comp rx=0 tx=0).stop 2024-04-23T18:23:16.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 -- 172.21.15.28:0/2784041483 shutdown_connections 2024-04-23T18:23:16.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f05c4068380 0x7f05c406a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e4157570 0x7f05e41f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05e4159db0 0x7f05e4157030 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 --2- 172.21.15.28:0/2784041483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05cc004810 0x7f05e40cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:16.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 -- 172.21.15.28:0/2784041483 >> 172.21.15.28:0/2784041483 conn(0x7f05e406c1d0 msgr2=0x7f05e414e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:16.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 -- 172.21.15.28:0/2784041483 shutdown_connections 2024-04-23T18:23:16.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:16.975+0000 7f05eb600640 1 -- 172.21.15.28:0/2784041483 wait complete. 2024-04-23T18:23:16.990 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T18:23:17.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.139+0000 7f0d21a00640 1 Processor -- start 2024-04-23T18:23:17.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.139+0000 7f0d21a00640 1 -- start start 2024-04-23T18:23:17.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d21a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d1c0c9e50 0x7f0d1c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d21a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0d1c0c8d50 0x7f0d1c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d21a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d1c15b520 con 0x7f0d1c152100 2024-04-23T18:23:17.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d21a00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f0d1c071d40 con 0x7f0d1c0c8d50 2024-04-23T18:23:17.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d21a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0d1c072020 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d1b400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0d1c0c8d50 0x7f0d1c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d1b400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0d1c0c8d50 0x7f0d1c06ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56090/0 (socket says 172.21.15.28:56090) 2024-04-23T18:23:17.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d1b400640 1 -- 172.21.15.28:0/461794505 learned_addr learned my addr 172.21.15.28:0/461794505 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:17.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d13e00640 1 --2- 172.21.15.28:0/461794505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d1c0c9e50 0x7f0d1c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d1b400640 1 -- 172.21.15.28:0/461794505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d1c0c9e50 msgr2=0x7f0d1c15bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:17.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d1b400640 1 --2- 172.21.15.28:0/461794505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d1c0c9e50 0x7f0d1c15bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d1b400640 1 -- 172.21.15.28:0/461794505 >> v1:172.21.15.137:6789/0 conn(0x7f0d1c152100 legacy=0x7f0d1c072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.143+0000 7f0d1b400640 1 -- 172.21.15.28:0/461794505 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1c15b7c0 con 0x7f0d1c0c8d50 2024-04-23T18:23:17.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d1b400640 1 --2- 172.21.15.28:0/461794505 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d1c0c8d50 0x7f0d1c06ca30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009e50 tx=0x7f0d1401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65b9215923c02f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:17.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d1a000640 1 -- 172.21.15.28:0/461794505 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140b4070 con 0x7f0d1c0c8d50 2024-04-23T18:23:17.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d1a000640 1 -- 172.21.15.28:0/461794505 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d140af400 con 0x7f0d1c0c8d50 2024-04-23T18:23:17.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d1a000640 1 -- 172.21.15.28:0/461794505 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140af7d0 con 0x7f0d1c0c8d50 2024-04-23T18:23:17.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 -- 172.21.15.28:0/461794505 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d1c0c8d50 msgr2=0x7f0d1c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 --2- 172.21.15.28:0/461794505 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d1c0c8d50 0x7f0d1c06ca30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009e50 tx=0x7f0d1401f210 comp rx=0 tx=0).stop 2024-04-23T18:23:17.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 -- 172.21.15.28:0/461794505 shutdown_connections 2024-04-23T18:23:17.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 --2- 172.21.15.28:0/461794505 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d1c0c8d50 0x7f0d1c06ca30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 --2- 172.21.15.28:0/461794505 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d1c0c9e50 0x7f0d1c15bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 -- 172.21.15.28:0/461794505 >> 172.21.15.28:0/461794505 conn(0x7f0d1c0c9330 msgr2=0x7f0d1c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:17.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 -- 172.21.15.28:0/461794505 shutdown_connections 2024-04-23T18:23:17.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 -- 172.21.15.28:0/461794505 wait complete. 2024-04-23T18:23:17.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 Processor -- start 2024-04-23T18:23:17.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 -- start start 2024-04-23T18:23:17.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d1c0c8d50 0x7f0d1c14f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d1c0c9e50 0x7f0d1c1486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d1c152100 0x7f0d1c1f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1c070fc0 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1c070e40 con 0x7f0d1c0c8d50 2024-04-23T18:23:17.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d21a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0d1c071140 con 0x7f0d1c152100 2024-04-23T18:23:17.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.147+0000 7f0d13e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d1c0c9e50 0x7f0d1c1486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d13e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d1c0c9e50 0x7f0d1c1486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56104/0 (socket says 172.21.15.28:56104) 2024-04-23T18:23:17.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d13e00640 1 -- 172.21.15.28:0/36794942 learned_addr learned my addr 172.21.15.28:0/36794942 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:17.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d1aa00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d1c0c8d50 0x7f0d1c14f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d1b400640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d1c152100 0x7f0d1c1f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d13e00640 1 -- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d1c152100 msgr2=0x7f0d1c1f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d13e00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d1c152100 0x7f0d1c1f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d13e00640 1 -- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d1c0c8d50 msgr2=0x7f0d1c14f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d13e00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d1c0c8d50 0x7f0d1c14f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d13e00640 1 -- 172.21.15.28:0/36794942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1c14e8d0 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d1aa00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d1c0c8d50 0x7f0d1c14f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:17.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d13e00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d1c0c9e50 0x7f0d1c1486d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400e930 tx=0x7f0d0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:17.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d12a00640 1 -- 172.21.15.28:0/36794942 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04017070 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d12a00640 1 -- 172.21.15.28:0/36794942 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0400ca00 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d12a00640 1 -- 172.21.15.28:0/36794942 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0400cdb0 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d21a00640 1 -- 172.21.15.28:0/36794942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d1c152b80 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d21a00640 1 -- 172.21.15.28:0/36794942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d1c14ffb0 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d21a00640 1 -- 172.21.15.28:0/36794942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d1c068db0 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d12a00640 1 -- 172.21.15.28:0/36794942 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0d0401a070 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.151+0000 7f0d12a00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0cf80683b0 0x7f0cf806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.155+0000 7f0d12a00640 1 -- 172.21.15.28:0/36794942 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0d04087180 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.155+0000 7f0d1aa00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0cf80683b0 0x7f0cf806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.155+0000 7f0d1aa00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0cf80683b0 0x7f0cf806a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c001670 tx=0x7f0d0c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:17.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.159+0000 7f0d12a00640 1 -- 172.21.15.28:0/36794942 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0d040573f0 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.323+0000 7f0d21a00640 1 -- 172.21.15.28:0/36794942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0d1c0c71b0 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.323+0000 7f0d12a00640 1 -- 172.21.15.28:0/36794942 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f0d04056cf0 con 0x7f0d1c0c9e50 2024-04-23T18:23:17.319 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:23:17.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 -- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0cf80683b0 msgr2=0x7f0cf806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0cf80683b0 0x7f0cf806a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c001670 tx=0x7f0d0c009040 comp rx=0 tx=0).stop 2024-04-23T18:23:17.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 -- 172.21.15.28:0/36794942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d1c0c9e50 msgr2=0x7f0d1c1486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d1c0c9e50 0x7f0d1c1486d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400e930 tx=0x7f0d0400edf0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 -- 172.21.15.28:0/36794942 shutdown_connections 2024-04-23T18:23:17.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0cf80683b0 0x7f0cf806a870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0d1c152100 0x7f0d1c1f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d1c0c9e50 0x7f0d1c1486d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 --2- 172.21.15.28:0/36794942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d1c0c8d50 0x7f0d1c14f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 -- 172.21.15.28:0/36794942 >> 172.21.15.28:0/36794942 conn(0x7f0d1c0c9330 msgr2=0x7f0d1c0c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:17.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 -- 172.21.15.28:0/36794942 shutdown_connections 2024-04-23T18:23:17.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.327+0000 7f0d21a00640 1 -- 172.21.15.28:0/36794942 wait complete. 2024-04-23T18:23:17.341 INFO:tasks.quiescer.ceph_manager:waiting for clean 2024-04-23T18:23:17.341 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:23:17.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.487+0000 7fce24600640 1 Processor -- start 2024-04-23T18:23:17.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.487+0000 7fce24600640 1 -- start start 2024-04-23T18:23:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce24600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fce1c1555d0 0x7fce1c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce24600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fce1c15c770 0x7fce1c0cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce24600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce1c073b00 0x7fce1c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce24600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fce1c15c2c0 con 0x7fce1c1555d0 2024-04-23T18:23:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce24600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fce1c0cecf0 con 0x7fce1c15c770 2024-04-23T18:23:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce24600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fce1c15ba20 con 0x7fce1c073b00 2024-04-23T18:23:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce21c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fce1c1555d0 0x7fce1c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce21c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fce1c1555d0 0x7fce1c15b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56118/0 (socket says 172.21.15.28:56118) 2024-04-23T18:23:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce21c00640 1 -- 172.21.15.28:0/2494830775 learned_addr learned my addr 172.21.15.28:0/2494830775 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce21200640 1 --2- 172.21.15.28:0/2494830775 >> v2:172.21.15.137:3300/0 conn(0x7fce1c15c770 0x7fce1c0cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce22600640 1 --2- 172.21.15.28:0/2494830775 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce1c073b00 0x7fce1c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce21c00640 1 -- 172.21.15.28:0/2494830775 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce1c073b00 msgr2=0x7fce1c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:17.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce21c00640 1 --2- 172.21.15.28:0/2494830775 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce1c073b00 0x7fce1c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce21c00640 1 -- 172.21.15.28:0/2494830775 >> v2:172.21.15.137:3300/0 conn(0x7fce1c15c770 msgr2=0x7fce1c0cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:17.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce21c00640 1 --2- 172.21.15.28:0/2494830775 >> v2:172.21.15.137:3300/0 conn(0x7fce1c15c770 0x7fce1c0cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.491+0000 7fce21c00640 1 -- 172.21.15.28:0/2494830775 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c15bd00 con 0x7fce1c1555d0 2024-04-23T18:23:17.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce21c00640 1 --2- 172.21.15.28:0/2494830775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce1c1555d0 0x7fce1c15b300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fce1c072320 tx=0x7fce1001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26218e7231eac1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:17.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce1be00640 1 -- 172.21.15.28:0/2494830775 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce100b5070 con 0x7fce1c1555d0 2024-04-23T18:23:17.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce1be00640 1 -- 172.21.15.28:0/2494830775 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce100a89d0 con 0x7fce1c1555d0 2024-04-23T18:23:17.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce1be00640 1 -- 172.21.15.28:0/2494830775 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce100a8da0 con 0x7fce1c1555d0 2024-04-23T18:23:17.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 -- 172.21.15.28:0/2494830775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce1c1555d0 msgr2=0x7fce1c15b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 --2- 172.21.15.28:0/2494830775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce1c1555d0 0x7fce1c15b300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fce1c072320 tx=0x7fce1001ed10 comp rx=0 tx=0).stop 2024-04-23T18:23:17.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 -- 172.21.15.28:0/2494830775 shutdown_connections 2024-04-23T18:23:17.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 --2- 172.21.15.28:0/2494830775 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce1c073b00 0x7fce1c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 --2- 172.21.15.28:0/2494830775 >> v2:172.21.15.137:3300/0 conn(0x7fce1c15c770 0x7fce1c0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 --2- 172.21.15.28:0/2494830775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce1c1555d0 0x7fce1c15b300 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 -- 172.21.15.28:0/2494830775 >> 172.21.15.28:0/2494830775 conn(0x7fce1c072f30 msgr2=0x7fce1c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:17.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 -- 172.21.15.28:0/2494830775 shutdown_connections 2024-04-23T18:23:17.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 -- 172.21.15.28:0/2494830775 wait complete. 2024-04-23T18:23:17.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 Processor -- start 2024-04-23T18:23:17.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 -- start start 2024-04-23T18:23:17.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.495+0000 7fce24600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce1c073b00 0x7fce1c0c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce24600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce1c1555d0 0x7fce1c1e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce24600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce1c15c770 0x7fce1c1f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce24600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c0cf6c0 con 0x7fce1c15c770 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce24600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c0ce980 con 0x7fce1c1555d0 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce24600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fce1c1559b0 con 0x7fce1c073b00 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce22600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce1c15c770 0x7fce1c1f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce22600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce1c15c770 0x7fce1c1f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56132/0 (socket says 172.21.15.28:56132) 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce22600640 1 -- 172.21.15.28:0/2645441342 learned_addr learned my addr 172.21.15.28:0/2645441342 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce21200640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce1c1555d0 0x7fce1c1e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce21c00640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce1c073b00 0x7fce1c0c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce22600640 1 -- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce1c073b00 msgr2=0x7fce1c0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce22600640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce1c073b00 0x7fce1c0c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce22600640 1 -- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce1c1555d0 msgr2=0x7fce1c1e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce22600640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce1c1555d0 0x7fce1c1e68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce22600640 1 -- 172.21.15.28:0/2645441342 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c1f1690 con 0x7fce1c15c770 2024-04-23T18:23:17.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce22600640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce1c15c770 0x7fce1c1f0c00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fce14007e90 tx=0x7fce1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:17.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce19600640 1 -- 172.21.15.28:0/2645441342 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14014420 con 0x7fce1c15c770 2024-04-23T18:23:17.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce19600640 1 -- 172.21.15.28:0/2645441342 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce14019070 con 0x7fce1c15c770 2024-04-23T18:23:17.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce24600640 1 -- 172.21.15.28:0/2645441342 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1c1f1970 con 0x7fce1c15c770 2024-04-23T18:23:17.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce19600640 1 -- 172.21.15.28:0/2645441342 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14014820 con 0x7fce1c15c770 2024-04-23T18:23:17.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce24600640 1 -- 172.21.15.28:0/2645441342 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce1c0c7290 con 0x7fce1c15c770 2024-04-23T18:23:17.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce24600640 1 -- 172.21.15.28:0/2645441342 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1c068cd0 con 0x7fce1c15c770 2024-04-23T18:23:17.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.499+0000 7fce19600640 1 -- 172.21.15.28:0/2645441342 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce140149c0 con 0x7fce1c15c770 2024-04-23T18:23:17.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.503+0000 7fce19600640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcdfc068380 0x7fcdfc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.503+0000 7fce19600640 1 -- 172.21.15.28:0/2645441342 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fce14087630 con 0x7fce1c15c770 2024-04-23T18:23:17.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.503+0000 7fce21c00640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcdfc068380 0x7fcdfc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.503+0000 7fce21c00640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcdfc068380 0x7fcdfc06a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce100b2000 tx=0x7fce10009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:17.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.507+0000 7fce19600640 1 -- 172.21.15.28:0/2645441342 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fce14057070 con 0x7fce1c15c770 2024-04-23T18:23:17.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.667+0000 7fce24600640 1 -- 172.21.15.28:0/2645441342 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce1c0c7fb0 con 0x7fcdfc068380 2024-04-23T18:23:17.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.691+0000 7fce19600640 1 -- 172.21.15.28:0/2645441342 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332258 (secure 0 0 0) 0x7fce1c0c7fb0 con 0x7fcdfc068380 2024-04-23T18:23:17.688 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:17.690 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:23:17.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 -- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcdfc068380 msgr2=0x7fcdfc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcdfc068380 0x7fcdfc06a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce100b2000 tx=0x7fce10009040 comp rx=0 tx=0).stop 2024-04-23T18:23:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 -- 172.21.15.28:0/2645441342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce1c15c770 msgr2=0x7fce1c1f0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce1c15c770 0x7fce1c1f0c00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fce14007e90 tx=0x7fce1400e4b0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 -- 172.21.15.28:0/2645441342 shutdown_connections 2024-04-23T18:23:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcdfc068380 0x7fcdfc06a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fce1c15c770 0x7fce1c1f0c00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce1c1555d0 0x7fce1c1e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 --2- 172.21.15.28:0/2645441342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fce1c073b00 0x7fce1c0c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 -- 172.21.15.28:0/2645441342 >> 172.21.15.28:0/2645441342 conn(0x7fce1c072f30 msgr2=0x7fce1c15e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 -- 172.21.15.28:0/2645441342 shutdown_connections 2024-04-23T18:23:17.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.695+0000 7fce24600640 1 -- 172.21.15.28:0/2645441342 wait complete. 2024-04-23T18:23:17.709 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-04-23T18:23:17.336099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232024,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742696,"statfs":{"total":773094113280,"available":772856520704,"internally_reserved":0,"allocated":3469312,"data_stored":2048170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1664,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002955"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714103+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:23:13.714103+0000","last_peered":"2024-04-23T18:23:13.714103+0000","last_clean":"2024-04-23T18:23:13.714103+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:23:13.714103+0000","last_undegraded":"2024-04-23T18:23:13.714103+0000","last_fullsized":"2024-04-23T18:23:13.714103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:38.512479+0000","last_change":"2024-04-23T18:23:14.399010+0000","last_active":"2024-04-23T18:23:14.399010+0000","last_peered":"2024-04-23T18:22:38.512479+0000","last_clean":"2024-04-23T18:22:38.512479+0000","last_became_active":"2024-04-23T18:22:33.374636+0000","last_became_peered":"2024-04-23T18:22:33.374636+0000","last_unstale":"2024-04-23T18:22:38.512479+0000","last_undegraded":"2024-04-23T18:22:38.512479+0000","last_fullsized":"2024-04-23T18:22:38.512479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.703975+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:23:13.703975+0000","last_peered":"2024-04-23T18:23:13.703975+0000","last_clean":"2024-04-23T18:23:13.703975+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:23:13.703975+0000","last_undegraded":"2024-04-23T18:23:13.703975+0000","last_fullsized":"2024-04-23T18:23:13.703975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705142+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:23:13.705142+0000","last_peered":"2024-04-23T18:23:13.705142+0000","last_clean":"2024-04-23T18:23:13.705142+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:23:13.705142+0000","last_undegraded":"2024-04-23T18:23:13.705142+0000","last_fullsized":"2024-04-23T18:23:13.705142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713925+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:23:13.713925+0000","last_peered":"2024-04-23T18:23:13.713925+0000","last_clean":"2024-04-23T18:23:13.713925+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:23:13.713925+0000","last_undegraded":"2024-04-23T18:23:13.713925+0000","last_fullsized":"2024-04-23T18:23:13.713925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711813+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:23:13.711813+0000","last_peered":"2024-04-23T18:23:13.711813+0000","last_clean":"2024-04-23T18:23:13.711813+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:23:13.711813+0000","last_undegraded":"2024-04-23T18:23:13.711813+0000","last_fullsized":"2024-04-23T18:23:13.711813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724579+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:23:13.724579+0000","last_peered":"2024-04-23T18:23:13.724579+0000","last_clean":"2024-04-23T18:23:13.724579+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:23:13.724579+0000","last_undegraded":"2024-04-23T18:23:13.724579+0000","last_fullsized":"2024-04-23T18:23:13.724579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714242+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:23:13.714242+0000","last_peered":"2024-04-23T18:23:13.714242+0000","last_clean":"2024-04-23T18:23:13.714242+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:23:13.714242+0000","last_undegraded":"2024-04-23T18:23:13.714242+0000","last_fullsized":"2024-04-23T18:23:13.714242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.720246+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:23:13.720246+0000","last_peered":"2024-04-23T18:23:13.720246+0000","last_clean":"2024-04-23T18:23:13.720246+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:23:13.720246+0000","last_undegraded":"2024-04-23T18:23:13.720246+0000","last_fullsized":"2024-04-23T18:23:13.720246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724028+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:23:13.724028+0000","last_peered":"2024-04-23T18:23:13.724028+0000","last_clean":"2024-04-23T18:23:13.724028+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:23:13.724028+0000","last_undegraded":"2024-04-23T18:23:13.724028+0000","last_fullsized":"2024-04-23T18:23:13.724028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716404+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:23:13.716404+0000","last_peered":"2024-04-23T18:23:13.716404+0000","last_clean":"2024-04-23T18:23:13.716404+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:23:13.716404+0000","last_undegraded":"2024-04-23T18:23:13.716404+0000","last_fullsized":"2024-04-23T18:23:13.716404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715137+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:23:13.715137+0000","last_peered":"2024-04-23T18:23:13.715137+0000","last_clean":"2024-04-23T18:23:13.715137+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:23:13.715137+0000","last_undegraded":"2024-04-23T18:23:13.715137+0000","last_fullsized":"2024-04-23T18:23:13.715137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708248+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:23:13.708248+0000","last_peered":"2024-04-23T18:23:13.708248+0000","last_clean":"2024-04-23T18:23:13.708248+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:23:13.708248+0000","last_undegraded":"2024-04-23T18:23:13.708248+0000","last_fullsized":"2024-04-23T18:23:13.708248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723698+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:23:13.723698+0000","last_peered":"2024-04-23T18:23:13.723698+0000","last_clean":"2024-04-23T18:23:13.723698+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:23:13.723698+0000","last_undegraded":"2024-04-23T18:23:13.723698+0000","last_fullsized":"2024-04-23T18:23:13.723698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717018+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:23:13.717018+0000","last_peered":"2024-04-23T18:23:13.717018+0000","last_clean":"2024-04-23T18:23:13.717018+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:23:13.717018+0000","last_undegraded":"2024-04-23T18:23:13.717018+0000","last_fullsized":"2024-04-23T18:23:13.717018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704708+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:23:13.704708+0000","last_peered":"2024-04-23T18:23:13.704708+0000","last_clean":"2024-04-23T18:23:13.704708+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:23:13.704708+0000","last_undegraded":"2024-04-23T18:23:13.704708+0000","last_fullsized":"2024-04-23T18:23:13.704708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707492+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:23:13.707492+0000","last_peered":"2024-04-23T18:23:13.707492+0000","last_clean":"2024-04-23T18:23:13.707492+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:23:13.707492+0000","last_undegraded":"2024-04-23T18:23:13.707492+0000","last_fullsized":"2024-04-23T18:23:13.707492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715538+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:23:13.715538+0000","last_peered":"2024-04-23T18:23:13.715538+0000","last_clean":"2024-04-23T18:23:13.715538+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:23:13.715538+0000","last_undegraded":"2024-04-23T18:23:13.715538+0000","last_fullsized":"2024-04-23T18:23:13.715538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704209+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:23:13.704209+0000","last_peered":"2024-04-23T18:23:13.704209+0000","last_clean":"2024-04-23T18:23:13.704209+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:23:13.704209+0000","last_undegraded":"2024-04-23T18:23:13.704209+0000","last_fullsized":"2024-04-23T18:23:13.704209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707276+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:23:13.707276+0000","last_peered":"2024-04-23T18:23:13.707276+0000","last_clean":"2024-04-23T18:23:13.707276+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:23:13.707276+0000","last_undegraded":"2024-04-23T18:23:13.707276+0000","last_fullsized":"2024-04-23T18:23:13.707276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709100+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:23:13.709100+0000","last_peered":"2024-04-23T18:23:13.709100+0000","last_clean":"2024-04-23T18:23:13.709100+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:23:13.709100+0000","last_undegraded":"2024-04-23T18:23:13.709100+0000","last_fullsized":"2024-04-23T18:23:13.709100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715948+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:23:13.715948+0000","last_peered":"2024-04-23T18:23:13.715948+0000","last_clean":"2024-04-23T18:23:13.715948+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:23:13.715948+0000","last_undegraded":"2024-04-23T18:23:13.715948+0000","last_fullsized":"2024-04-23T18:23:13.715948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722449+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:23:13.722449+0000","last_peered":"2024-04-23T18:23:13.722449+0000","last_clean":"2024-04-23T18:23:13.722449+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:23:13.722449+0000","last_undegraded":"2024-04-23T18:23:13.722449+0000","last_fullsized":"2024-04-23T18:23:13.722449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717671+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:23:13.717671+0000","last_peered":"2024-04-23T18:23:13.717671+0000","last_clean":"2024-04-23T18:23:13.717671+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:23:13.717671+0000","last_undegraded":"2024-04-23T18:23:13.717671+0000","last_fullsized":"2024-04-23T18:23:13.717671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713208+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:23:13.713208+0000","last_peered":"2024-04-23T18:23:13.713208+0000","last_clean":"2024-04-23T18:23:13.713208+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:23:13.713208+0000","last_undegraded":"2024-04-23T18:23:13.713208+0000","last_fullsized":"2024-04-23T18:23:13.713208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715074+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:23:13.715074+0000","last_peered":"2024-04-23T18:23:13.715074+0000","last_clean":"2024-04-23T18:23:13.715074+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:23:13.715074+0000","last_undegraded":"2024-04-23T18:23:13.715074+0000","last_fullsized":"2024-04-23T18:23:13.715074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715116+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:23:13.715116+0000","last_peered":"2024-04-23T18:23:13.715116+0000","last_clean":"2024-04-23T18:23:13.715116+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:23:13.715116+0000","last_undegraded":"2024-04-23T18:23:13.715116+0000","last_fullsized":"2024-04-23T18:23:13.715116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705498+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:23:13.705498+0000","last_peered":"2024-04-23T18:23:13.705498+0000","last_clean":"2024-04-23T18:23:13.705498+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:23:13.705498+0000","last_undegraded":"2024-04-23T18:23:13.705498+0000","last_fullsized":"2024-04-23T18:23:13.705498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708857+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:23:13.708857+0000","last_peered":"2024-04-23T18:23:13.708857+0000","last_clean":"2024-04-23T18:23:13.708857+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:23:13.708857+0000","last_undegraded":"2024-04-23T18:23:13.708857+0000","last_fullsized":"2024-04-23T18:23:13.708857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.703875+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:23:13.703875+0000","last_peered":"2024-04-23T18:23:13.703875+0000","last_clean":"2024-04-23T18:23:13.703875+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:23:13.703875+0000","last_undegraded":"2024-04-23T18:23:13.703875+0000","last_fullsized":"2024-04-23T18:23:13.703875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707790+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:23:13.707790+0000","last_peered":"2024-04-23T18:23:13.707790+0000","last_clean":"2024-04-23T18:23:13.707790+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:23:13.707790+0000","last_undegraded":"2024-04-23T18:23:13.707790+0000","last_fullsized":"2024-04-23T18:23:13.707790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724832+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:23:13.724832+0000","last_peered":"2024-04-23T18:23:13.724832+0000","last_clean":"2024-04-23T18:23:13.724832+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:23:13.724832+0000","last_undegraded":"2024-04-23T18:23:13.724832+0000","last_fullsized":"2024-04-23T18:23:13.724832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713574+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:23:13.713574+0000","last_peered":"2024-04-23T18:23:13.713574+0000","last_clean":"2024-04-23T18:23:13.713574+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:23:13.713574+0000","last_undegraded":"2024-04-23T18:23:13.713574+0000","last_fullsized":"2024-04-23T18:23:13.713574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716655+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:23:13.716655+0000","last_peered":"2024-04-23T18:23:13.716655+0000","last_clean":"2024-04-23T18:23:13.716655+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:23:13.716655+0000","last_undegraded":"2024-04-23T18:23:13.716655+0000","last_fullsized":"2024-04-23T18:23:13.716655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707875+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:23:13.707875+0000","last_peered":"2024-04-23T18:23:13.707875+0000","last_clean":"2024-04-23T18:23:13.707875+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:23:13.707875+0000","last_undegraded":"2024-04-23T18:23:13.707875+0000","last_fullsized":"2024-04-23T18:23:13.707875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707060+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:23:13.707060+0000","last_peered":"2024-04-23T18:23:13.707060+0000","last_clean":"2024-04-23T18:23:13.707060+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:23:13.707060+0000","last_undegraded":"2024-04-23T18:23:13.707060+0000","last_fullsized":"2024-04-23T18:23:13.707060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.721077+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:23:13.721077+0000","last_peered":"2024-04-23T18:23:13.721077+0000","last_clean":"2024-04-23T18:23:13.721077+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:23:13.721077+0000","last_undegraded":"2024-04-23T18:23:13.721077+0000","last_fullsized":"2024-04-23T18:23:13.721077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717386+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:23:13.717386+0000","last_peered":"2024-04-23T18:23:13.717386+0000","last_clean":"2024-04-23T18:23:13.717386+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:23:13.717386+0000","last_undegraded":"2024-04-23T18:23:13.717386+0000","last_fullsized":"2024-04-23T18:23:13.717386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707660+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:23:13.707660+0000","last_peered":"2024-04-23T18:23:13.707660+0000","last_clean":"2024-04-23T18:23:13.707660+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:23:13.707660+0000","last_undegraded":"2024-04-23T18:23:13.707660+0000","last_fullsized":"2024-04-23T18:23:13.707660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707152+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:23:13.707152+0000","last_peered":"2024-04-23T18:23:13.707152+0000","last_clean":"2024-04-23T18:23:13.707152+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:23:13.707152+0000","last_undegraded":"2024-04-23T18:23:13.707152+0000","last_fullsized":"2024-04-23T18:23:13.707152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709779+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:23:13.709779+0000","last_peered":"2024-04-23T18:23:13.709779+0000","last_clean":"2024-04-23T18:23:13.709779+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:23:13.709779+0000","last_undegraded":"2024-04-23T18:23:13.709779+0000","last_fullsized":"2024-04-23T18:23:13.709779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:37.402011+0000","last_change":"2024-04-23T18:23:14.399026+0000","last_active":"2024-04-23T18:22:36.376251+0000","last_peered":"2024-04-23T18:22:36.376251+0000","last_clean":"2024-04-23T18:22:36.376251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:37.402011+0000","last_undegraded":"2024-04-23T18:22:37.402011+0000","last_fullsized":"2024-04-23T18:22:37.402011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712220+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:23:13.712220+0000","last_peered":"2024-04-23T18:23:13.712220+0000","last_clean":"2024-04-23T18:23:13.712220+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:23:13.712220+0000","last_undegraded":"2024-04-23T18:23:13.712220+0000","last_fullsized":"2024-04-23T18:23:13.712220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722563+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:23:13.722563+0000","last_peered":"2024-04-23T18:23:13.722563+0000","last_clean":"2024-04-23T18:23:13.722563+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:23:13.722563+0000","last_undegraded":"2024-04-23T18:23:13.722563+0000","last_fullsized":"2024-04-23T18:23:13.722563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713085+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:23:13.713085+0000","last_peered":"2024-04-23T18:23:13.713085+0000","last_clean":"2024-04-23T18:23:13.713085+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:23:13.713085+0000","last_undegraded":"2024-04-23T18:23:13.713085+0000","last_fullsized":"2024-04-23T18:23:13.713085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704661+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:23:13.704661+0000","last_peered":"2024-04-23T18:23:13.704661+0000","last_clean":"2024-04-23T18:23:13.704661+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:23:13.704661+0000","last_undegraded":"2024-04-23T18:23:13.704661+0000","last_fullsized":"2024-04-23T18:23:13.704661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714295+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:23:13.714295+0000","last_peered":"2024-04-23T18:23:13.714295+0000","last_clean":"2024-04-23T18:23:13.714295+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:23:13.714295+0000","last_undegraded":"2024-04-23T18:23:13.714295+0000","last_fullsized":"2024-04-23T18:23:13.714295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722744+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:23:13.722744+0000","last_peered":"2024-04-23T18:23:13.722744+0000","last_clean":"2024-04-23T18:23:13.722744+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:23:13.722744+0000","last_undegraded":"2024-04-23T18:23:13.722744+0000","last_fullsized":"2024-04-23T18:23:13.722744+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712815+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:23:13.712815+0000","last_peered":"2024-04-23T18:23:13.712815+0000","last_clean":"2024-04-23T18:23:13.712815+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:23:13.712815+0000","last_undegraded":"2024-04-23T18:23:13.712815+0000","last_fullsized":"2024-04-23T18:23:13.712815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724334+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:23:13.724334+0000","last_peered":"2024-04-23T18:23:13.724334+0000","last_clean":"2024-04-23T18:23:13.724334+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:23:13.724334+0000","last_undegraded":"2024-04-23T18:23:13.724334+0000","last_fullsized":"2024-04-23T18:23:13.724334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710819+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:23:13.710819+0000","last_peered":"2024-04-23T18:23:13.710819+0000","last_clean":"2024-04-23T18:23:13.710819+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:23:13.710819+0000","last_undegraded":"2024-04-23T18:23:13.710819+0000","last_fullsized":"2024-04-23T18:23:13.710819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707782+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:23:13.707782+0000","last_peered":"2024-04-23T18:23:13.707782+0000","last_clean":"2024-04-23T18:23:13.707782+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:23:13.707782+0000","last_undegraded":"2024-04-23T18:23:13.707782+0000","last_fullsized":"2024-04-23T18:23:13.707782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716205+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:23:13.716205+0000","last_peered":"2024-04-23T18:23:13.716205+0000","last_clean":"2024-04-23T18:23:13.716205+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:23:13.716205+0000","last_undegraded":"2024-04-23T18:23:13.716205+0000","last_fullsized":"2024-04-23T18:23:13.716205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708424+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:23:13.708424+0000","last_peered":"2024-04-23T18:23:13.708424+0000","last_clean":"2024-04-23T18:23:13.708424+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:23:13.708424+0000","last_undegraded":"2024-04-23T18:23:13.708424+0000","last_fullsized":"2024-04-23T18:23:13.708424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"peering","last_fresh":"2024-04-23T18:22:39.394570+0000","last_change":"2024-04-23T18:23:13.712613+0000","last_active":"2024-04-23T18:23:13.712613+0000","last_peered":"2024-04-23T18:22:39.394570+0000","last_clean":"2024-04-23T18:22:39.394570+0000","last_became_active":"2024-04-23T18:22:37.421745+0000","last_became_peered":"2024-04-23T18:22:37.421745+0000","last_unstale":"2024-04-23T18:22:39.394570+0000","last_undegraded":"2024-04-23T18:22:39.394570+0000","last_fullsized":"2024-04-23T18:22:39.394570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,4,5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.725226+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:23:13.725226+0000","last_peered":"2024-04-23T18:23:13.725226+0000","last_clean":"2024-04-23T18:23:13.725226+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:23:13.725226+0000","last_undegraded":"2024-04-23T18:23:13.725226+0000","last_fullsized":"2024-04-23T18:23:13.725226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711073+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:23:13.711073+0000","last_peered":"2024-04-23T18:23:13.711073+0000","last_clean":"2024-04-23T18:23:13.711073+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:23:13.711073+0000","last_undegraded":"2024-04-23T18:23:13.711073+0000","last_fullsized":"2024-04-23T18:23:13.711073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710196+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:23:13.710196+0000","last_peered":"2024-04-23T18:23:13.710196+0000","last_clean":"2024-04-23T18:23:13.710196+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:23:13.710196+0000","last_undegraded":"2024-04-23T18:23:13.710196+0000","last_fullsized":"2024-04-23T18:23:13.710196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724766+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:23:13.724766+0000","last_peered":"2024-04-23T18:23:13.724766+0000","last_clean":"2024-04-23T18:23:13.724766+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:23:13.724766+0000","last_undegraded":"2024-04-23T18:23:13.724766+0000","last_fullsized":"2024-04-23T18:23:13.724766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.718445+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:23:13.718445+0000","last_peered":"2024-04-23T18:23:13.718445+0000","last_clean":"2024-04-23T18:23:13.718445+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:23:13.718445+0000","last_undegraded":"2024-04-23T18:23:13.718445+0000","last_fullsized":"2024-04-23T18:23:13.718445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711927+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:23:13.711927+0000","last_peered":"2024-04-23T18:23:13.711927+0000","last_clean":"2024-04-23T18:23:13.711927+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:23:13.711927+0000","last_undegraded":"2024-04-23T18:23:13.711927+0000","last_fullsized":"2024-04-23T18:23:13.711927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:33.374695+0000","last_change":"2024-04-23T18:23:14.398956+0000","last_active":"2024-04-23T18:22:32.337166+0000","last_peered":"2024-04-23T18:22:32.337166+0000","last_clean":"2024-04-23T18:22:32.337166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:33.374695+0000","last_undegraded":"2024-04-23T18:22:33.374695+0000","last_fullsized":"2024-04-23T18:22:33.374695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'15","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709549+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:23:13.709549+0000","last_peered":"2024-04-23T18:23:13.709549+0000","last_clean":"2024-04-23T18:23:13.709549+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:23:13.709549+0000","last_undegraded":"2024-04-23T18:23:13.709549+0000","last_fullsized":"2024-04-23T18:23:13.709549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712978+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:23:13.712978+0000","last_peered":"2024-04-23T18:23:13.712978+0000","last_clean":"2024-04-23T18:23:13.712978+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:23:13.712978+0000","last_undegraded":"2024-04-23T18:23:13.712978+0000","last_fullsized":"2024-04-23T18:23:13.712978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707934+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:23:13.707934+0000","last_peered":"2024-04-23T18:23:13.707934+0000","last_clean":"2024-04-23T18:23:13.707934+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:23:13.707934+0000","last_undegraded":"2024-04-23T18:23:13.707934+0000","last_fullsized":"2024-04-23T18:23:13.707934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708251+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:23:13.708251+0000","last_peered":"2024-04-23T18:23:13.708251+0000","last_clean":"2024-04-23T18:23:13.708251+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:23:13.708251+0000","last_undegraded":"2024-04-23T18:23:13.708251+0000","last_fullsized":"2024-04-23T18:23:13.708251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704942+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:23:13.704942+0000","last_peered":"2024-04-23T18:23:13.704942+0000","last_clean":"2024-04-23T18:23:13.704942+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:23:13.704942+0000","last_undegraded":"2024-04-23T18:23:13.704942+0000","last_fullsized":"2024-04-23T18:23:13.704942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723425+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:23:13.723425+0000","last_peered":"2024-04-23T18:23:13.723425+0000","last_clean":"2024-04-23T18:23:13.723425+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:23:13.723425+0000","last_undegraded":"2024-04-23T18:23:13.723425+0000","last_fullsized":"2024-04-23T18:23:13.723425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717077+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:23:13.717077+0000","last_peered":"2024-04-23T18:23:13.717077+0000","last_clean":"2024-04-23T18:23:13.717077+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:23:13.717077+0000","last_undegraded":"2024-04-23T18:23:13.717077+0000","last_fullsized":"2024-04-23T18:23:13.717077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705662+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:23:13.705662+0000","last_peered":"2024-04-23T18:23:13.705662+0000","last_clean":"2024-04-23T18:23:13.705662+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:23:13.705662+0000","last_undegraded":"2024-04-23T18:23:13.705662+0000","last_fullsized":"2024-04-23T18:23:13.705662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713070+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:23:13.713070+0000","last_peered":"2024-04-23T18:23:13.713070+0000","last_clean":"2024-04-23T18:23:13.713070+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:23:13.713070+0000","last_undegraded":"2024-04-23T18:23:13.713070+0000","last_fullsized":"2024-04-23T18:23:13.713070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'6","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713237+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:23:13.713237+0000","last_peered":"2024-04-23T18:23:13.713237+0000","last_clean":"2024-04-23T18:23:13.713237+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:23:13.713237+0000","last_undegraded":"2024-04-23T18:23:13.713237+0000","last_fullsized":"2024-04-23T18:23:13.713237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716173+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:23:13.716173+0000","last_peered":"2024-04-23T18:23:13.716173+0000","last_clean":"2024-04-23T18:23:13.716173+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:23:13.716173+0000","last_undegraded":"2024-04-23T18:23:13.716173+0000","last_fullsized":"2024-04-23T18:23:13.716173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724257+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:23:13.724257+0000","last_peered":"2024-04-23T18:23:13.724257+0000","last_clean":"2024-04-23T18:23:13.724257+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:23:13.724257+0000","last_undegraded":"2024-04-23T18:23:13.724257+0000","last_fullsized":"2024-04-23T18:23:13.724257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712704+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:23:13.712704+0000","last_peered":"2024-04-23T18:23:13.712704+0000","last_clean":"2024-04-23T18:23:13.712704+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:23:13.712704+0000","last_undegraded":"2024-04-23T18:23:13.712704+0000","last_fullsized":"2024-04-23T18:23:13.712704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:37.396053+0000","last_change":"2024-04-23T18:23:14.399300+0000","last_active":"2024-04-23T18:22:36.376251+0000","last_peered":"2024-04-23T18:22:36.376251+0000","last_clean":"2024-04-23T18:22:36.376251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:37.396053+0000","last_undegraded":"2024-04-23T18:22:37.396053+0000","last_fullsized":"2024-04-23T18:22:37.396053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715884+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:23:13.715884+0000","last_peered":"2024-04-23T18:23:13.715884+0000","last_clean":"2024-04-23T18:23:13.715884+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:23:13.715884+0000","last_undegraded":"2024-04-23T18:23:13.715884+0000","last_fullsized":"2024-04-23T18:23:13.715884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708327+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:23:13.708327+0000","last_peered":"2024-04-23T18:23:13.708327+0000","last_clean":"2024-04-23T18:23:13.708327+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:23:13.708327+0000","last_undegraded":"2024-04-23T18:23:13.708327+0000","last_fullsized":"2024-04-23T18:23:13.708327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.720845+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:23:13.720845+0000","last_peered":"2024-04-23T18:23:13.720845+0000","last_clean":"2024-04-23T18:23:13.720845+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:23:13.720845+0000","last_undegraded":"2024-04-23T18:23:13.720845+0000","last_fullsized":"2024-04-23T18:23:13.720845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714022+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:23:13.714022+0000","last_peered":"2024-04-23T18:23:13.714022+0000","last_clean":"2024-04-23T18:23:13.714022+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:23:13.714022+0000","last_undegraded":"2024-04-23T18:23:13.714022+0000","last_fullsized":"2024-04-23T18:23:13.714022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714003+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:23:13.714003+0000","last_peered":"2024-04-23T18:23:13.714003+0000","last_clean":"2024-04-23T18:23:13.714003+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:23:13.714003+0000","last_undegraded":"2024-04-23T18:23:13.714003+0000","last_fullsized":"2024-04-23T18:23:13.714003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704014+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:23:13.704014+0000","last_peered":"2024-04-23T18:23:13.704014+0000","last_clean":"2024-04-23T18:23:13.704014+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:23:13.704014+0000","last_undegraded":"2024-04-23T18:23:13.704014+0000","last_fullsized":"2024-04-23T18:23:13.704014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713743+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:23:13.713743+0000","last_peered":"2024-04-23T18:23:13.713743+0000","last_clean":"2024-04-23T18:23:13.713743+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:23:13.713743+0000","last_undegraded":"2024-04-23T18:23:13.713743+0000","last_fullsized":"2024-04-23T18:23:13.713743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714758+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:23:13.714758+0000","last_peered":"2024-04-23T18:23:13.714758+0000","last_clean":"2024-04-23T18:23:13.714758+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:23:13.714758+0000","last_undegraded":"2024-04-23T18:23:13.714758+0000","last_fullsized":"2024-04-23T18:23:13.714758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704911+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:23:13.704911+0000","last_peered":"2024-04-23T18:23:13.704911+0000","last_clean":"2024-04-23T18:23:13.704911+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:23:13.704911+0000","last_undegraded":"2024-04-23T18:23:13.704911+0000","last_fullsized":"2024-04-23T18:23:13.704911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712345+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:23:13.712345+0000","last_peered":"2024-04-23T18:23:13.712345+0000","last_clean":"2024-04-23T18:23:13.712345+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:23:13.712345+0000","last_undegraded":"2024-04-23T18:23:13.712345+0000","last_fullsized":"2024-04-23T18:23:13.712345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707146+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:23:13.707146+0000","last_peered":"2024-04-23T18:23:13.707146+0000","last_clean":"2024-04-23T18:23:13.707146+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:23:13.707146+0000","last_undegraded":"2024-04-23T18:23:13.707146+0000","last_fullsized":"2024-04-23T18:23:13.707146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711003+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:23:13.711003+0000","last_peered":"2024-04-23T18:23:13.711003+0000","last_clean":"2024-04-23T18:23:13.711003+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:23:13.711003+0000","last_undegraded":"2024-04-23T18:23:13.711003+0000","last_fullsized":"2024-04-23T18:23:13.711003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714572+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:23:13.714572+0000","last_peered":"2024-04-23T18:23:13.714572+0000","last_clean":"2024-04-23T18:23:13.714572+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:23:13.714572+0000","last_undegraded":"2024-04-23T18:23:13.714572+0000","last_fullsized":"2024-04-23T18:23:13.714572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704115+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:23:13.704115+0000","last_peered":"2024-04-23T18:23:13.704115+0000","last_clean":"2024-04-23T18:23:13.704115+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:23:13.704115+0000","last_undegraded":"2024-04-23T18:23:13.704115+0000","last_fullsized":"2024-04-23T18:23:13.704115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704366+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:23:13.704366+0000","last_peered":"2024-04-23T18:23:13.704366+0000","last_clean":"2024-04-23T18:23:13.704366+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:23:13.704366+0000","last_undegraded":"2024-04-23T18:23:13.704366+0000","last_fullsized":"2024-04-23T18:23:13.704366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716051+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:23:13.716051+0000","last_peered":"2024-04-23T18:23:13.716051+0000","last_clean":"2024-04-23T18:23:13.716051+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:23:13.716051+0000","last_undegraded":"2024-04-23T18:23:13.716051+0000","last_fullsized":"2024-04-23T18:23:13.716051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713149+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:23:13.713149+0000","last_peered":"2024-04-23T18:23:13.713149+0000","last_clean":"2024-04-23T18:23:13.713149+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:23:13.713149+0000","last_undegraded":"2024-04-23T18:23:13.713149+0000","last_fullsized":"2024-04-23T18:23:13.713149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709902+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:23:13.709902+0000","last_peered":"2024-04-23T18:23:13.709902+0000","last_clean":"2024-04-23T18:23:13.709902+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:23:13.709902+0000","last_undegraded":"2024-04-23T18:23:13.709902+0000","last_fullsized":"2024-04-23T18:23:13.709902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705652+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:23:13.705652+0000","last_peered":"2024-04-23T18:23:13.705652+0000","last_clean":"2024-04-23T18:23:13.705652+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:23:13.705652+0000","last_undegraded":"2024-04-23T18:23:13.705652+0000","last_fullsized":"2024-04-23T18:23:13.705652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715614+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:23:13.715614+0000","last_peered":"2024-04-23T18:23:13.715614+0000","last_clean":"2024-04-23T18:23:13.715614+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:23:13.715614+0000","last_undegraded":"2024-04-23T18:23:13.715614+0000","last_fullsized":"2024-04-23T18:23:13.715614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704937+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:23:13.704937+0000","last_peered":"2024-04-23T18:23:13.704937+0000","last_clean":"2024-04-23T18:23:13.704937+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:23:13.704937+0000","last_undegraded":"2024-04-23T18:23:13.704937+0000","last_fullsized":"2024-04-23T18:23:13.704937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707678+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:23:13.707678+0000","last_peered":"2024-04-23T18:23:13.707678+0000","last_clean":"2024-04-23T18:23:13.707678+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:23:13.707678+0000","last_undegraded":"2024-04-23T18:23:13.707678+0000","last_fullsized":"2024-04-23T18:23:13.707678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709677+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:23:13.709677+0000","last_peered":"2024-04-23T18:23:13.709677+0000","last_clean":"2024-04-23T18:23:13.709677+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:23:13.709677+0000","last_undegraded":"2024-04-23T18:23:13.709677+0000","last_fullsized":"2024-04-23T18:23:13.709677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716889+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:23:13.716889+0000","last_peered":"2024-04-23T18:23:13.716889+0000","last_clean":"2024-04-23T18:23:13.716889+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:23:13.716889+0000","last_undegraded":"2024-04-23T18:23:13.716889+0000","last_fullsized":"2024-04-23T18:23:13.716889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713039+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:23:13.713039+0000","last_peered":"2024-04-23T18:23:13.713039+0000","last_clean":"2024-04-23T18:23:13.713039+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:23:13.713039+0000","last_undegraded":"2024-04-23T18:23:13.713039+0000","last_fullsized":"2024-04-23T18:23:13.713039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705260+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:23:13.705260+0000","last_peered":"2024-04-23T18:23:13.705260+0000","last_clean":"2024-04-23T18:23:13.705260+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:23:13.705260+0000","last_undegraded":"2024-04-23T18:23:13.705260+0000","last_fullsized":"2024-04-23T18:23:13.705260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708044+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:23:13.708044+0000","last_peered":"2024-04-23T18:23:13.708044+0000","last_clean":"2024-04-23T18:23:13.708044+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:23:13.708044+0000","last_undegraded":"2024-04-23T18:23:13.708044+0000","last_fullsized":"2024-04-23T18:23:13.708044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715561+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:23:13.715561+0000","last_peered":"2024-04-23T18:23:13.715561+0000","last_clean":"2024-04-23T18:23:13.715561+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:23:13.715561+0000","last_undegraded":"2024-04-23T18:23:13.715561+0000","last_fullsized":"2024-04-23T18:23:13.715561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705373+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:23:13.705373+0000","last_peered":"2024-04-23T18:23:13.705373+0000","last_clean":"2024-04-23T18:23:13.705373+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:23:13.705373+0000","last_undegraded":"2024-04-23T18:23:13.705373+0000","last_fullsized":"2024-04-23T18:23:13.705373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710750+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:23:13.710750+0000","last_peered":"2024-04-23T18:23:13.710750+0000","last_clean":"2024-04-23T18:23:13.710750+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:23:13.710750+0000","last_undegraded":"2024-04-23T18:23:13.710750+0000","last_fullsized":"2024-04-23T18:23:13.710750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704180+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:23:13.704180+0000","last_peered":"2024-04-23T18:23:13.704180+0000","last_clean":"2024-04-23T18:23:13.704180+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:23:13.704180+0000","last_undegraded":"2024-04-23T18:23:13.704180+0000","last_fullsized":"2024-04-23T18:23:13.704180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:38.519804+0000","last_change":"2024-04-23T18:23:14.398989+0000","last_active":"2024-04-23T18:23:14.398989+0000","last_peered":"2024-04-23T18:22:38.519804+0000","last_clean":"2024-04-23T18:22:38.519804+0000","last_became_active":"2024-04-23T18:22:33.396752+0000","last_became_peered":"2024-04-23T18:22:33.396752+0000","last_unstale":"2024-04-23T18:22:38.519804+0000","last_undegraded":"2024-04-23T18:22:38.519804+0000","last_fullsized":"2024-04-23T18:22:38.519804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712922+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:23:13.712922+0000","last_peered":"2024-04-23T18:23:13.712922+0000","last_clean":"2024-04-23T18:23:13.712922+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:23:13.712922+0000","last_undegraded":"2024-04-23T18:23:13.712922+0000","last_fullsized":"2024-04-23T18:23:13.712922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712299+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:23:13.712299+0000","last_peered":"2024-04-23T18:23:13.712299+0000","last_clean":"2024-04-23T18:23:13.712299+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:23:13.712299+0000","last_undegraded":"2024-04-23T18:23:13.712299+0000","last_fullsized":"2024-04-23T18:23:13.712299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724741+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:23:13.724741+0000","last_peered":"2024-04-23T18:23:13.724741+0000","last_clean":"2024-04-23T18:23:13.724741+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:23:13.724741+0000","last_undegraded":"2024-04-23T18:23:13.724741+0000","last_fullsized":"2024-04-23T18:23:13.724741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711311+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:23:13.711311+0000","last_peered":"2024-04-23T18:23:13.711311+0000","last_clean":"2024-04-23T18:23:13.711311+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:23:13.711311+0000","last_undegraded":"2024-04-23T18:23:13.711311+0000","last_fullsized":"2024-04-23T18:23:13.711311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716888+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:23:13.716888+0000","last_peered":"2024-04-23T18:23:13.716888+0000","last_clean":"2024-04-23T18:23:13.716888+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:23:13.716888+0000","last_undegraded":"2024-04-23T18:23:13.716888+0000","last_fullsized":"2024-04-23T18:23:13.716888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710505+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:23:13.710505+0000","last_peered":"2024-04-23T18:23:13.710505+0000","last_clean":"2024-04-23T18:23:13.710505+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:23:13.710505+0000","last_undegraded":"2024-04-23T18:23:13.710505+0000","last_fullsized":"2024-04-23T18:23:13.710505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707148+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:23:13.707148+0000","last_peered":"2024-04-23T18:23:13.707148+0000","last_clean":"2024-04-23T18:23:13.707148+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:23:13.707148+0000","last_undegraded":"2024-04-23T18:23:13.707148+0000","last_fullsized":"2024-04-23T18:23:13.707148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712966+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:23:13.712966+0000","last_peered":"2024-04-23T18:23:13.712966+0000","last_clean":"2024-04-23T18:23:13.712966+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:23:13.712966+0000","last_undegraded":"2024-04-23T18:23:13.712966+0000","last_fullsized":"2024-04-23T18:23:13.712966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704612+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:23:13.704612+0000","last_peered":"2024-04-23T18:23:13.704612+0000","last_clean":"2024-04-23T18:23:13.704612+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:23:13.704612+0000","last_undegraded":"2024-04-23T18:23:13.704612+0000","last_fullsized":"2024-04-23T18:23:13.704612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715731+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:23:13.715731+0000","last_peered":"2024-04-23T18:23:13.715731+0000","last_clean":"2024-04-23T18:23:13.715731+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:23:13.715731+0000","last_undegraded":"2024-04-23T18:23:13.715731+0000","last_fullsized":"2024-04-23T18:23:13.715731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713268+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:23:13.713268+0000","last_peered":"2024-04-23T18:23:13.713268+0000","last_clean":"2024-04-23T18:23:13.713268+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:23:13.713268+0000","last_undegraded":"2024-04-23T18:23:13.713268+0000","last_fullsized":"2024-04-23T18:23:13.713268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715336+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:23:13.715336+0000","last_peered":"2024-04-23T18:23:13.715336+0000","last_clean":"2024-04-23T18:23:13.715336+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:23:13.715336+0000","last_undegraded":"2024-04-23T18:23:13.715336+0000","last_fullsized":"2024-04-23T18:23:13.715336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.725146+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:23:13.725146+0000","last_peered":"2024-04-23T18:23:13.725146+0000","last_clean":"2024-04-23T18:23:13.725146+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:23:13.725146+0000","last_undegraded":"2024-04-23T18:23:13.725146+0000","last_fullsized":"2024-04-23T18:23:13.725146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"peering","last_fresh":"2024-04-23T18:22:38.511717+0000","last_change":"2024-04-23T18:23:13.704483+0000","last_active":"2024-04-23T18:23:13.704483+0000","last_peered":"2024-04-23T18:22:38.511717+0000","last_clean":"2024-04-23T18:22:38.511717+0000","last_became_active":"2024-04-23T18:22:33.397476+0000","last_became_peered":"2024-04-23T18:22:33.397476+0000","last_unstale":"2024-04-23T18:22:38.511717+0000","last_undegraded":"2024-04-23T18:22:38.511717+0000","last_fullsized":"2024-04-23T18:22:38.511717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723094+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:23:13.723094+0000","last_peered":"2024-04-23T18:23:13.723094+0000","last_clean":"2024-04-23T18:23:13.723094+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:23:13.723094+0000","last_undegraded":"2024-04-23T18:23:13.723094+0000","last_fullsized":"2024-04-23T18:23:13.723094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713507+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:23:13.713507+0000","last_peered":"2024-04-23T18:23:13.713507+0000","last_clean":"2024-04-23T18:23:13.713507+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:23:13.713507+0000","last_undegraded":"2024-04-23T18:23:13.713507+0000","last_fullsized":"2024-04-23T18:23:13.713507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722558+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:23:13.722558+0000","last_peered":"2024-04-23T18:23:13.722558+0000","last_clean":"2024-04-23T18:23:13.722558+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:23:13.722558+0000","last_undegraded":"2024-04-23T18:23:13.722558+0000","last_fullsized":"2024-04-23T18:23:13.722558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713966+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:23:13.713966+0000","last_peered":"2024-04-23T18:23:13.713966+0000","last_clean":"2024-04-23T18:23:13.713966+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:23:13.713966+0000","last_undegraded":"2024-04-23T18:23:13.713966+0000","last_fullsized":"2024-04-23T18:23:13.713966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713681+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:23:13.713681+0000","last_peered":"2024-04-23T18:23:13.713681+0000","last_clean":"2024-04-23T18:23:13.713681+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:23:13.713681+0000","last_undegraded":"2024-04-23T18:23:13.713681+0000","last_fullsized":"2024-04-23T18:23:13.713681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708751+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:23:13.708751+0000","last_peered":"2024-04-23T18:23:13.708751+0000","last_clean":"2024-04-23T18:23:13.708751+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:23:13.708751+0000","last_undegraded":"2024-04-23T18:23:13.708751+0000","last_fullsized":"2024-04-23T18:23:13.708751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724963+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:23:13.724963+0000","last_peered":"2024-04-23T18:23:13.724963+0000","last_clean":"2024-04-23T18:23:13.724963+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:23:13.724963+0000","last_undegraded":"2024-04-23T18:23:13.724963+0000","last_fullsized":"2024-04-23T18:23:13.724963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":699078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":108772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":101228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":111948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":286720,"data_stored":108212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":108338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":698422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:23:17.714 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:23:17.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.895+0000 7ffbeaa00640 1 Processor -- start 2024-04-23T18:23:17.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbeaa00640 1 -- start start 2024-04-23T18:23:17.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbeaa00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffbe41555d0 0x7ffbe415b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbeaa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffbe4073b00 0x7ffbe406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbeaa00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe415ba20 con 0x7ffbe415c770 2024-04-23T18:23:17.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbeaa00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7ffbe415c2c0 con 0x7ffbe41555d0 2024-04-23T18:23:17.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbeaa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe40cecf0 con 0x7ffbe4073b00 2024-04-23T18:23:17.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbe3e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffbe41555d0 0x7ffbe415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbe3e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffbe41555d0 0x7ffbe415b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56146/0 (socket says 172.21.15.28:56146) 2024-04-23T18:23:17.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbe3e00640 1 -- 172.21.15.28:0/1689441629 learned_addr learned my addr 172.21.15.28:0/1689441629 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:17.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbe8a00640 1 --2- 172.21.15.28:0/1689441629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffbe4073b00 0x7ffbe406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbe3e00640 1 -- 172.21.15.28:0/1689441629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffbe4073b00 msgr2=0x7ffbe406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:17.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbe3e00640 1 --2- 172.21.15.28:0/1689441629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffbe4073b00 0x7ffbe406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbe3e00640 1 -- 172.21.15.28:0/1689441629 >> v1:172.21.15.137:6789/0 conn(0x7ffbe415c770 legacy=0x7ffbe40cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.899+0000 7ffbe3e00640 1 -- 172.21.15.28:0/1689441629 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe415bd00 con 0x7ffbe41555d0 2024-04-23T18:23:17.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbe3e00640 1 --2- 172.21.15.28:0/1689441629 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbe41555d0 0x7ffbe415b300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009870 tx=0x7ffbd401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25fb13ae75cde27 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:17.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbe3400640 1 -- 172.21.15.28:0/1689441629 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40b5070 con 0x7ffbe41555d0 2024-04-23T18:23:17.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbe3400640 1 -- 172.21.15.28:0/1689441629 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd40a8a50 con 0x7ffbe41555d0 2024-04-23T18:23:17.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbe3400640 1 -- 172.21.15.28:0/1689441629 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40a8e20 con 0x7ffbe41555d0 2024-04-23T18:23:17.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbeaa00640 1 -- 172.21.15.28:0/1689441629 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbe41555d0 msgr2=0x7ffbe415b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbeaa00640 1 --2- 172.21.15.28:0/1689441629 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbe41555d0 0x7ffbe415b300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009870 tx=0x7ffbd401ed50 comp rx=0 tx=0).stop 2024-04-23T18:23:17.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbeaa00640 1 -- 172.21.15.28:0/1689441629 shutdown_connections 2024-04-23T18:23:17.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbeaa00640 1 --2- 172.21.15.28:0/1689441629 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffbe4073b00 0x7ffbe406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbeaa00640 1 --2- 172.21.15.28:0/1689441629 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbe41555d0 0x7ffbe415b300 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbeaa00640 1 -- 172.21.15.28:0/1689441629 >> 172.21.15.28:0/1689441629 conn(0x7ffbe4072f30 msgr2=0x7ffbe4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:17.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbeaa00640 1 -- 172.21.15.28:0/1689441629 shutdown_connections 2024-04-23T18:23:17.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbeaa00640 1 -- 172.21.15.28:0/1689441629 wait complete. 2024-04-23T18:23:17.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbeaa00640 1 Processor -- start 2024-04-23T18:23:17.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.903+0000 7ffbeaa00640 1 -- start start 2024-04-23T18:23:17.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbeaa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffbe4073b00 0x7ffbe40c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbeaa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbe41555d0 0x7ffbe41f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbeaa00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbe415c770 0x7ffbe41f1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbeaa00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe41559b0 con 0x7ffbe415c770 2024-04-23T18:23:17.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbeaa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe40ce980 con 0x7ffbe41555d0 2024-04-23T18:23:17.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbeaa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe406bf20 con 0x7ffbe4073b00 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe8a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbe415c770 0x7ffbe41f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe8a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbe415c770 0x7ffbe41f1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56148/0 (socket says 172.21.15.28:56148) 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe8a00640 1 -- 172.21.15.28:0/3981850371 learned_addr learned my addr 172.21.15.28:0/3981850371 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe3e00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffbe4073b00 0x7ffbe40c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbdb400640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbe41555d0 0x7ffbe41f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe8a00640 1 -- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffbe4073b00 msgr2=0x7ffbe40c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe8a00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffbe4073b00 0x7ffbe40c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe8a00640 1 -- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbe41555d0 msgr2=0x7ffbe41f13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe8a00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbe41555d0 0x7ffbe41f13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe8a00640 1 -- 172.21.15.28:0/3981850371 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe40c7720 con 0x7ffbe415c770 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbdb400640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbe41555d0 0x7ffbe41f13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:17.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe8a00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbe415c770 0x7ffbe41f1910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc007e70 tx=0x7ffbdc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe0c00640 1 -- 172.21.15.28:0/3981850371 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc014620 con 0x7ffbe415c770 2024-04-23T18:23:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe0c00640 1 -- 172.21.15.28:0/3981850371 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc019070 con 0x7ffbe415c770 2024-04-23T18:23:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe0c00640 1 -- 172.21.15.28:0/3981850371 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc014a20 con 0x7ffbe415c770 2024-04-23T18:23:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbeaa00640 1 -- 172.21.15.28:0/3981850371 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe406f9d0 con 0x7ffbe415c770 2024-04-23T18:23:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbeaa00640 1 -- 172.21.15.28:0/3981850371 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe40c7160 con 0x7ffbe415c770 2024-04-23T18:23:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbeaa00640 1 -- 172.21.15.28:0/3981850371 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe4068cd0 con 0x7ffbe415c770 2024-04-23T18:23:17.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.907+0000 7ffbe0c00640 1 -- 172.21.15.28:0/3981850371 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffbdc014bc0 con 0x7ffbe415c770 2024-04-23T18:23:17.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.911+0000 7ffbe0c00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ffbc0068380 0x7ffbc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:17.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.911+0000 7ffbe0c00640 1 -- 172.21.15.28:0/3981850371 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ffbdc087710 con 0x7ffbe415c770 2024-04-23T18:23:17.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.911+0000 7ffbe3e00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ffbc0068380 0x7ffbc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:17.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.911+0000 7ffbe3e00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ffbc0068380 0x7ffbc006a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40b2000 tx=0x7ffbd4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:17.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:17.915+0000 7ffbe0c00640 1 -- 172.21.15.28:0/3981850371 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffbdc057830 con 0x7ffbe415c770 2024-04-23T18:23:18.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.075+0000 7ffbeaa00640 1 -- 172.21.15.28:0/3981850371 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffbe4156040 con 0x7ffbc0068380 2024-04-23T18:23:18.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.099+0000 7ffbe0c00640 1 -- 172.21.15.28:0/3981850371 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332258 (secure 0 0 0) 0x7ffbe4156040 con 0x7ffbc0068380 2024-04-23T18:23:18.098 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:18.100 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:23:18.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 -- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ffbc0068380 msgr2=0x7ffbc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ffbc0068380 0x7ffbc006a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40b2000 tx=0x7ffbd4008040 comp rx=0 tx=0).stop 2024-04-23T18:23:18.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 -- 172.21.15.28:0/3981850371 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbe415c770 msgr2=0x7ffbe41f1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbe415c770 0x7ffbe41f1910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc007e70 tx=0x7ffbdc00e4b0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 -- 172.21.15.28:0/3981850371 shutdown_connections 2024-04-23T18:23:18.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ffbc0068380 0x7ffbc006a840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbe415c770 0x7ffbe41f1910 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbe41555d0 0x7ffbe41f13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 --2- 172.21.15.28:0/3981850371 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffbe4073b00 0x7ffbe40c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 -- 172.21.15.28:0/3981850371 >> 172.21.15.28:0/3981850371 conn(0x7ffbe4072f30 msgr2=0x7ffbe415b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:18.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 -- 172.21.15.28:0/3981850371 shutdown_connections 2024-04-23T18:23:18.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.103+0000 7ffbeaa00640 1 -- 172.21.15.28:0/3981850371 wait complete. 2024-04-23T18:23:18.118 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-04-23T18:23:17.336099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232024,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742696,"statfs":{"total":773094113280,"available":772856520704,"internally_reserved":0,"allocated":3469312,"data_stored":2048170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1664,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002955"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714103+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:23:13.714103+0000","last_peered":"2024-04-23T18:23:13.714103+0000","last_clean":"2024-04-23T18:23:13.714103+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:23:13.714103+0000","last_undegraded":"2024-04-23T18:23:13.714103+0000","last_fullsized":"2024-04-23T18:23:13.714103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:38.512479+0000","last_change":"2024-04-23T18:23:14.399010+0000","last_active":"2024-04-23T18:23:14.399010+0000","last_peered":"2024-04-23T18:22:38.512479+0000","last_clean":"2024-04-23T18:22:38.512479+0000","last_became_active":"2024-04-23T18:22:33.374636+0000","last_became_peered":"2024-04-23T18:22:33.374636+0000","last_unstale":"2024-04-23T18:22:38.512479+0000","last_undegraded":"2024-04-23T18:22:38.512479+0000","last_fullsized":"2024-04-23T18:22:38.512479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.703975+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:23:13.703975+0000","last_peered":"2024-04-23T18:23:13.703975+0000","last_clean":"2024-04-23T18:23:13.703975+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:23:13.703975+0000","last_undegraded":"2024-04-23T18:23:13.703975+0000","last_fullsized":"2024-04-23T18:23:13.703975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705142+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:23:13.705142+0000","last_peered":"2024-04-23T18:23:13.705142+0000","last_clean":"2024-04-23T18:23:13.705142+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:23:13.705142+0000","last_undegraded":"2024-04-23T18:23:13.705142+0000","last_fullsized":"2024-04-23T18:23:13.705142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713925+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:23:13.713925+0000","last_peered":"2024-04-23T18:23:13.713925+0000","last_clean":"2024-04-23T18:23:13.713925+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:23:13.713925+0000","last_undegraded":"2024-04-23T18:23:13.713925+0000","last_fullsized":"2024-04-23T18:23:13.713925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711813+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:23:13.711813+0000","last_peered":"2024-04-23T18:23:13.711813+0000","last_clean":"2024-04-23T18:23:13.711813+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:23:13.711813+0000","last_undegraded":"2024-04-23T18:23:13.711813+0000","last_fullsized":"2024-04-23T18:23:13.711813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724579+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:23:13.724579+0000","last_peered":"2024-04-23T18:23:13.724579+0000","last_clean":"2024-04-23T18:23:13.724579+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:23:13.724579+0000","last_undegraded":"2024-04-23T18:23:13.724579+0000","last_fullsized":"2024-04-23T18:23:13.724579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714242+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:23:13.714242+0000","last_peered":"2024-04-23T18:23:13.714242+0000","last_clean":"2024-04-23T18:23:13.714242+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:23:13.714242+0000","last_undegraded":"2024-04-23T18:23:13.714242+0000","last_fullsized":"2024-04-23T18:23:13.714242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.720246+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:23:13.720246+0000","last_peered":"2024-04-23T18:23:13.720246+0000","last_clean":"2024-04-23T18:23:13.720246+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:23:13.720246+0000","last_undegraded":"2024-04-23T18:23:13.720246+0000","last_fullsized":"2024-04-23T18:23:13.720246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724028+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:23:13.724028+0000","last_peered":"2024-04-23T18:23:13.724028+0000","last_clean":"2024-04-23T18:23:13.724028+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:23:13.724028+0000","last_undegraded":"2024-04-23T18:23:13.724028+0000","last_fullsized":"2024-04-23T18:23:13.724028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716404+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:23:13.716404+0000","last_peered":"2024-04-23T18:23:13.716404+0000","last_clean":"2024-04-23T18:23:13.716404+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:23:13.716404+0000","last_undegraded":"2024-04-23T18:23:13.716404+0000","last_fullsized":"2024-04-23T18:23:13.716404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715137+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:23:13.715137+0000","last_peered":"2024-04-23T18:23:13.715137+0000","last_clean":"2024-04-23T18:23:13.715137+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:23:13.715137+0000","last_undegraded":"2024-04-23T18:23:13.715137+0000","last_fullsized":"2024-04-23T18:23:13.715137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708248+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:23:13.708248+0000","last_peered":"2024-04-23T18:23:13.708248+0000","last_clean":"2024-04-23T18:23:13.708248+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:23:13.708248+0000","last_undegraded":"2024-04-23T18:23:13.708248+0000","last_fullsized":"2024-04-23T18:23:13.708248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723698+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:23:13.723698+0000","last_peered":"2024-04-23T18:23:13.723698+0000","last_clean":"2024-04-23T18:23:13.723698+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:23:13.723698+0000","last_undegraded":"2024-04-23T18:23:13.723698+0000","last_fullsized":"2024-04-23T18:23:13.723698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717018+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:23:13.717018+0000","last_peered":"2024-04-23T18:23:13.717018+0000","last_clean":"2024-04-23T18:23:13.717018+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:23:13.717018+0000","last_undegraded":"2024-04-23T18:23:13.717018+0000","last_fullsized":"2024-04-23T18:23:13.717018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704708+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:23:13.704708+0000","last_peered":"2024-04-23T18:23:13.704708+0000","last_clean":"2024-04-23T18:23:13.704708+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:23:13.704708+0000","last_undegraded":"2024-04-23T18:23:13.704708+0000","last_fullsized":"2024-04-23T18:23:13.704708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707492+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:23:13.707492+0000","last_peered":"2024-04-23T18:23:13.707492+0000","last_clean":"2024-04-23T18:23:13.707492+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:23:13.707492+0000","last_undegraded":"2024-04-23T18:23:13.707492+0000","last_fullsized":"2024-04-23T18:23:13.707492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715538+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:23:13.715538+0000","last_peered":"2024-04-23T18:23:13.715538+0000","last_clean":"2024-04-23T18:23:13.715538+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:23:13.715538+0000","last_undegraded":"2024-04-23T18:23:13.715538+0000","last_fullsized":"2024-04-23T18:23:13.715538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704209+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:23:13.704209+0000","last_peered":"2024-04-23T18:23:13.704209+0000","last_clean":"2024-04-23T18:23:13.704209+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:23:13.704209+0000","last_undegraded":"2024-04-23T18:23:13.704209+0000","last_fullsized":"2024-04-23T18:23:13.704209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707276+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:23:13.707276+0000","last_peered":"2024-04-23T18:23:13.707276+0000","last_clean":"2024-04-23T18:23:13.707276+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:23:13.707276+0000","last_undegraded":"2024-04-23T18:23:13.707276+0000","last_fullsized":"2024-04-23T18:23:13.707276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709100+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:23:13.709100+0000","last_peered":"2024-04-23T18:23:13.709100+0000","last_clean":"2024-04-23T18:23:13.709100+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:23:13.709100+0000","last_undegraded":"2024-04-23T18:23:13.709100+0000","last_fullsized":"2024-04-23T18:23:13.709100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715948+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:23:13.715948+0000","last_peered":"2024-04-23T18:23:13.715948+0000","last_clean":"2024-04-23T18:23:13.715948+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:23:13.715948+0000","last_undegraded":"2024-04-23T18:23:13.715948+0000","last_fullsized":"2024-04-23T18:23:13.715948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722449+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:23:13.722449+0000","last_peered":"2024-04-23T18:23:13.722449+0000","last_clean":"2024-04-23T18:23:13.722449+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:23:13.722449+0000","last_undegraded":"2024-04-23T18:23:13.722449+0000","last_fullsized":"2024-04-23T18:23:13.722449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717671+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:23:13.717671+0000","last_peered":"2024-04-23T18:23:13.717671+0000","last_clean":"2024-04-23T18:23:13.717671+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:23:13.717671+0000","last_undegraded":"2024-04-23T18:23:13.717671+0000","last_fullsized":"2024-04-23T18:23:13.717671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713208+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:23:13.713208+0000","last_peered":"2024-04-23T18:23:13.713208+0000","last_clean":"2024-04-23T18:23:13.713208+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:23:13.713208+0000","last_undegraded":"2024-04-23T18:23:13.713208+0000","last_fullsized":"2024-04-23T18:23:13.713208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715074+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:23:13.715074+0000","last_peered":"2024-04-23T18:23:13.715074+0000","last_clean":"2024-04-23T18:23:13.715074+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:23:13.715074+0000","last_undegraded":"2024-04-23T18:23:13.715074+0000","last_fullsized":"2024-04-23T18:23:13.715074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715116+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:23:13.715116+0000","last_peered":"2024-04-23T18:23:13.715116+0000","last_clean":"2024-04-23T18:23:13.715116+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:23:13.715116+0000","last_undegraded":"2024-04-23T18:23:13.715116+0000","last_fullsized":"2024-04-23T18:23:13.715116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705498+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:23:13.705498+0000","last_peered":"2024-04-23T18:23:13.705498+0000","last_clean":"2024-04-23T18:23:13.705498+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:23:13.705498+0000","last_undegraded":"2024-04-23T18:23:13.705498+0000","last_fullsized":"2024-04-23T18:23:13.705498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708857+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:23:13.708857+0000","last_peered":"2024-04-23T18:23:13.708857+0000","last_clean":"2024-04-23T18:23:13.708857+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:23:13.708857+0000","last_undegraded":"2024-04-23T18:23:13.708857+0000","last_fullsized":"2024-04-23T18:23:13.708857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.703875+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:23:13.703875+0000","last_peered":"2024-04-23T18:23:13.703875+0000","last_clean":"2024-04-23T18:23:13.703875+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:23:13.703875+0000","last_undegraded":"2024-04-23T18:23:13.703875+0000","last_fullsized":"2024-04-23T18:23:13.703875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707790+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:23:13.707790+0000","last_peered":"2024-04-23T18:23:13.707790+0000","last_clean":"2024-04-23T18:23:13.707790+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:23:13.707790+0000","last_undegraded":"2024-04-23T18:23:13.707790+0000","last_fullsized":"2024-04-23T18:23:13.707790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724832+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:23:13.724832+0000","last_peered":"2024-04-23T18:23:13.724832+0000","last_clean":"2024-04-23T18:23:13.724832+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:23:13.724832+0000","last_undegraded":"2024-04-23T18:23:13.724832+0000","last_fullsized":"2024-04-23T18:23:13.724832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713574+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:23:13.713574+0000","last_peered":"2024-04-23T18:23:13.713574+0000","last_clean":"2024-04-23T18:23:13.713574+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:23:13.713574+0000","last_undegraded":"2024-04-23T18:23:13.713574+0000","last_fullsized":"2024-04-23T18:23:13.713574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716655+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:23:13.716655+0000","last_peered":"2024-04-23T18:23:13.716655+0000","last_clean":"2024-04-23T18:23:13.716655+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:23:13.716655+0000","last_undegraded":"2024-04-23T18:23:13.716655+0000","last_fullsized":"2024-04-23T18:23:13.716655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707875+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:23:13.707875+0000","last_peered":"2024-04-23T18:23:13.707875+0000","last_clean":"2024-04-23T18:23:13.707875+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:23:13.707875+0000","last_undegraded":"2024-04-23T18:23:13.707875+0000","last_fullsized":"2024-04-23T18:23:13.707875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707060+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:23:13.707060+0000","last_peered":"2024-04-23T18:23:13.707060+0000","last_clean":"2024-04-23T18:23:13.707060+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:23:13.707060+0000","last_undegraded":"2024-04-23T18:23:13.707060+0000","last_fullsized":"2024-04-23T18:23:13.707060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.721077+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:23:13.721077+0000","last_peered":"2024-04-23T18:23:13.721077+0000","last_clean":"2024-04-23T18:23:13.721077+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:23:13.721077+0000","last_undegraded":"2024-04-23T18:23:13.721077+0000","last_fullsized":"2024-04-23T18:23:13.721077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717386+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:23:13.717386+0000","last_peered":"2024-04-23T18:23:13.717386+0000","last_clean":"2024-04-23T18:23:13.717386+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:23:13.717386+0000","last_undegraded":"2024-04-23T18:23:13.717386+0000","last_fullsized":"2024-04-23T18:23:13.717386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707660+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:23:13.707660+0000","last_peered":"2024-04-23T18:23:13.707660+0000","last_clean":"2024-04-23T18:23:13.707660+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:23:13.707660+0000","last_undegraded":"2024-04-23T18:23:13.707660+0000","last_fullsized":"2024-04-23T18:23:13.707660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707152+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:23:13.707152+0000","last_peered":"2024-04-23T18:23:13.707152+0000","last_clean":"2024-04-23T18:23:13.707152+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:23:13.707152+0000","last_undegraded":"2024-04-23T18:23:13.707152+0000","last_fullsized":"2024-04-23T18:23:13.707152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709779+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:23:13.709779+0000","last_peered":"2024-04-23T18:23:13.709779+0000","last_clean":"2024-04-23T18:23:13.709779+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:23:13.709779+0000","last_undegraded":"2024-04-23T18:23:13.709779+0000","last_fullsized":"2024-04-23T18:23:13.709779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:37.402011+0000","last_change":"2024-04-23T18:23:14.399026+0000","last_active":"2024-04-23T18:22:36.376251+0000","last_peered":"2024-04-23T18:22:36.376251+0000","last_clean":"2024-04-23T18:22:36.376251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:37.402011+0000","last_undegraded":"2024-04-23T18:22:37.402011+0000","last_fullsized":"2024-04-23T18:22:37.402011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712220+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:23:13.712220+0000","last_peered":"2024-04-23T18:23:13.712220+0000","last_clean":"2024-04-23T18:23:13.712220+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:23:13.712220+0000","last_undegraded":"2024-04-23T18:23:13.712220+0000","last_fullsized":"2024-04-23T18:23:13.712220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722563+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:23:13.722563+0000","last_peered":"2024-04-23T18:23:13.722563+0000","last_clean":"2024-04-23T18:23:13.722563+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:23:13.722563+0000","last_undegraded":"2024-04-23T18:23:13.722563+0000","last_fullsized":"2024-04-23T18:23:13.722563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713085+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:23:13.713085+0000","last_peered":"2024-04-23T18:23:13.713085+0000","last_clean":"2024-04-23T18:23:13.713085+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:23:13.713085+0000","last_undegraded":"2024-04-23T18:23:13.713085+0000","last_fullsized":"2024-04-23T18:23:13.713085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704661+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:23:13.704661+0000","last_peered":"2024-04-23T18:23:13.704661+0000","last_clean":"2024-04-23T18:23:13.704661+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:23:13.704661+0000","last_undegraded":"2024-04-23T18:23:13.704661+0000","last_fullsized":"2024-04-23T18:23:13.704661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714295+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:23:13.714295+0000","last_peered":"2024-04-23T18:23:13.714295+0000","last_clean":"2024-04-23T18:23:13.714295+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:23:13.714295+0000","last_undegraded":"2024-04-23T18:23:13.714295+0000","last_fullsized":"2024-04-23T18:23:13.714295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722744+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:23:13.722744+0000","last_peered":"2024-04-23T18:23:13.722744+0000","last_clean":"2024-04-23T18:23:13.722744+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:23:13.722744+0000","last_undegraded":"2024-04-23T18:23:13.722744+0000","last_fullsized":"2024-04-23T18:23:13.722744+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712815+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:23:13.712815+0000","last_peered":"2024-04-23T18:23:13.712815+0000","last_clean":"2024-04-23T18:23:13.712815+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:23:13.712815+0000","last_undegraded":"2024-04-23T18:23:13.712815+0000","last_fullsized":"2024-04-23T18:23:13.712815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724334+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:23:13.724334+0000","last_peered":"2024-04-23T18:23:13.724334+0000","last_clean":"2024-04-23T18:23:13.724334+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:23:13.724334+0000","last_undegraded":"2024-04-23T18:23:13.724334+0000","last_fullsized":"2024-04-23T18:23:13.724334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710819+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:23:13.710819+0000","last_peered":"2024-04-23T18:23:13.710819+0000","last_clean":"2024-04-23T18:23:13.710819+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:23:13.710819+0000","last_undegraded":"2024-04-23T18:23:13.710819+0000","last_fullsized":"2024-04-23T18:23:13.710819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707782+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:23:13.707782+0000","last_peered":"2024-04-23T18:23:13.707782+0000","last_clean":"2024-04-23T18:23:13.707782+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:23:13.707782+0000","last_undegraded":"2024-04-23T18:23:13.707782+0000","last_fullsized":"2024-04-23T18:23:13.707782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716205+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:23:13.716205+0000","last_peered":"2024-04-23T18:23:13.716205+0000","last_clean":"2024-04-23T18:23:13.716205+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:23:13.716205+0000","last_undegraded":"2024-04-23T18:23:13.716205+0000","last_fullsized":"2024-04-23T18:23:13.716205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708424+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:23:13.708424+0000","last_peered":"2024-04-23T18:23:13.708424+0000","last_clean":"2024-04-23T18:23:13.708424+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:23:13.708424+0000","last_undegraded":"2024-04-23T18:23:13.708424+0000","last_fullsized":"2024-04-23T18:23:13.708424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"peering","last_fresh":"2024-04-23T18:22:39.394570+0000","last_change":"2024-04-23T18:23:13.712613+0000","last_active":"2024-04-23T18:23:13.712613+0000","last_peered":"2024-04-23T18:22:39.394570+0000","last_clean":"2024-04-23T18:22:39.394570+0000","last_became_active":"2024-04-23T18:22:37.421745+0000","last_became_peered":"2024-04-23T18:22:37.421745+0000","last_unstale":"2024-04-23T18:22:39.394570+0000","last_undegraded":"2024-04-23T18:22:39.394570+0000","last_fullsized":"2024-04-23T18:22:39.394570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,4,5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.725226+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:23:13.725226+0000","last_peered":"2024-04-23T18:23:13.725226+0000","last_clean":"2024-04-23T18:23:13.725226+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:23:13.725226+0000","last_undegraded":"2024-04-23T18:23:13.725226+0000","last_fullsized":"2024-04-23T18:23:13.725226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711073+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:23:13.711073+0000","last_peered":"2024-04-23T18:23:13.711073+0000","last_clean":"2024-04-23T18:23:13.711073+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:23:13.711073+0000","last_undegraded":"2024-04-23T18:23:13.711073+0000","last_fullsized":"2024-04-23T18:23:13.711073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710196+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:23:13.710196+0000","last_peered":"2024-04-23T18:23:13.710196+0000","last_clean":"2024-04-23T18:23:13.710196+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:23:13.710196+0000","last_undegraded":"2024-04-23T18:23:13.710196+0000","last_fullsized":"2024-04-23T18:23:13.710196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724766+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:23:13.724766+0000","last_peered":"2024-04-23T18:23:13.724766+0000","last_clean":"2024-04-23T18:23:13.724766+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:23:13.724766+0000","last_undegraded":"2024-04-23T18:23:13.724766+0000","last_fullsized":"2024-04-23T18:23:13.724766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.718445+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:23:13.718445+0000","last_peered":"2024-04-23T18:23:13.718445+0000","last_clean":"2024-04-23T18:23:13.718445+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:23:13.718445+0000","last_undegraded":"2024-04-23T18:23:13.718445+0000","last_fullsized":"2024-04-23T18:23:13.718445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711927+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:23:13.711927+0000","last_peered":"2024-04-23T18:23:13.711927+0000","last_clean":"2024-04-23T18:23:13.711927+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:23:13.711927+0000","last_undegraded":"2024-04-23T18:23:13.711927+0000","last_fullsized":"2024-04-23T18:23:13.711927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:33.374695+0000","last_change":"2024-04-23T18:23:14.398956+0000","last_active":"2024-04-23T18:22:32.337166+0000","last_peered":"2024-04-23T18:22:32.337166+0000","last_clean":"2024-04-23T18:22:32.337166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:33.374695+0000","last_undegraded":"2024-04-23T18:22:33.374695+0000","last_fullsized":"2024-04-23T18:22:33.374695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'15","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709549+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:23:13.709549+0000","last_peered":"2024-04-23T18:23:13.709549+0000","last_clean":"2024-04-23T18:23:13.709549+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:23:13.709549+0000","last_undegraded":"2024-04-23T18:23:13.709549+0000","last_fullsized":"2024-04-23T18:23:13.709549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712978+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:23:13.712978+0000","last_peered":"2024-04-23T18:23:13.712978+0000","last_clean":"2024-04-23T18:23:13.712978+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:23:13.712978+0000","last_undegraded":"2024-04-23T18:23:13.712978+0000","last_fullsized":"2024-04-23T18:23:13.712978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707934+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:23:13.707934+0000","last_peered":"2024-04-23T18:23:13.707934+0000","last_clean":"2024-04-23T18:23:13.707934+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:23:13.707934+0000","last_undegraded":"2024-04-23T18:23:13.707934+0000","last_fullsized":"2024-04-23T18:23:13.707934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708251+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:23:13.708251+0000","last_peered":"2024-04-23T18:23:13.708251+0000","last_clean":"2024-04-23T18:23:13.708251+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:23:13.708251+0000","last_undegraded":"2024-04-23T18:23:13.708251+0000","last_fullsized":"2024-04-23T18:23:13.708251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704942+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:23:13.704942+0000","last_peered":"2024-04-23T18:23:13.704942+0000","last_clean":"2024-04-23T18:23:13.704942+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:23:13.704942+0000","last_undegraded":"2024-04-23T18:23:13.704942+0000","last_fullsized":"2024-04-23T18:23:13.704942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723425+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:23:13.723425+0000","last_peered":"2024-04-23T18:23:13.723425+0000","last_clean":"2024-04-23T18:23:13.723425+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:23:13.723425+0000","last_undegraded":"2024-04-23T18:23:13.723425+0000","last_fullsized":"2024-04-23T18:23:13.723425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717077+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:23:13.717077+0000","last_peered":"2024-04-23T18:23:13.717077+0000","last_clean":"2024-04-23T18:23:13.717077+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:23:13.717077+0000","last_undegraded":"2024-04-23T18:23:13.717077+0000","last_fullsized":"2024-04-23T18:23:13.717077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705662+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:23:13.705662+0000","last_peered":"2024-04-23T18:23:13.705662+0000","last_clean":"2024-04-23T18:23:13.705662+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:23:13.705662+0000","last_undegraded":"2024-04-23T18:23:13.705662+0000","last_fullsized":"2024-04-23T18:23:13.705662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713070+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:23:13.713070+0000","last_peered":"2024-04-23T18:23:13.713070+0000","last_clean":"2024-04-23T18:23:13.713070+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:23:13.713070+0000","last_undegraded":"2024-04-23T18:23:13.713070+0000","last_fullsized":"2024-04-23T18:23:13.713070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'6","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713237+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:23:13.713237+0000","last_peered":"2024-04-23T18:23:13.713237+0000","last_clean":"2024-04-23T18:23:13.713237+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:23:13.713237+0000","last_undegraded":"2024-04-23T18:23:13.713237+0000","last_fullsized":"2024-04-23T18:23:13.713237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716173+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:23:13.716173+0000","last_peered":"2024-04-23T18:23:13.716173+0000","last_clean":"2024-04-23T18:23:13.716173+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:23:13.716173+0000","last_undegraded":"2024-04-23T18:23:13.716173+0000","last_fullsized":"2024-04-23T18:23:13.716173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724257+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:23:13.724257+0000","last_peered":"2024-04-23T18:23:13.724257+0000","last_clean":"2024-04-23T18:23:13.724257+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:23:13.724257+0000","last_undegraded":"2024-04-23T18:23:13.724257+0000","last_fullsized":"2024-04-23T18:23:13.724257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712704+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:23:13.712704+0000","last_peered":"2024-04-23T18:23:13.712704+0000","last_clean":"2024-04-23T18:23:13.712704+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:23:13.712704+0000","last_undegraded":"2024-04-23T18:23:13.712704+0000","last_fullsized":"2024-04-23T18:23:13.712704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:37.396053+0000","last_change":"2024-04-23T18:23:14.399300+0000","last_active":"2024-04-23T18:22:36.376251+0000","last_peered":"2024-04-23T18:22:36.376251+0000","last_clean":"2024-04-23T18:22:36.376251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:37.396053+0000","last_undegraded":"2024-04-23T18:22:37.396053+0000","last_fullsized":"2024-04-23T18:22:37.396053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715884+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:23:13.715884+0000","last_peered":"2024-04-23T18:23:13.715884+0000","last_clean":"2024-04-23T18:23:13.715884+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:23:13.715884+0000","last_undegraded":"2024-04-23T18:23:13.715884+0000","last_fullsized":"2024-04-23T18:23:13.715884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708327+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:23:13.708327+0000","last_peered":"2024-04-23T18:23:13.708327+0000","last_clean":"2024-04-23T18:23:13.708327+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:23:13.708327+0000","last_undegraded":"2024-04-23T18:23:13.708327+0000","last_fullsized":"2024-04-23T18:23:13.708327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.720845+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:23:13.720845+0000","last_peered":"2024-04-23T18:23:13.720845+0000","last_clean":"2024-04-23T18:23:13.720845+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:23:13.720845+0000","last_undegraded":"2024-04-23T18:23:13.720845+0000","last_fullsized":"2024-04-23T18:23:13.720845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714022+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:23:13.714022+0000","last_peered":"2024-04-23T18:23:13.714022+0000","last_clean":"2024-04-23T18:23:13.714022+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:23:13.714022+0000","last_undegraded":"2024-04-23T18:23:13.714022+0000","last_fullsized":"2024-04-23T18:23:13.714022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714003+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:23:13.714003+0000","last_peered":"2024-04-23T18:23:13.714003+0000","last_clean":"2024-04-23T18:23:13.714003+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:23:13.714003+0000","last_undegraded":"2024-04-23T18:23:13.714003+0000","last_fullsized":"2024-04-23T18:23:13.714003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704014+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:23:13.704014+0000","last_peered":"2024-04-23T18:23:13.704014+0000","last_clean":"2024-04-23T18:23:13.704014+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:23:13.704014+0000","last_undegraded":"2024-04-23T18:23:13.704014+0000","last_fullsized":"2024-04-23T18:23:13.704014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713743+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:23:13.713743+0000","last_peered":"2024-04-23T18:23:13.713743+0000","last_clean":"2024-04-23T18:23:13.713743+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:23:13.713743+0000","last_undegraded":"2024-04-23T18:23:13.713743+0000","last_fullsized":"2024-04-23T18:23:13.713743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714758+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:23:13.714758+0000","last_peered":"2024-04-23T18:23:13.714758+0000","last_clean":"2024-04-23T18:23:13.714758+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:23:13.714758+0000","last_undegraded":"2024-04-23T18:23:13.714758+0000","last_fullsized":"2024-04-23T18:23:13.714758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704911+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:23:13.704911+0000","last_peered":"2024-04-23T18:23:13.704911+0000","last_clean":"2024-04-23T18:23:13.704911+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:23:13.704911+0000","last_undegraded":"2024-04-23T18:23:13.704911+0000","last_fullsized":"2024-04-23T18:23:13.704911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712345+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:23:13.712345+0000","last_peered":"2024-04-23T18:23:13.712345+0000","last_clean":"2024-04-23T18:23:13.712345+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:23:13.712345+0000","last_undegraded":"2024-04-23T18:23:13.712345+0000","last_fullsized":"2024-04-23T18:23:13.712345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707146+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:23:13.707146+0000","last_peered":"2024-04-23T18:23:13.707146+0000","last_clean":"2024-04-23T18:23:13.707146+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:23:13.707146+0000","last_undegraded":"2024-04-23T18:23:13.707146+0000","last_fullsized":"2024-04-23T18:23:13.707146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711003+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:23:13.711003+0000","last_peered":"2024-04-23T18:23:13.711003+0000","last_clean":"2024-04-23T18:23:13.711003+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:23:13.711003+0000","last_undegraded":"2024-04-23T18:23:13.711003+0000","last_fullsized":"2024-04-23T18:23:13.711003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714572+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:23:13.714572+0000","last_peered":"2024-04-23T18:23:13.714572+0000","last_clean":"2024-04-23T18:23:13.714572+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:23:13.714572+0000","last_undegraded":"2024-04-23T18:23:13.714572+0000","last_fullsized":"2024-04-23T18:23:13.714572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704115+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:23:13.704115+0000","last_peered":"2024-04-23T18:23:13.704115+0000","last_clean":"2024-04-23T18:23:13.704115+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:23:13.704115+0000","last_undegraded":"2024-04-23T18:23:13.704115+0000","last_fullsized":"2024-04-23T18:23:13.704115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704366+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:23:13.704366+0000","last_peered":"2024-04-23T18:23:13.704366+0000","last_clean":"2024-04-23T18:23:13.704366+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:23:13.704366+0000","last_undegraded":"2024-04-23T18:23:13.704366+0000","last_fullsized":"2024-04-23T18:23:13.704366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716051+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:23:13.716051+0000","last_peered":"2024-04-23T18:23:13.716051+0000","last_clean":"2024-04-23T18:23:13.716051+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:23:13.716051+0000","last_undegraded":"2024-04-23T18:23:13.716051+0000","last_fullsized":"2024-04-23T18:23:13.716051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713149+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:23:13.713149+0000","last_peered":"2024-04-23T18:23:13.713149+0000","last_clean":"2024-04-23T18:23:13.713149+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:23:13.713149+0000","last_undegraded":"2024-04-23T18:23:13.713149+0000","last_fullsized":"2024-04-23T18:23:13.713149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709902+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:23:13.709902+0000","last_peered":"2024-04-23T18:23:13.709902+0000","last_clean":"2024-04-23T18:23:13.709902+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:23:13.709902+0000","last_undegraded":"2024-04-23T18:23:13.709902+0000","last_fullsized":"2024-04-23T18:23:13.709902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705652+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:23:13.705652+0000","last_peered":"2024-04-23T18:23:13.705652+0000","last_clean":"2024-04-23T18:23:13.705652+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:23:13.705652+0000","last_undegraded":"2024-04-23T18:23:13.705652+0000","last_fullsized":"2024-04-23T18:23:13.705652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715614+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:23:13.715614+0000","last_peered":"2024-04-23T18:23:13.715614+0000","last_clean":"2024-04-23T18:23:13.715614+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:23:13.715614+0000","last_undegraded":"2024-04-23T18:23:13.715614+0000","last_fullsized":"2024-04-23T18:23:13.715614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704937+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:23:13.704937+0000","last_peered":"2024-04-23T18:23:13.704937+0000","last_clean":"2024-04-23T18:23:13.704937+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:23:13.704937+0000","last_undegraded":"2024-04-23T18:23:13.704937+0000","last_fullsized":"2024-04-23T18:23:13.704937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707678+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:23:13.707678+0000","last_peered":"2024-04-23T18:23:13.707678+0000","last_clean":"2024-04-23T18:23:13.707678+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:23:13.707678+0000","last_undegraded":"2024-04-23T18:23:13.707678+0000","last_fullsized":"2024-04-23T18:23:13.707678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709677+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:23:13.709677+0000","last_peered":"2024-04-23T18:23:13.709677+0000","last_clean":"2024-04-23T18:23:13.709677+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:23:13.709677+0000","last_undegraded":"2024-04-23T18:23:13.709677+0000","last_fullsized":"2024-04-23T18:23:13.709677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716889+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:23:13.716889+0000","last_peered":"2024-04-23T18:23:13.716889+0000","last_clean":"2024-04-23T18:23:13.716889+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:23:13.716889+0000","last_undegraded":"2024-04-23T18:23:13.716889+0000","last_fullsized":"2024-04-23T18:23:13.716889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713039+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:23:13.713039+0000","last_peered":"2024-04-23T18:23:13.713039+0000","last_clean":"2024-04-23T18:23:13.713039+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:23:13.713039+0000","last_undegraded":"2024-04-23T18:23:13.713039+0000","last_fullsized":"2024-04-23T18:23:13.713039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705260+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:23:13.705260+0000","last_peered":"2024-04-23T18:23:13.705260+0000","last_clean":"2024-04-23T18:23:13.705260+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:23:13.705260+0000","last_undegraded":"2024-04-23T18:23:13.705260+0000","last_fullsized":"2024-04-23T18:23:13.705260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708044+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:23:13.708044+0000","last_peered":"2024-04-23T18:23:13.708044+0000","last_clean":"2024-04-23T18:23:13.708044+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:23:13.708044+0000","last_undegraded":"2024-04-23T18:23:13.708044+0000","last_fullsized":"2024-04-23T18:23:13.708044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715561+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:23:13.715561+0000","last_peered":"2024-04-23T18:23:13.715561+0000","last_clean":"2024-04-23T18:23:13.715561+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:23:13.715561+0000","last_undegraded":"2024-04-23T18:23:13.715561+0000","last_fullsized":"2024-04-23T18:23:13.715561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705373+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:23:13.705373+0000","last_peered":"2024-04-23T18:23:13.705373+0000","last_clean":"2024-04-23T18:23:13.705373+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:23:13.705373+0000","last_undegraded":"2024-04-23T18:23:13.705373+0000","last_fullsized":"2024-04-23T18:23:13.705373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710750+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:23:13.710750+0000","last_peered":"2024-04-23T18:23:13.710750+0000","last_clean":"2024-04-23T18:23:13.710750+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:23:13.710750+0000","last_undegraded":"2024-04-23T18:23:13.710750+0000","last_fullsized":"2024-04-23T18:23:13.710750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704180+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:23:13.704180+0000","last_peered":"2024-04-23T18:23:13.704180+0000","last_clean":"2024-04-23T18:23:13.704180+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:23:13.704180+0000","last_undegraded":"2024-04-23T18:23:13.704180+0000","last_fullsized":"2024-04-23T18:23:13.704180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:38.519804+0000","last_change":"2024-04-23T18:23:14.398989+0000","last_active":"2024-04-23T18:23:14.398989+0000","last_peered":"2024-04-23T18:22:38.519804+0000","last_clean":"2024-04-23T18:22:38.519804+0000","last_became_active":"2024-04-23T18:22:33.396752+0000","last_became_peered":"2024-04-23T18:22:33.396752+0000","last_unstale":"2024-04-23T18:22:38.519804+0000","last_undegraded":"2024-04-23T18:22:38.519804+0000","last_fullsized":"2024-04-23T18:22:38.519804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712922+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:23:13.712922+0000","last_peered":"2024-04-23T18:23:13.712922+0000","last_clean":"2024-04-23T18:23:13.712922+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:23:13.712922+0000","last_undegraded":"2024-04-23T18:23:13.712922+0000","last_fullsized":"2024-04-23T18:23:13.712922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712299+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:23:13.712299+0000","last_peered":"2024-04-23T18:23:13.712299+0000","last_clean":"2024-04-23T18:23:13.712299+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:23:13.712299+0000","last_undegraded":"2024-04-23T18:23:13.712299+0000","last_fullsized":"2024-04-23T18:23:13.712299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724741+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:23:13.724741+0000","last_peered":"2024-04-23T18:23:13.724741+0000","last_clean":"2024-04-23T18:23:13.724741+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:23:13.724741+0000","last_undegraded":"2024-04-23T18:23:13.724741+0000","last_fullsized":"2024-04-23T18:23:13.724741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711311+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:23:13.711311+0000","last_peered":"2024-04-23T18:23:13.711311+0000","last_clean":"2024-04-23T18:23:13.711311+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:23:13.711311+0000","last_undegraded":"2024-04-23T18:23:13.711311+0000","last_fullsized":"2024-04-23T18:23:13.711311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716888+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:23:13.716888+0000","last_peered":"2024-04-23T18:23:13.716888+0000","last_clean":"2024-04-23T18:23:13.716888+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:23:13.716888+0000","last_undegraded":"2024-04-23T18:23:13.716888+0000","last_fullsized":"2024-04-23T18:23:13.716888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710505+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:23:13.710505+0000","last_peered":"2024-04-23T18:23:13.710505+0000","last_clean":"2024-04-23T18:23:13.710505+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:23:13.710505+0000","last_undegraded":"2024-04-23T18:23:13.710505+0000","last_fullsized":"2024-04-23T18:23:13.710505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707148+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:23:13.707148+0000","last_peered":"2024-04-23T18:23:13.707148+0000","last_clean":"2024-04-23T18:23:13.707148+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:23:13.707148+0000","last_undegraded":"2024-04-23T18:23:13.707148+0000","last_fullsized":"2024-04-23T18:23:13.707148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712966+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:23:13.712966+0000","last_peered":"2024-04-23T18:23:13.712966+0000","last_clean":"2024-04-23T18:23:13.712966+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:23:13.712966+0000","last_undegraded":"2024-04-23T18:23:13.712966+0000","last_fullsized":"2024-04-23T18:23:13.712966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704612+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:23:13.704612+0000","last_peered":"2024-04-23T18:23:13.704612+0000","last_clean":"2024-04-23T18:23:13.704612+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:23:13.704612+0000","last_undegraded":"2024-04-23T18:23:13.704612+0000","last_fullsized":"2024-04-23T18:23:13.704612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715731+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:23:13.715731+0000","last_peered":"2024-04-23T18:23:13.715731+0000","last_clean":"2024-04-23T18:23:13.715731+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:23:13.715731+0000","last_undegraded":"2024-04-23T18:23:13.715731+0000","last_fullsized":"2024-04-23T18:23:13.715731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713268+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:23:13.713268+0000","last_peered":"2024-04-23T18:23:13.713268+0000","last_clean":"2024-04-23T18:23:13.713268+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:23:13.713268+0000","last_undegraded":"2024-04-23T18:23:13.713268+0000","last_fullsized":"2024-04-23T18:23:13.713268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715336+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:23:13.715336+0000","last_peered":"2024-04-23T18:23:13.715336+0000","last_clean":"2024-04-23T18:23:13.715336+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:23:13.715336+0000","last_undegraded":"2024-04-23T18:23:13.715336+0000","last_fullsized":"2024-04-23T18:23:13.715336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.725146+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:23:13.725146+0000","last_peered":"2024-04-23T18:23:13.725146+0000","last_clean":"2024-04-23T18:23:13.725146+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:23:13.725146+0000","last_undegraded":"2024-04-23T18:23:13.725146+0000","last_fullsized":"2024-04-23T18:23:13.725146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"peering","last_fresh":"2024-04-23T18:22:38.511717+0000","last_change":"2024-04-23T18:23:13.704483+0000","last_active":"2024-04-23T18:23:13.704483+0000","last_peered":"2024-04-23T18:22:38.511717+0000","last_clean":"2024-04-23T18:22:38.511717+0000","last_became_active":"2024-04-23T18:22:33.397476+0000","last_became_peered":"2024-04-23T18:22:33.397476+0000","last_unstale":"2024-04-23T18:22:38.511717+0000","last_undegraded":"2024-04-23T18:22:38.511717+0000","last_fullsized":"2024-04-23T18:22:38.511717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723094+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:23:13.723094+0000","last_peered":"2024-04-23T18:23:13.723094+0000","last_clean":"2024-04-23T18:23:13.723094+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:23:13.723094+0000","last_undegraded":"2024-04-23T18:23:13.723094+0000","last_fullsized":"2024-04-23T18:23:13.723094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713507+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:23:13.713507+0000","last_peered":"2024-04-23T18:23:13.713507+0000","last_clean":"2024-04-23T18:23:13.713507+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:23:13.713507+0000","last_undegraded":"2024-04-23T18:23:13.713507+0000","last_fullsized":"2024-04-23T18:23:13.713507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722558+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:23:13.722558+0000","last_peered":"2024-04-23T18:23:13.722558+0000","last_clean":"2024-04-23T18:23:13.722558+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:23:13.722558+0000","last_undegraded":"2024-04-23T18:23:13.722558+0000","last_fullsized":"2024-04-23T18:23:13.722558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713966+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:23:13.713966+0000","last_peered":"2024-04-23T18:23:13.713966+0000","last_clean":"2024-04-23T18:23:13.713966+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:23:13.713966+0000","last_undegraded":"2024-04-23T18:23:13.713966+0000","last_fullsized":"2024-04-23T18:23:13.713966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713681+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:23:13.713681+0000","last_peered":"2024-04-23T18:23:13.713681+0000","last_clean":"2024-04-23T18:23:13.713681+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:23:13.713681+0000","last_undegraded":"2024-04-23T18:23:13.713681+0000","last_fullsized":"2024-04-23T18:23:13.713681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708751+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:23:13.708751+0000","last_peered":"2024-04-23T18:23:13.708751+0000","last_clean":"2024-04-23T18:23:13.708751+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:23:13.708751+0000","last_undegraded":"2024-04-23T18:23:13.708751+0000","last_fullsized":"2024-04-23T18:23:13.708751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724963+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:23:13.724963+0000","last_peered":"2024-04-23T18:23:13.724963+0000","last_clean":"2024-04-23T18:23:13.724963+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:23:13.724963+0000","last_undegraded":"2024-04-23T18:23:13.724963+0000","last_fullsized":"2024-04-23T18:23:13.724963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":699078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":108772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":101228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":111948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":286720,"data_stored":108212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":108338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":698422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:23:18.123 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:23:18.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.331+0000 7ff06f000640 1 Processor -- start 2024-04-23T18:23:18.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.331+0000 7ff06f000640 1 -- start start 2024-04-23T18:23:18.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06f000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0680ca970 0x7ff06806ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06f000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff0680ce6f0 0x7ff0680ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06f000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0680cf0c0 con 0x7ff068153000 2024-04-23T18:23:18.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06f000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7ff06806f6a0 con 0x7ff0680ce6f0 2024-04-23T18:23:18.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06f000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff0681533e0 con 0x7ff0680ca970 2024-04-23T18:23:18.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06dc00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff068153000 0x7ff0680cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:60886/0 (socket says 172.21.15.28:60886) 2024-04-23T18:23:18.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06dc00640 1 -- 172.21.15.28:0/867450277 learned_addr learned my addr 172.21.15.28:0/867450277 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:18.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06e600640 1 --2- 172.21.15.28:0/867450277 >> v2:172.21.15.28:3300/0 conn(0x7ff0680ce6f0 0x7ff0680ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06d200640 1 --2- 172.21.15.28:0/867450277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0680ca970 0x7ff06806ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff067e00640 1 -- 172.21.15.28:0/867450277 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567570317 0 0) 0x7ff0680cf0c0 con 0x7ff068153000 2024-04-23T18:23:18.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff067e00640 1 -- 172.21.15.28:0/867450277 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff050003530 con 0x7ff068153000 2024-04-23T18:23:18.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06e600640 1 -- 172.21.15.28:0/867450277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0680ca970 msgr2=0x7ff06806ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:18.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06e600640 1 --2- 172.21.15.28:0/867450277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0680ca970 0x7ff06806ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06e600640 1 -- 172.21.15.28:0/867450277 >> v1:172.21.15.28:6789/0 conn(0x7ff068153000 legacy=0x7ff0680cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.335+0000 7ff06e600640 1 -- 172.21.15.28:0/867450277 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff068158ea0 con 0x7ff0680ce6f0 2024-04-23T18:23:18.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff06e600640 1 --2- 172.21.15.28:0/867450277 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0680ce6f0 0x7ff0680ceb80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff060009d90 tx=0x7ff06001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1aac72c9f4c0b62 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:18.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff067e00640 1 -- 172.21.15.28:0/867450277 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0600b2070 con 0x7ff0680ce6f0 2024-04-23T18:23:18.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff067e00640 1 -- 172.21.15.28:0/867450277 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0600a5940 con 0x7ff0680ce6f0 2024-04-23T18:23:18.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff067e00640 1 -- 172.21.15.28:0/867450277 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0600a5cf0 con 0x7ff0680ce6f0 2024-04-23T18:23:18.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff06f000640 1 -- 172.21.15.28:0/867450277 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0680ce6f0 msgr2=0x7ff0680ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff06f000640 1 --2- 172.21.15.28:0/867450277 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0680ce6f0 0x7ff0680ceb80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff060009d90 tx=0x7ff06001c970 comp rx=0 tx=0).stop 2024-04-23T18:23:18.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff06f000640 1 -- 172.21.15.28:0/867450277 shutdown_connections 2024-04-23T18:23:18.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff06f000640 1 --2- 172.21.15.28:0/867450277 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0680ce6f0 0x7ff0680ceb80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff06f000640 1 --2- 172.21.15.28:0/867450277 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0680ca970 0x7ff06806ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff06f000640 1 -- 172.21.15.28:0/867450277 >> 172.21.15.28:0/867450277 conn(0x7ff0680676e0 msgr2=0x7ff068067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:18.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff06f000640 1 -- 172.21.15.28:0/867450277 shutdown_connections 2024-04-23T18:23:18.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.339+0000 7ff06f000640 1 -- 172.21.15.28:0/867450277 wait complete. 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06f000640 1 Processor -- start 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06f000640 1 -- start start 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06f000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0680ca970 0x7ff06814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06f000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0680ce6f0 0x7ff0681542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06f000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff068153000 0x7ff068155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06f000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680cb900 con 0x7ff068153000 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06f000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680cb780 con 0x7ff0680ce6f0 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06f000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff06806e610 con 0x7ff0680ca970 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06e600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff068153000 0x7ff068155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06e600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff068153000 0x7ff068155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56166/0 (socket says 172.21.15.28:56166) 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06e600640 1 -- 172.21.15.28:0/734522263 learned_addr learned my addr 172.21.15.28:0/734522263 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:18.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06dc00640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0680ca970 0x7ff06814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06d200640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0680ce6f0 0x7ff0681542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06e600640 1 -- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0680ca970 msgr2=0x7ff06814d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06e600640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0680ca970 0x7ff06814d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06e600640 1 -- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0680ce6f0 msgr2=0x7ff0681542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06e600640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0680ce6f0 0x7ff0681542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06e600640 1 -- 172.21.15.28:0/734522263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff068156090 con 0x7ff068153000 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06e600640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff068153000 0x7ff068155520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff060009d90 tx=0x7ff060019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff065600640 1 -- 172.21.15.28:0/734522263 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0600b2050 con 0x7ff068153000 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff065600640 1 -- 172.21.15.28:0/734522263 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0600be070 con 0x7ff068153000 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff06f000640 1 -- 172.21.15.28:0/734522263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff068156350 con 0x7ff068153000 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.343+0000 7ff065600640 1 -- 172.21.15.28:0/734522263 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0600ada70 con 0x7ff068153000 2024-04-23T18:23:18.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.347+0000 7ff06f000640 1 -- 172.21.15.28:0/734522263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff068153aa0 con 0x7ff068153000 2024-04-23T18:23:18.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.347+0000 7ff06f000640 1 -- 172.21.15.28:0/734522263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff068068cd0 con 0x7ff068153000 2024-04-23T18:23:18.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.347+0000 7ff065600640 1 -- 172.21.15.28:0/734522263 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff0600a57c0 con 0x7ff068153000 2024-04-23T18:23:18.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.347+0000 7ff065600640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff048068380 0x7ff04806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.347+0000 7ff065600640 1 -- 172.21.15.28:0/734522263 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff060121e80 con 0x7ff068153000 2024-04-23T18:23:18.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.347+0000 7ff06dc00640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff048068380 0x7ff04806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.351+0000 7ff06dc00640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff048068380 0x7ff04806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff05c005890 tx=0x7ff05c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:18.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.351+0000 7ff065600640 1 -- 172.21.15.28:0/734522263 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff060016560 con 0x7ff068153000 2024-04-23T18:23:18.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.519+0000 7ff06f000640 1 -- 172.21.15.28:0/734522263 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff0681535f0 con 0x7ff048068380 2024-04-23T18:23:18.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.543+0000 7ff065600640 1 -- 172.21.15.28:0/734522263 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332258 (secure 0 0 0) 0x7ff0681535f0 con 0x7ff048068380 2024-04-23T18:23:18.540 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:18.542 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:23:18.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 -- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff048068380 msgr2=0x7ff04806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff048068380 0x7ff04806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff05c005890 tx=0x7ff05c009040 comp rx=0 tx=0).stop 2024-04-23T18:23:18.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 -- 172.21.15.28:0/734522263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff068153000 msgr2=0x7ff068155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff068153000 0x7ff068155520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff060009d90 tx=0x7ff060019710 comp rx=0 tx=0).stop 2024-04-23T18:23:18.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 -- 172.21.15.28:0/734522263 shutdown_connections 2024-04-23T18:23:18.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff048068380 0x7ff04806a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff068153000 0x7ff068155520 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0680ce6f0 0x7ff0681542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 --2- 172.21.15.28:0/734522263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff0680ca970 0x7ff06814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 -- 172.21.15.28:0/734522263 >> 172.21.15.28:0/734522263 conn(0x7ff0680676e0 msgr2=0x7ff068150830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:18.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 -- 172.21.15.28:0/734522263 shutdown_connections 2024-04-23T18:23:18.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.547+0000 7ff06f000640 1 -- 172.21.15.28:0/734522263 wait complete. 2024-04-23T18:23:18.560 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-04-23T18:23:17.336099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232024,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742696,"statfs":{"total":773094113280,"available":772856520704,"internally_reserved":0,"allocated":3469312,"data_stored":2048170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1664,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002955"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714103+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:23:13.714103+0000","last_peered":"2024-04-23T18:23:13.714103+0000","last_clean":"2024-04-23T18:23:13.714103+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:23:13.714103+0000","last_undegraded":"2024-04-23T18:23:13.714103+0000","last_fullsized":"2024-04-23T18:23:13.714103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:38.512479+0000","last_change":"2024-04-23T18:23:14.399010+0000","last_active":"2024-04-23T18:23:14.399010+0000","last_peered":"2024-04-23T18:22:38.512479+0000","last_clean":"2024-04-23T18:22:38.512479+0000","last_became_active":"2024-04-23T18:22:33.374636+0000","last_became_peered":"2024-04-23T18:22:33.374636+0000","last_unstale":"2024-04-23T18:22:38.512479+0000","last_undegraded":"2024-04-23T18:22:38.512479+0000","last_fullsized":"2024-04-23T18:22:38.512479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.703975+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:23:13.703975+0000","last_peered":"2024-04-23T18:23:13.703975+0000","last_clean":"2024-04-23T18:23:13.703975+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:23:13.703975+0000","last_undegraded":"2024-04-23T18:23:13.703975+0000","last_fullsized":"2024-04-23T18:23:13.703975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705142+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:23:13.705142+0000","last_peered":"2024-04-23T18:23:13.705142+0000","last_clean":"2024-04-23T18:23:13.705142+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:23:13.705142+0000","last_undegraded":"2024-04-23T18:23:13.705142+0000","last_fullsized":"2024-04-23T18:23:13.705142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713925+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:23:13.713925+0000","last_peered":"2024-04-23T18:23:13.713925+0000","last_clean":"2024-04-23T18:23:13.713925+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:23:13.713925+0000","last_undegraded":"2024-04-23T18:23:13.713925+0000","last_fullsized":"2024-04-23T18:23:13.713925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711813+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:23:13.711813+0000","last_peered":"2024-04-23T18:23:13.711813+0000","last_clean":"2024-04-23T18:23:13.711813+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:23:13.711813+0000","last_undegraded":"2024-04-23T18:23:13.711813+0000","last_fullsized":"2024-04-23T18:23:13.711813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724579+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:23:13.724579+0000","last_peered":"2024-04-23T18:23:13.724579+0000","last_clean":"2024-04-23T18:23:13.724579+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:23:13.724579+0000","last_undegraded":"2024-04-23T18:23:13.724579+0000","last_fullsized":"2024-04-23T18:23:13.724579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714242+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:23:13.714242+0000","last_peered":"2024-04-23T18:23:13.714242+0000","last_clean":"2024-04-23T18:23:13.714242+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:23:13.714242+0000","last_undegraded":"2024-04-23T18:23:13.714242+0000","last_fullsized":"2024-04-23T18:23:13.714242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.720246+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:23:13.720246+0000","last_peered":"2024-04-23T18:23:13.720246+0000","last_clean":"2024-04-23T18:23:13.720246+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:23:13.720246+0000","last_undegraded":"2024-04-23T18:23:13.720246+0000","last_fullsized":"2024-04-23T18:23:13.720246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724028+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:23:13.724028+0000","last_peered":"2024-04-23T18:23:13.724028+0000","last_clean":"2024-04-23T18:23:13.724028+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:23:13.724028+0000","last_undegraded":"2024-04-23T18:23:13.724028+0000","last_fullsized":"2024-04-23T18:23:13.724028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716404+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:23:13.716404+0000","last_peered":"2024-04-23T18:23:13.716404+0000","last_clean":"2024-04-23T18:23:13.716404+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:23:13.716404+0000","last_undegraded":"2024-04-23T18:23:13.716404+0000","last_fullsized":"2024-04-23T18:23:13.716404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715137+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:23:13.715137+0000","last_peered":"2024-04-23T18:23:13.715137+0000","last_clean":"2024-04-23T18:23:13.715137+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:23:13.715137+0000","last_undegraded":"2024-04-23T18:23:13.715137+0000","last_fullsized":"2024-04-23T18:23:13.715137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708248+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:23:13.708248+0000","last_peered":"2024-04-23T18:23:13.708248+0000","last_clean":"2024-04-23T18:23:13.708248+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:23:13.708248+0000","last_undegraded":"2024-04-23T18:23:13.708248+0000","last_fullsized":"2024-04-23T18:23:13.708248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723698+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:23:13.723698+0000","last_peered":"2024-04-23T18:23:13.723698+0000","last_clean":"2024-04-23T18:23:13.723698+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:23:13.723698+0000","last_undegraded":"2024-04-23T18:23:13.723698+0000","last_fullsized":"2024-04-23T18:23:13.723698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717018+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:23:13.717018+0000","last_peered":"2024-04-23T18:23:13.717018+0000","last_clean":"2024-04-23T18:23:13.717018+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:23:13.717018+0000","last_undegraded":"2024-04-23T18:23:13.717018+0000","last_fullsized":"2024-04-23T18:23:13.717018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704708+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:23:13.704708+0000","last_peered":"2024-04-23T18:23:13.704708+0000","last_clean":"2024-04-23T18:23:13.704708+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:23:13.704708+0000","last_undegraded":"2024-04-23T18:23:13.704708+0000","last_fullsized":"2024-04-23T18:23:13.704708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707492+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:23:13.707492+0000","last_peered":"2024-04-23T18:23:13.707492+0000","last_clean":"2024-04-23T18:23:13.707492+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:23:13.707492+0000","last_undegraded":"2024-04-23T18:23:13.707492+0000","last_fullsized":"2024-04-23T18:23:13.707492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715538+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:23:13.715538+0000","last_peered":"2024-04-23T18:23:13.715538+0000","last_clean":"2024-04-23T18:23:13.715538+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:23:13.715538+0000","last_undegraded":"2024-04-23T18:23:13.715538+0000","last_fullsized":"2024-04-23T18:23:13.715538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704209+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:23:13.704209+0000","last_peered":"2024-04-23T18:23:13.704209+0000","last_clean":"2024-04-23T18:23:13.704209+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:23:13.704209+0000","last_undegraded":"2024-04-23T18:23:13.704209+0000","last_fullsized":"2024-04-23T18:23:13.704209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707276+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:23:13.707276+0000","last_peered":"2024-04-23T18:23:13.707276+0000","last_clean":"2024-04-23T18:23:13.707276+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:23:13.707276+0000","last_undegraded":"2024-04-23T18:23:13.707276+0000","last_fullsized":"2024-04-23T18:23:13.707276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709100+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:23:13.709100+0000","last_peered":"2024-04-23T18:23:13.709100+0000","last_clean":"2024-04-23T18:23:13.709100+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:23:13.709100+0000","last_undegraded":"2024-04-23T18:23:13.709100+0000","last_fullsized":"2024-04-23T18:23:13.709100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715948+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:23:13.715948+0000","last_peered":"2024-04-23T18:23:13.715948+0000","last_clean":"2024-04-23T18:23:13.715948+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:23:13.715948+0000","last_undegraded":"2024-04-23T18:23:13.715948+0000","last_fullsized":"2024-04-23T18:23:13.715948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722449+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:23:13.722449+0000","last_peered":"2024-04-23T18:23:13.722449+0000","last_clean":"2024-04-23T18:23:13.722449+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:23:13.722449+0000","last_undegraded":"2024-04-23T18:23:13.722449+0000","last_fullsized":"2024-04-23T18:23:13.722449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717671+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:23:13.717671+0000","last_peered":"2024-04-23T18:23:13.717671+0000","last_clean":"2024-04-23T18:23:13.717671+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:23:13.717671+0000","last_undegraded":"2024-04-23T18:23:13.717671+0000","last_fullsized":"2024-04-23T18:23:13.717671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713208+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:23:13.713208+0000","last_peered":"2024-04-23T18:23:13.713208+0000","last_clean":"2024-04-23T18:23:13.713208+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:23:13.713208+0000","last_undegraded":"2024-04-23T18:23:13.713208+0000","last_fullsized":"2024-04-23T18:23:13.713208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715074+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:23:13.715074+0000","last_peered":"2024-04-23T18:23:13.715074+0000","last_clean":"2024-04-23T18:23:13.715074+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:23:13.715074+0000","last_undegraded":"2024-04-23T18:23:13.715074+0000","last_fullsized":"2024-04-23T18:23:13.715074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715116+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:23:13.715116+0000","last_peered":"2024-04-23T18:23:13.715116+0000","last_clean":"2024-04-23T18:23:13.715116+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:23:13.715116+0000","last_undegraded":"2024-04-23T18:23:13.715116+0000","last_fullsized":"2024-04-23T18:23:13.715116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705498+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:23:13.705498+0000","last_peered":"2024-04-23T18:23:13.705498+0000","last_clean":"2024-04-23T18:23:13.705498+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:23:13.705498+0000","last_undegraded":"2024-04-23T18:23:13.705498+0000","last_fullsized":"2024-04-23T18:23:13.705498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708857+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:23:13.708857+0000","last_peered":"2024-04-23T18:23:13.708857+0000","last_clean":"2024-04-23T18:23:13.708857+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:23:13.708857+0000","last_undegraded":"2024-04-23T18:23:13.708857+0000","last_fullsized":"2024-04-23T18:23:13.708857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.703875+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:23:13.703875+0000","last_peered":"2024-04-23T18:23:13.703875+0000","last_clean":"2024-04-23T18:23:13.703875+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:23:13.703875+0000","last_undegraded":"2024-04-23T18:23:13.703875+0000","last_fullsized":"2024-04-23T18:23:13.703875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707790+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:23:13.707790+0000","last_peered":"2024-04-23T18:23:13.707790+0000","last_clean":"2024-04-23T18:23:13.707790+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:23:13.707790+0000","last_undegraded":"2024-04-23T18:23:13.707790+0000","last_fullsized":"2024-04-23T18:23:13.707790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724832+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:23:13.724832+0000","last_peered":"2024-04-23T18:23:13.724832+0000","last_clean":"2024-04-23T18:23:13.724832+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:23:13.724832+0000","last_undegraded":"2024-04-23T18:23:13.724832+0000","last_fullsized":"2024-04-23T18:23:13.724832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713574+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:23:13.713574+0000","last_peered":"2024-04-23T18:23:13.713574+0000","last_clean":"2024-04-23T18:23:13.713574+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:23:13.713574+0000","last_undegraded":"2024-04-23T18:23:13.713574+0000","last_fullsized":"2024-04-23T18:23:13.713574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716655+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:23:13.716655+0000","last_peered":"2024-04-23T18:23:13.716655+0000","last_clean":"2024-04-23T18:23:13.716655+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:23:13.716655+0000","last_undegraded":"2024-04-23T18:23:13.716655+0000","last_fullsized":"2024-04-23T18:23:13.716655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707875+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:23:13.707875+0000","last_peered":"2024-04-23T18:23:13.707875+0000","last_clean":"2024-04-23T18:23:13.707875+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:23:13.707875+0000","last_undegraded":"2024-04-23T18:23:13.707875+0000","last_fullsized":"2024-04-23T18:23:13.707875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707060+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:23:13.707060+0000","last_peered":"2024-04-23T18:23:13.707060+0000","last_clean":"2024-04-23T18:23:13.707060+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:23:13.707060+0000","last_undegraded":"2024-04-23T18:23:13.707060+0000","last_fullsized":"2024-04-23T18:23:13.707060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.721077+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:23:13.721077+0000","last_peered":"2024-04-23T18:23:13.721077+0000","last_clean":"2024-04-23T18:23:13.721077+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:23:13.721077+0000","last_undegraded":"2024-04-23T18:23:13.721077+0000","last_fullsized":"2024-04-23T18:23:13.721077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717386+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:23:13.717386+0000","last_peered":"2024-04-23T18:23:13.717386+0000","last_clean":"2024-04-23T18:23:13.717386+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:23:13.717386+0000","last_undegraded":"2024-04-23T18:23:13.717386+0000","last_fullsized":"2024-04-23T18:23:13.717386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707660+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:23:13.707660+0000","last_peered":"2024-04-23T18:23:13.707660+0000","last_clean":"2024-04-23T18:23:13.707660+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:23:13.707660+0000","last_undegraded":"2024-04-23T18:23:13.707660+0000","last_fullsized":"2024-04-23T18:23:13.707660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707152+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:23:13.707152+0000","last_peered":"2024-04-23T18:23:13.707152+0000","last_clean":"2024-04-23T18:23:13.707152+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:23:13.707152+0000","last_undegraded":"2024-04-23T18:23:13.707152+0000","last_fullsized":"2024-04-23T18:23:13.707152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709779+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:23:13.709779+0000","last_peered":"2024-04-23T18:23:13.709779+0000","last_clean":"2024-04-23T18:23:13.709779+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:23:13.709779+0000","last_undegraded":"2024-04-23T18:23:13.709779+0000","last_fullsized":"2024-04-23T18:23:13.709779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:37.402011+0000","last_change":"2024-04-23T18:23:14.399026+0000","last_active":"2024-04-23T18:22:36.376251+0000","last_peered":"2024-04-23T18:22:36.376251+0000","last_clean":"2024-04-23T18:22:36.376251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:37.402011+0000","last_undegraded":"2024-04-23T18:22:37.402011+0000","last_fullsized":"2024-04-23T18:22:37.402011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712220+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:23:13.712220+0000","last_peered":"2024-04-23T18:23:13.712220+0000","last_clean":"2024-04-23T18:23:13.712220+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:23:13.712220+0000","last_undegraded":"2024-04-23T18:23:13.712220+0000","last_fullsized":"2024-04-23T18:23:13.712220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722563+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:23:13.722563+0000","last_peered":"2024-04-23T18:23:13.722563+0000","last_clean":"2024-04-23T18:23:13.722563+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:23:13.722563+0000","last_undegraded":"2024-04-23T18:23:13.722563+0000","last_fullsized":"2024-04-23T18:23:13.722563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713085+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:23:13.713085+0000","last_peered":"2024-04-23T18:23:13.713085+0000","last_clean":"2024-04-23T18:23:13.713085+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:23:13.713085+0000","last_undegraded":"2024-04-23T18:23:13.713085+0000","last_fullsized":"2024-04-23T18:23:13.713085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704661+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:23:13.704661+0000","last_peered":"2024-04-23T18:23:13.704661+0000","last_clean":"2024-04-23T18:23:13.704661+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:23:13.704661+0000","last_undegraded":"2024-04-23T18:23:13.704661+0000","last_fullsized":"2024-04-23T18:23:13.704661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714295+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:23:13.714295+0000","last_peered":"2024-04-23T18:23:13.714295+0000","last_clean":"2024-04-23T18:23:13.714295+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:23:13.714295+0000","last_undegraded":"2024-04-23T18:23:13.714295+0000","last_fullsized":"2024-04-23T18:23:13.714295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722744+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:23:13.722744+0000","last_peered":"2024-04-23T18:23:13.722744+0000","last_clean":"2024-04-23T18:23:13.722744+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:23:13.722744+0000","last_undegraded":"2024-04-23T18:23:13.722744+0000","last_fullsized":"2024-04-23T18:23:13.722744+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712815+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:23:13.712815+0000","last_peered":"2024-04-23T18:23:13.712815+0000","last_clean":"2024-04-23T18:23:13.712815+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:23:13.712815+0000","last_undegraded":"2024-04-23T18:23:13.712815+0000","last_fullsized":"2024-04-23T18:23:13.712815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724334+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:23:13.724334+0000","last_peered":"2024-04-23T18:23:13.724334+0000","last_clean":"2024-04-23T18:23:13.724334+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:23:13.724334+0000","last_undegraded":"2024-04-23T18:23:13.724334+0000","last_fullsized":"2024-04-23T18:23:13.724334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710819+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:23:13.710819+0000","last_peered":"2024-04-23T18:23:13.710819+0000","last_clean":"2024-04-23T18:23:13.710819+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:23:13.710819+0000","last_undegraded":"2024-04-23T18:23:13.710819+0000","last_fullsized":"2024-04-23T18:23:13.710819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707782+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:23:13.707782+0000","last_peered":"2024-04-23T18:23:13.707782+0000","last_clean":"2024-04-23T18:23:13.707782+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:23:13.707782+0000","last_undegraded":"2024-04-23T18:23:13.707782+0000","last_fullsized":"2024-04-23T18:23:13.707782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716205+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:23:13.716205+0000","last_peered":"2024-04-23T18:23:13.716205+0000","last_clean":"2024-04-23T18:23:13.716205+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:23:13.716205+0000","last_undegraded":"2024-04-23T18:23:13.716205+0000","last_fullsized":"2024-04-23T18:23:13.716205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708424+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:23:13.708424+0000","last_peered":"2024-04-23T18:23:13.708424+0000","last_clean":"2024-04-23T18:23:13.708424+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:23:13.708424+0000","last_undegraded":"2024-04-23T18:23:13.708424+0000","last_fullsized":"2024-04-23T18:23:13.708424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"peering","last_fresh":"2024-04-23T18:22:39.394570+0000","last_change":"2024-04-23T18:23:13.712613+0000","last_active":"2024-04-23T18:23:13.712613+0000","last_peered":"2024-04-23T18:22:39.394570+0000","last_clean":"2024-04-23T18:22:39.394570+0000","last_became_active":"2024-04-23T18:22:37.421745+0000","last_became_peered":"2024-04-23T18:22:37.421745+0000","last_unstale":"2024-04-23T18:22:39.394570+0000","last_undegraded":"2024-04-23T18:22:39.394570+0000","last_fullsized":"2024-04-23T18:22:39.394570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,4,5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.725226+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:23:13.725226+0000","last_peered":"2024-04-23T18:23:13.725226+0000","last_clean":"2024-04-23T18:23:13.725226+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:23:13.725226+0000","last_undegraded":"2024-04-23T18:23:13.725226+0000","last_fullsized":"2024-04-23T18:23:13.725226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711073+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:23:13.711073+0000","last_peered":"2024-04-23T18:23:13.711073+0000","last_clean":"2024-04-23T18:23:13.711073+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:23:13.711073+0000","last_undegraded":"2024-04-23T18:23:13.711073+0000","last_fullsized":"2024-04-23T18:23:13.711073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710196+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:23:13.710196+0000","last_peered":"2024-04-23T18:23:13.710196+0000","last_clean":"2024-04-23T18:23:13.710196+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:23:13.710196+0000","last_undegraded":"2024-04-23T18:23:13.710196+0000","last_fullsized":"2024-04-23T18:23:13.710196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724766+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:23:13.724766+0000","last_peered":"2024-04-23T18:23:13.724766+0000","last_clean":"2024-04-23T18:23:13.724766+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:23:13.724766+0000","last_undegraded":"2024-04-23T18:23:13.724766+0000","last_fullsized":"2024-04-23T18:23:13.724766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.718445+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:23:13.718445+0000","last_peered":"2024-04-23T18:23:13.718445+0000","last_clean":"2024-04-23T18:23:13.718445+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:23:13.718445+0000","last_undegraded":"2024-04-23T18:23:13.718445+0000","last_fullsized":"2024-04-23T18:23:13.718445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711927+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:23:13.711927+0000","last_peered":"2024-04-23T18:23:13.711927+0000","last_clean":"2024-04-23T18:23:13.711927+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:23:13.711927+0000","last_undegraded":"2024-04-23T18:23:13.711927+0000","last_fullsized":"2024-04-23T18:23:13.711927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:33.374695+0000","last_change":"2024-04-23T18:23:14.398956+0000","last_active":"2024-04-23T18:22:32.337166+0000","last_peered":"2024-04-23T18:22:32.337166+0000","last_clean":"2024-04-23T18:22:32.337166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:33.374695+0000","last_undegraded":"2024-04-23T18:22:33.374695+0000","last_fullsized":"2024-04-23T18:22:33.374695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'15","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709549+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:23:13.709549+0000","last_peered":"2024-04-23T18:23:13.709549+0000","last_clean":"2024-04-23T18:23:13.709549+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:23:13.709549+0000","last_undegraded":"2024-04-23T18:23:13.709549+0000","last_fullsized":"2024-04-23T18:23:13.709549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712978+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:23:13.712978+0000","last_peered":"2024-04-23T18:23:13.712978+0000","last_clean":"2024-04-23T18:23:13.712978+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:23:13.712978+0000","last_undegraded":"2024-04-23T18:23:13.712978+0000","last_fullsized":"2024-04-23T18:23:13.712978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707934+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:23:13.707934+0000","last_peered":"2024-04-23T18:23:13.707934+0000","last_clean":"2024-04-23T18:23:13.707934+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:23:13.707934+0000","last_undegraded":"2024-04-23T18:23:13.707934+0000","last_fullsized":"2024-04-23T18:23:13.707934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708251+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:23:13.708251+0000","last_peered":"2024-04-23T18:23:13.708251+0000","last_clean":"2024-04-23T18:23:13.708251+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:23:13.708251+0000","last_undegraded":"2024-04-23T18:23:13.708251+0000","last_fullsized":"2024-04-23T18:23:13.708251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704942+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:23:13.704942+0000","last_peered":"2024-04-23T18:23:13.704942+0000","last_clean":"2024-04-23T18:23:13.704942+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:23:13.704942+0000","last_undegraded":"2024-04-23T18:23:13.704942+0000","last_fullsized":"2024-04-23T18:23:13.704942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723425+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:23:13.723425+0000","last_peered":"2024-04-23T18:23:13.723425+0000","last_clean":"2024-04-23T18:23:13.723425+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:23:13.723425+0000","last_undegraded":"2024-04-23T18:23:13.723425+0000","last_fullsized":"2024-04-23T18:23:13.723425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717077+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:23:13.717077+0000","last_peered":"2024-04-23T18:23:13.717077+0000","last_clean":"2024-04-23T18:23:13.717077+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:23:13.717077+0000","last_undegraded":"2024-04-23T18:23:13.717077+0000","last_fullsized":"2024-04-23T18:23:13.717077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705662+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:23:13.705662+0000","last_peered":"2024-04-23T18:23:13.705662+0000","last_clean":"2024-04-23T18:23:13.705662+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:23:13.705662+0000","last_undegraded":"2024-04-23T18:23:13.705662+0000","last_fullsized":"2024-04-23T18:23:13.705662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713070+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:23:13.713070+0000","last_peered":"2024-04-23T18:23:13.713070+0000","last_clean":"2024-04-23T18:23:13.713070+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:23:13.713070+0000","last_undegraded":"2024-04-23T18:23:13.713070+0000","last_fullsized":"2024-04-23T18:23:13.713070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'6","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713237+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:23:13.713237+0000","last_peered":"2024-04-23T18:23:13.713237+0000","last_clean":"2024-04-23T18:23:13.713237+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:23:13.713237+0000","last_undegraded":"2024-04-23T18:23:13.713237+0000","last_fullsized":"2024-04-23T18:23:13.713237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716173+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:23:13.716173+0000","last_peered":"2024-04-23T18:23:13.716173+0000","last_clean":"2024-04-23T18:23:13.716173+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:23:13.716173+0000","last_undegraded":"2024-04-23T18:23:13.716173+0000","last_fullsized":"2024-04-23T18:23:13.716173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724257+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:23:13.724257+0000","last_peered":"2024-04-23T18:23:13.724257+0000","last_clean":"2024-04-23T18:23:13.724257+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:23:13.724257+0000","last_undegraded":"2024-04-23T18:23:13.724257+0000","last_fullsized":"2024-04-23T18:23:13.724257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712704+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:23:13.712704+0000","last_peered":"2024-04-23T18:23:13.712704+0000","last_clean":"2024-04-23T18:23:13.712704+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:23:13.712704+0000","last_undegraded":"2024-04-23T18:23:13.712704+0000","last_fullsized":"2024-04-23T18:23:13.712704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:37.396053+0000","last_change":"2024-04-23T18:23:14.399300+0000","last_active":"2024-04-23T18:22:36.376251+0000","last_peered":"2024-04-23T18:22:36.376251+0000","last_clean":"2024-04-23T18:22:36.376251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:37.396053+0000","last_undegraded":"2024-04-23T18:22:37.396053+0000","last_fullsized":"2024-04-23T18:22:37.396053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715884+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:23:13.715884+0000","last_peered":"2024-04-23T18:23:13.715884+0000","last_clean":"2024-04-23T18:23:13.715884+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:23:13.715884+0000","last_undegraded":"2024-04-23T18:23:13.715884+0000","last_fullsized":"2024-04-23T18:23:13.715884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708327+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:23:13.708327+0000","last_peered":"2024-04-23T18:23:13.708327+0000","last_clean":"2024-04-23T18:23:13.708327+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:23:13.708327+0000","last_undegraded":"2024-04-23T18:23:13.708327+0000","last_fullsized":"2024-04-23T18:23:13.708327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.720845+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:23:13.720845+0000","last_peered":"2024-04-23T18:23:13.720845+0000","last_clean":"2024-04-23T18:23:13.720845+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:23:13.720845+0000","last_undegraded":"2024-04-23T18:23:13.720845+0000","last_fullsized":"2024-04-23T18:23:13.720845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714022+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:23:13.714022+0000","last_peered":"2024-04-23T18:23:13.714022+0000","last_clean":"2024-04-23T18:23:13.714022+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:23:13.714022+0000","last_undegraded":"2024-04-23T18:23:13.714022+0000","last_fullsized":"2024-04-23T18:23:13.714022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714003+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:23:13.714003+0000","last_peered":"2024-04-23T18:23:13.714003+0000","last_clean":"2024-04-23T18:23:13.714003+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:23:13.714003+0000","last_undegraded":"2024-04-23T18:23:13.714003+0000","last_fullsized":"2024-04-23T18:23:13.714003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704014+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:23:13.704014+0000","last_peered":"2024-04-23T18:23:13.704014+0000","last_clean":"2024-04-23T18:23:13.704014+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:23:13.704014+0000","last_undegraded":"2024-04-23T18:23:13.704014+0000","last_fullsized":"2024-04-23T18:23:13.704014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713743+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:23:13.713743+0000","last_peered":"2024-04-23T18:23:13.713743+0000","last_clean":"2024-04-23T18:23:13.713743+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:23:13.713743+0000","last_undegraded":"2024-04-23T18:23:13.713743+0000","last_fullsized":"2024-04-23T18:23:13.713743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714758+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:23:13.714758+0000","last_peered":"2024-04-23T18:23:13.714758+0000","last_clean":"2024-04-23T18:23:13.714758+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:23:13.714758+0000","last_undegraded":"2024-04-23T18:23:13.714758+0000","last_fullsized":"2024-04-23T18:23:13.714758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704911+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:23:13.704911+0000","last_peered":"2024-04-23T18:23:13.704911+0000","last_clean":"2024-04-23T18:23:13.704911+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:23:13.704911+0000","last_undegraded":"2024-04-23T18:23:13.704911+0000","last_fullsized":"2024-04-23T18:23:13.704911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712345+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:23:13.712345+0000","last_peered":"2024-04-23T18:23:13.712345+0000","last_clean":"2024-04-23T18:23:13.712345+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:23:13.712345+0000","last_undegraded":"2024-04-23T18:23:13.712345+0000","last_fullsized":"2024-04-23T18:23:13.712345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707146+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:23:13.707146+0000","last_peered":"2024-04-23T18:23:13.707146+0000","last_clean":"2024-04-23T18:23:13.707146+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:23:13.707146+0000","last_undegraded":"2024-04-23T18:23:13.707146+0000","last_fullsized":"2024-04-23T18:23:13.707146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711003+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:23:13.711003+0000","last_peered":"2024-04-23T18:23:13.711003+0000","last_clean":"2024-04-23T18:23:13.711003+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:23:13.711003+0000","last_undegraded":"2024-04-23T18:23:13.711003+0000","last_fullsized":"2024-04-23T18:23:13.711003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714572+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:23:13.714572+0000","last_peered":"2024-04-23T18:23:13.714572+0000","last_clean":"2024-04-23T18:23:13.714572+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:23:13.714572+0000","last_undegraded":"2024-04-23T18:23:13.714572+0000","last_fullsized":"2024-04-23T18:23:13.714572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704115+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:23:13.704115+0000","last_peered":"2024-04-23T18:23:13.704115+0000","last_clean":"2024-04-23T18:23:13.704115+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:23:13.704115+0000","last_undegraded":"2024-04-23T18:23:13.704115+0000","last_fullsized":"2024-04-23T18:23:13.704115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704366+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:23:13.704366+0000","last_peered":"2024-04-23T18:23:13.704366+0000","last_clean":"2024-04-23T18:23:13.704366+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:23:13.704366+0000","last_undegraded":"2024-04-23T18:23:13.704366+0000","last_fullsized":"2024-04-23T18:23:13.704366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716051+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:23:13.716051+0000","last_peered":"2024-04-23T18:23:13.716051+0000","last_clean":"2024-04-23T18:23:13.716051+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:23:13.716051+0000","last_undegraded":"2024-04-23T18:23:13.716051+0000","last_fullsized":"2024-04-23T18:23:13.716051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713149+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:23:13.713149+0000","last_peered":"2024-04-23T18:23:13.713149+0000","last_clean":"2024-04-23T18:23:13.713149+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:23:13.713149+0000","last_undegraded":"2024-04-23T18:23:13.713149+0000","last_fullsized":"2024-04-23T18:23:13.713149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709902+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:23:13.709902+0000","last_peered":"2024-04-23T18:23:13.709902+0000","last_clean":"2024-04-23T18:23:13.709902+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:23:13.709902+0000","last_undegraded":"2024-04-23T18:23:13.709902+0000","last_fullsized":"2024-04-23T18:23:13.709902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705652+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:23:13.705652+0000","last_peered":"2024-04-23T18:23:13.705652+0000","last_clean":"2024-04-23T18:23:13.705652+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:23:13.705652+0000","last_undegraded":"2024-04-23T18:23:13.705652+0000","last_fullsized":"2024-04-23T18:23:13.705652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715614+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:23:13.715614+0000","last_peered":"2024-04-23T18:23:13.715614+0000","last_clean":"2024-04-23T18:23:13.715614+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:23:13.715614+0000","last_undegraded":"2024-04-23T18:23:13.715614+0000","last_fullsized":"2024-04-23T18:23:13.715614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704937+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:23:13.704937+0000","last_peered":"2024-04-23T18:23:13.704937+0000","last_clean":"2024-04-23T18:23:13.704937+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:23:13.704937+0000","last_undegraded":"2024-04-23T18:23:13.704937+0000","last_fullsized":"2024-04-23T18:23:13.704937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707678+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:23:13.707678+0000","last_peered":"2024-04-23T18:23:13.707678+0000","last_clean":"2024-04-23T18:23:13.707678+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:23:13.707678+0000","last_undegraded":"2024-04-23T18:23:13.707678+0000","last_fullsized":"2024-04-23T18:23:13.707678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709677+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:23:13.709677+0000","last_peered":"2024-04-23T18:23:13.709677+0000","last_clean":"2024-04-23T18:23:13.709677+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:23:13.709677+0000","last_undegraded":"2024-04-23T18:23:13.709677+0000","last_fullsized":"2024-04-23T18:23:13.709677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716889+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:23:13.716889+0000","last_peered":"2024-04-23T18:23:13.716889+0000","last_clean":"2024-04-23T18:23:13.716889+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:23:13.716889+0000","last_undegraded":"2024-04-23T18:23:13.716889+0000","last_fullsized":"2024-04-23T18:23:13.716889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713039+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:23:13.713039+0000","last_peered":"2024-04-23T18:23:13.713039+0000","last_clean":"2024-04-23T18:23:13.713039+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:23:13.713039+0000","last_undegraded":"2024-04-23T18:23:13.713039+0000","last_fullsized":"2024-04-23T18:23:13.713039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705260+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:23:13.705260+0000","last_peered":"2024-04-23T18:23:13.705260+0000","last_clean":"2024-04-23T18:23:13.705260+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:23:13.705260+0000","last_undegraded":"2024-04-23T18:23:13.705260+0000","last_fullsized":"2024-04-23T18:23:13.705260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708044+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:23:13.708044+0000","last_peered":"2024-04-23T18:23:13.708044+0000","last_clean":"2024-04-23T18:23:13.708044+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:23:13.708044+0000","last_undegraded":"2024-04-23T18:23:13.708044+0000","last_fullsized":"2024-04-23T18:23:13.708044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715561+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:23:13.715561+0000","last_peered":"2024-04-23T18:23:13.715561+0000","last_clean":"2024-04-23T18:23:13.715561+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:23:13.715561+0000","last_undegraded":"2024-04-23T18:23:13.715561+0000","last_fullsized":"2024-04-23T18:23:13.715561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705373+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:23:13.705373+0000","last_peered":"2024-04-23T18:23:13.705373+0000","last_clean":"2024-04-23T18:23:13.705373+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:23:13.705373+0000","last_undegraded":"2024-04-23T18:23:13.705373+0000","last_fullsized":"2024-04-23T18:23:13.705373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710750+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:23:13.710750+0000","last_peered":"2024-04-23T18:23:13.710750+0000","last_clean":"2024-04-23T18:23:13.710750+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:23:13.710750+0000","last_undegraded":"2024-04-23T18:23:13.710750+0000","last_fullsized":"2024-04-23T18:23:13.710750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704180+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:23:13.704180+0000","last_peered":"2024-04-23T18:23:13.704180+0000","last_clean":"2024-04-23T18:23:13.704180+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:23:13.704180+0000","last_undegraded":"2024-04-23T18:23:13.704180+0000","last_fullsized":"2024-04-23T18:23:13.704180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:38.519804+0000","last_change":"2024-04-23T18:23:14.398989+0000","last_active":"2024-04-23T18:23:14.398989+0000","last_peered":"2024-04-23T18:22:38.519804+0000","last_clean":"2024-04-23T18:22:38.519804+0000","last_became_active":"2024-04-23T18:22:33.396752+0000","last_became_peered":"2024-04-23T18:22:33.396752+0000","last_unstale":"2024-04-23T18:22:38.519804+0000","last_undegraded":"2024-04-23T18:22:38.519804+0000","last_fullsized":"2024-04-23T18:22:38.519804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712922+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:23:13.712922+0000","last_peered":"2024-04-23T18:23:13.712922+0000","last_clean":"2024-04-23T18:23:13.712922+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:23:13.712922+0000","last_undegraded":"2024-04-23T18:23:13.712922+0000","last_fullsized":"2024-04-23T18:23:13.712922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712299+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:23:13.712299+0000","last_peered":"2024-04-23T18:23:13.712299+0000","last_clean":"2024-04-23T18:23:13.712299+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:23:13.712299+0000","last_undegraded":"2024-04-23T18:23:13.712299+0000","last_fullsized":"2024-04-23T18:23:13.712299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724741+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:23:13.724741+0000","last_peered":"2024-04-23T18:23:13.724741+0000","last_clean":"2024-04-23T18:23:13.724741+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:23:13.724741+0000","last_undegraded":"2024-04-23T18:23:13.724741+0000","last_fullsized":"2024-04-23T18:23:13.724741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711311+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:23:13.711311+0000","last_peered":"2024-04-23T18:23:13.711311+0000","last_clean":"2024-04-23T18:23:13.711311+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:23:13.711311+0000","last_undegraded":"2024-04-23T18:23:13.711311+0000","last_fullsized":"2024-04-23T18:23:13.711311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716888+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:23:13.716888+0000","last_peered":"2024-04-23T18:23:13.716888+0000","last_clean":"2024-04-23T18:23:13.716888+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:23:13.716888+0000","last_undegraded":"2024-04-23T18:23:13.716888+0000","last_fullsized":"2024-04-23T18:23:13.716888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710505+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:23:13.710505+0000","last_peered":"2024-04-23T18:23:13.710505+0000","last_clean":"2024-04-23T18:23:13.710505+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:23:13.710505+0000","last_undegraded":"2024-04-23T18:23:13.710505+0000","last_fullsized":"2024-04-23T18:23:13.710505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707148+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:23:13.707148+0000","last_peered":"2024-04-23T18:23:13.707148+0000","last_clean":"2024-04-23T18:23:13.707148+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:23:13.707148+0000","last_undegraded":"2024-04-23T18:23:13.707148+0000","last_fullsized":"2024-04-23T18:23:13.707148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712966+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:23:13.712966+0000","last_peered":"2024-04-23T18:23:13.712966+0000","last_clean":"2024-04-23T18:23:13.712966+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:23:13.712966+0000","last_undegraded":"2024-04-23T18:23:13.712966+0000","last_fullsized":"2024-04-23T18:23:13.712966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704612+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:23:13.704612+0000","last_peered":"2024-04-23T18:23:13.704612+0000","last_clean":"2024-04-23T18:23:13.704612+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:23:13.704612+0000","last_undegraded":"2024-04-23T18:23:13.704612+0000","last_fullsized":"2024-04-23T18:23:13.704612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715731+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:23:13.715731+0000","last_peered":"2024-04-23T18:23:13.715731+0000","last_clean":"2024-04-23T18:23:13.715731+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:23:13.715731+0000","last_undegraded":"2024-04-23T18:23:13.715731+0000","last_fullsized":"2024-04-23T18:23:13.715731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713268+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:23:13.713268+0000","last_peered":"2024-04-23T18:23:13.713268+0000","last_clean":"2024-04-23T18:23:13.713268+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:23:13.713268+0000","last_undegraded":"2024-04-23T18:23:13.713268+0000","last_fullsized":"2024-04-23T18:23:13.713268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715336+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:23:13.715336+0000","last_peered":"2024-04-23T18:23:13.715336+0000","last_clean":"2024-04-23T18:23:13.715336+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:23:13.715336+0000","last_undegraded":"2024-04-23T18:23:13.715336+0000","last_fullsized":"2024-04-23T18:23:13.715336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.725146+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:23:13.725146+0000","last_peered":"2024-04-23T18:23:13.725146+0000","last_clean":"2024-04-23T18:23:13.725146+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:23:13.725146+0000","last_undegraded":"2024-04-23T18:23:13.725146+0000","last_fullsized":"2024-04-23T18:23:13.725146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"peering","last_fresh":"2024-04-23T18:22:38.511717+0000","last_change":"2024-04-23T18:23:13.704483+0000","last_active":"2024-04-23T18:23:13.704483+0000","last_peered":"2024-04-23T18:22:38.511717+0000","last_clean":"2024-04-23T18:22:38.511717+0000","last_became_active":"2024-04-23T18:22:33.397476+0000","last_became_peered":"2024-04-23T18:22:33.397476+0000","last_unstale":"2024-04-23T18:22:38.511717+0000","last_undegraded":"2024-04-23T18:22:38.511717+0000","last_fullsized":"2024-04-23T18:22:38.511717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723094+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:23:13.723094+0000","last_peered":"2024-04-23T18:23:13.723094+0000","last_clean":"2024-04-23T18:23:13.723094+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:23:13.723094+0000","last_undegraded":"2024-04-23T18:23:13.723094+0000","last_fullsized":"2024-04-23T18:23:13.723094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713507+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:23:13.713507+0000","last_peered":"2024-04-23T18:23:13.713507+0000","last_clean":"2024-04-23T18:23:13.713507+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:23:13.713507+0000","last_undegraded":"2024-04-23T18:23:13.713507+0000","last_fullsized":"2024-04-23T18:23:13.713507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722558+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:23:13.722558+0000","last_peered":"2024-04-23T18:23:13.722558+0000","last_clean":"2024-04-23T18:23:13.722558+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:23:13.722558+0000","last_undegraded":"2024-04-23T18:23:13.722558+0000","last_fullsized":"2024-04-23T18:23:13.722558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713966+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:23:13.713966+0000","last_peered":"2024-04-23T18:23:13.713966+0000","last_clean":"2024-04-23T18:23:13.713966+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:23:13.713966+0000","last_undegraded":"2024-04-23T18:23:13.713966+0000","last_fullsized":"2024-04-23T18:23:13.713966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713681+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:23:13.713681+0000","last_peered":"2024-04-23T18:23:13.713681+0000","last_clean":"2024-04-23T18:23:13.713681+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:23:13.713681+0000","last_undegraded":"2024-04-23T18:23:13.713681+0000","last_fullsized":"2024-04-23T18:23:13.713681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708751+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:23:13.708751+0000","last_peered":"2024-04-23T18:23:13.708751+0000","last_clean":"2024-04-23T18:23:13.708751+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:23:13.708751+0000","last_undegraded":"2024-04-23T18:23:13.708751+0000","last_fullsized":"2024-04-23T18:23:13.708751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724963+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:23:13.724963+0000","last_peered":"2024-04-23T18:23:13.724963+0000","last_clean":"2024-04-23T18:23:13.724963+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:23:13.724963+0000","last_undegraded":"2024-04-23T18:23:13.724963+0000","last_fullsized":"2024-04-23T18:23:13.724963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":699078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":108772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":101228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":111948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":286720,"data_stored":108212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":108338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":698422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:23:18.565 INFO:tasks.quiescer.ceph_manager:PG 3.1e is not active+clean 2024-04-23T18:23:18.565 INFO:tasks.quiescer.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 25, 'state': 'peering', 'last_fresh': '2024-04-23T18:22:38.512479+0000', 'last_change': '2024-04-23T18:23:14.399010+0000', 'last_active': '2024-04-23T18:23:14.399010+0000', 'last_peered': '2024-04-23T18:22:38.512479+0000', 'last_clean': '2024-04-23T18:22:38.512479+0000', 'last_became_active': '2024-04-23T18:22:33.374636+0000', 'last_became_peered': '2024-04-23T18:22:33.374636+0000', 'last_unstale': '2024-04-23T18:22:38.512479+0000', 'last_undegraded': '2024-04-23T18:22:38.512479+0000', 'last_fullsized': '2024-04-23T18:22:38.512479+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 19, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'last_clean_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-23T18:23:18.565 INFO:tasks.quiescer.ceph_manager:PG 4.7 is not active+clean 2024-04-23T18:23:18.565 INFO:tasks.quiescer.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 25, 'state': 'peering', 'last_fresh': '2024-04-23T18:22:37.402011+0000', 'last_change': '2024-04-23T18:23:14.399026+0000', 'last_active': '2024-04-23T18:22:36.376251+0000', 'last_peered': '2024-04-23T18:22:36.376251+0000', 'last_clean': '2024-04-23T18:22:36.376251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-23T18:22:37.402011+0000', 'last_undegraded': '2024-04-23T18:22:37.402011+0000', 'last_fullsized': '2024-04-23T18:22:37.402011+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 23, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-23T18:22:36.376251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-23T18:22:36.376251+0000', 'last_clean_scrub_stamp': '2024-04-23T18:22:36.376251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5, 0, 3], 'acting': [2, 5, 0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-23T18:23:18.565 INFO:tasks.quiescer.ceph_manager:PG 4.b is not active+clean 2024-04-23T18:23:18.565 INFO:tasks.quiescer.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 24, 'state': 'peering', 'last_fresh': '2024-04-23T18:22:39.394570+0000', 'last_change': '2024-04-23T18:23:13.712613+0000', 'last_active': '2024-04-23T18:23:13.712613+0000', 'last_peered': '2024-04-23T18:22:39.394570+0000', 'last_clean': '2024-04-23T18:22:39.394570+0000', 'last_became_active': '2024-04-23T18:22:37.421745+0000', 'last_became_peered': '2024-04-23T18:22:37.421745+0000', 'last_unstale': '2024-04-23T18:22:39.394570+0000', 'last_undegraded': '2024-04-23T18:22:39.394570+0000', 'last_fullsized': '2024-04-23T18:22:39.394570+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 23, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-23T18:22:36.376251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-23T18:22:36.376251+0000', 'last_clean_scrub_stamp': '2024-04-23T18:22:36.376251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2, 4, 5], 'acting': [0, 2, 4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1, 2, 4, 5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-23T18:23:18.565 INFO:tasks.quiescer.ceph_manager:PG 3.11 is not active+clean 2024-04-23T18:23:18.566 INFO:tasks.quiescer.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 25, 'state': 'peering', 'last_fresh': '2024-04-23T18:22:33.374695+0000', 'last_change': '2024-04-23T18:23:14.398956+0000', 'last_active': '2024-04-23T18:22:32.337166+0000', 'last_peered': '2024-04-23T18:22:32.337166+0000', 'last_clean': '2024-04-23T18:22:32.337166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-23T18:22:33.374695+0000', 'last_undegraded': '2024-04-23T18:22:33.374695+0000', 'last_fullsized': '2024-04-23T18:22:33.374695+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 19, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'last_clean_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-23T18:23:18.566 INFO:tasks.quiescer.ceph_manager:PG 4.12 is not active+clean 2024-04-23T18:23:18.566 INFO:tasks.quiescer.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 25, 'state': 'peering', 'last_fresh': '2024-04-23T18:22:37.396053+0000', 'last_change': '2024-04-23T18:23:14.399300+0000', 'last_active': '2024-04-23T18:22:36.376251+0000', 'last_peered': '2024-04-23T18:22:36.376251+0000', 'last_clean': '2024-04-23T18:22:36.376251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-23T18:22:37.396053+0000', 'last_undegraded': '2024-04-23T18:22:37.396053+0000', 'last_fullsized': '2024-04-23T18:22:37.396053+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 23, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-23T18:22:36.376251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-23T18:22:36.376251+0000', 'last_clean_scrub_stamp': '2024-04-23T18:22:36.376251+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6, 2, 0], 'acting': [5, 6, 2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-23T18:23:18.566 INFO:tasks.quiescer.ceph_manager:PG 3.2a is not active+clean 2024-04-23T18:23:18.566 INFO:tasks.quiescer.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 25, 'state': 'peering', 'last_fresh': '2024-04-23T18:22:38.519804+0000', 'last_change': '2024-04-23T18:23:14.398989+0000', 'last_active': '2024-04-23T18:23:14.398989+0000', 'last_peered': '2024-04-23T18:22:38.519804+0000', 'last_clean': '2024-04-23T18:22:38.519804+0000', 'last_became_active': '2024-04-23T18:22:33.396752+0000', 'last_became_peered': '2024-04-23T18:22:33.396752+0000', 'last_unstale': '2024-04-23T18:22:38.519804+0000', 'last_undegraded': '2024-04-23T18:22:38.519804+0000', 'last_fullsized': '2024-04-23T18:22:38.519804+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 19, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'last_clean_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-23T18:23:18.566 INFO:tasks.quiescer.ceph_manager:PG 3.38 is not active+clean 2024-04-23T18:23:18.566 INFO:tasks.quiescer.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 21, 'reported_epoch': 24, 'state': 'peering', 'last_fresh': '2024-04-23T18:22:38.511717+0000', 'last_change': '2024-04-23T18:23:13.704483+0000', 'last_active': '2024-04-23T18:23:13.704483+0000', 'last_peered': '2024-04-23T18:22:38.511717+0000', 'last_clean': '2024-04-23T18:22:38.511717+0000', 'last_became_active': '2024-04-23T18:22:33.397476+0000', 'last_became_peered': '2024-04-23T18:22:33.397476+0000', 'last_unstale': '2024-04-23T18:22:38.511717+0000', 'last_undegraded': '2024-04-23T18:22:38.511717+0000', 'last_fullsized': '2024-04-23T18:22:38.511717+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 19, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'last_clean_scrub_stamp': '2024-04-23T18:22:32.337166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1, 5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-23T18:23:18.567 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-23T18:23:18.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.751+0000 7f6145e00640 1 Processor -- start 2024-04-23T18:23:18.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.751+0000 7f6145e00640 1 -- start start 2024-04-23T18:23:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6145e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f61400c9a00 0x7f6140158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6145e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61400c9e70 0x7f6140159430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6145e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61400c3bc0 con 0x7f61401531a0 2024-04-23T18:23:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6145e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f61400c4940 con 0x7f61400c9a00 2024-04-23T18:23:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6145e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f61400c6790 con 0x7f61400c9e70 2024-04-23T18:23:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6137e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f61400c9a00 0x7f6140158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f613f400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61400c9e70 0x7f6140159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6137e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f61400c9a00 0x7f6140158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:53550/0 (socket says 172.21.15.28:53550) 2024-04-23T18:23:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6137e00640 1 -- 172.21.15.28:0/2149782037 learned_addr learned my addr 172.21.15.28:0/2149782037 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f613ea00640 1 --1- 172.21.15.28:0/2149782037 >> v1:172.21.15.137:6789/0 conn(0x7f61401531a0 0x7f61400c5ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:41678/0 (socket says 172.21.15.28:41678) 2024-04-23T18:23:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6137e00640 1 -- 172.21.15.28:0/2149782037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61400c9e70 msgr2=0x7f6140159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:18.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6137e00640 1 --2- 172.21.15.28:0/2149782037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61400c9e70 0x7f6140159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6137e00640 1 -- 172.21.15.28:0/2149782037 >> v1:172.21.15.137:6789/0 conn(0x7f61401531a0 legacy=0x7f61400c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.755+0000 7f6137e00640 1 -- 172.21.15.28:0/2149782037 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61400c6a70 con 0x7f61400c9a00 2024-04-23T18:23:18.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f6137e00640 1 --2- 172.21.15.28:0/2149782037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61400c9a00 0x7f6140158ef0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6128009870 tx=0x7f612801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a67c7a28d280c12b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:18.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f613e000640 1 -- 172.21.15.28:0/2149782037 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61280b5070 con 0x7f61400c9a00 2024-04-23T18:23:18.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f613e000640 1 -- 172.21.15.28:0/2149782037 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61280a8a50 con 0x7f61400c9a00 2024-04-23T18:23:18.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f613e000640 1 -- 172.21.15.28:0/2149782037 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61280a8e20 con 0x7f61400c9a00 2024-04-23T18:23:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f6145e00640 1 -- 172.21.15.28:0/2149782037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61400c9a00 msgr2=0x7f6140158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f6145e00640 1 --2- 172.21.15.28:0/2149782037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61400c9a00 0x7f6140158ef0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6128009870 tx=0x7f612801ed50 comp rx=0 tx=0).stop 2024-04-23T18:23:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f6145e00640 1 -- 172.21.15.28:0/2149782037 shutdown_connections 2024-04-23T18:23:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f6145e00640 1 --2- 172.21.15.28:0/2149782037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61400c9e70 0x7f6140159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f6145e00640 1 --2- 172.21.15.28:0/2149782037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61400c9a00 0x7f6140158ef0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f6145e00640 1 -- 172.21.15.28:0/2149782037 >> 172.21.15.28:0/2149782037 conn(0x7f614006d0a0 msgr2=0x7f61400676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f6145e00640 1 -- 172.21.15.28:0/2149782037 shutdown_connections 2024-04-23T18:23:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f6145e00640 1 -- 172.21.15.28:0/2149782037 wait complete. 2024-04-23T18:23:18.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f6145e00640 1 Processor -- start 2024-04-23T18:23:18.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.759+0000 7f6145e00640 1 -- start start 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6145e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61400c9a00 0x7f6140071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6145e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61401531a0 0x7f6140072b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6145e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61401e7840 0x7f61401f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6145e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f61400c4420 con 0x7f61401e7840 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6145e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61400c4140 con 0x7f61401531a0 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6145e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6140153580 con 0x7f61400c9a00 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f613f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61401e7840 0x7f61401f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f613f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61401e7840 0x7f61401f4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56176/0 (socket says 172.21.15.28:56176) 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f613f400640 1 -- 172.21.15.28:0/3016830776 learned_addr learned my addr 172.21.15.28:0/3016830776 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f613ea00640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61400c9a00 0x7f6140071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6137e00640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61401531a0 0x7f6140072b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f613f400640 1 -- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61400c9a00 msgr2=0x7f6140071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f613f400640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61400c9a00 0x7f6140071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f613f400640 1 -- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61401531a0 msgr2=0x7f6140072b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f613f400640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61401531a0 0x7f6140072b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f613f400640 1 -- 172.21.15.28:0/3016830776 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61401598d0 con 0x7f61401e7840 2024-04-23T18:23:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f613f400640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61401e7840 0x7f61401f4cc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6138009e30 tx=0x7f613800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6137400640 1 -- 172.21.15.28:0/3016830776 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138018020 con 0x7f61401e7840 2024-04-23T18:23:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6137400640 1 -- 172.21.15.28:0/3016830776 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6138014480 con 0x7f61401e7840 2024-04-23T18:23:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6137400640 1 -- 172.21.15.28:0/3016830776 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138014870 con 0x7f61401e7840 2024-04-23T18:23:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6145e00640 1 -- 172.21.15.28:0/3016830776 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6140159b70 con 0x7f61401e7840 2024-04-23T18:23:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6145e00640 1 -- 172.21.15.28:0/3016830776 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61400722e0 con 0x7f61401e7840 2024-04-23T18:23:18.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.763+0000 7f6145e00640 1 -- 172.21.15.28:0/3016830776 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6140072520 con 0x7f61401e7840 2024-04-23T18:23:18.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.767+0000 7f6137400640 1 -- 172.21.15.28:0/3016830776 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f613801b020 con 0x7f61401e7840 2024-04-23T18:23:18.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.767+0000 7f6137400640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f611c0683b0 0x7f611c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:18.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.767+0000 7f6137400640 1 -- 172.21.15.28:0/3016830776 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6138087b90 con 0x7f61401e7840 2024-04-23T18:23:18.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.767+0000 7f613ea00640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f611c0683b0 0x7f611c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:18.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.767+0000 7f613ea00640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f611c0683b0 0x7f611c06a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6130000f70 tx=0x7f6130007e90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:18.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.771+0000 7f6137400640 1 -- 172.21.15.28:0/3016830776 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6140072520 con 0x7f61401e7840 2024-04-23T18:23:18.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.995+0000 7f6145e00640 1 -- 172.21.15.28:0/3016830776 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6140068cd0 con 0x7f61401e7840 2024-04-23T18:23:18.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6137400640 1 -- 172.21.15.28:0/3016830776 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3106 (secure 0 0 0) 0x7f6138022030 con 0x7f61401e7840 2024-04-23T18:23:18.992 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:18.992 INFO:teuthology.orchestra.run.smithi028.stdout:{"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":71,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":26,"num_osds":8,"num_up_osds":8,"osd_up_since":1713896538,"num_in_osds":8,"osd_in_since":1713896530,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":122},{"state_name":"peering","count":7}],"num_pgs":129,"num_pools":4,"num_objects":62,"data_bytes":598078,"bytes_used":237592576,"bytes_avail":772856520704,"bytes_total":773094113280,"inactive_pgs_ratio":0.054263565689325333,"write_bytes_sec":1663,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":15,"id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"e","status":"up:active","gid":4281},{"filesystem_id":1,"rank":1,"name":"d","status":"up:active","gid":4294},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4297}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-04-23T18:23:15.335537+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 -- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f611c0683b0 msgr2=0x7f611c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f611c0683b0 0x7f611c06a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6130000f70 tx=0x7f6130007e90 comp rx=0 tx=0).stop 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 -- 172.21.15.28:0/3016830776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61401e7840 msgr2=0x7f61401f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61401e7840 0x7f61401f4cc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6138009e30 tx=0x7f613800c490 comp rx=0 tx=0).stop 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 -- 172.21.15.28:0/3016830776 shutdown_connections 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f611c0683b0 0x7f611c06a870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f61401e7840 0x7f61401f4cc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61401531a0 0x7f6140072b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 --2- 172.21.15.28:0/3016830776 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f61400c9a00 0x7f6140071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 -- 172.21.15.28:0/3016830776 >> 172.21.15.28:0/3016830776 conn(0x7f614006d0a0 msgr2=0x7f614014d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 -- 172.21.15.28:0/3016830776 shutdown_connections 2024-04-23T18:23:18.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:18.999+0000 7f6145e00640 1 -- 172.21.15.28:0/3016830776 wait complete. 2024-04-23T18:23:19.015 INFO:tasks.quiescer.ceph_manager:no progress seen, keeping timeout for now 2024-04-23T18:23:19.015 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:23:19.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.159+0000 7f120c200640 1 Processor -- start 2024-04-23T18:23:19.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.159+0000 7f120c200640 1 -- start start 2024-04-23T18:23:19.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f120c200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f120415c770 0x7f120415b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:19.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f120c200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1204073b00 0x7f120406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:19.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f120c200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f120415ba20 con 0x7f12041555d0 2024-04-23T18:23:19.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f120c200640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f120415c2c0 con 0x7f120415c770 2024-04-23T18:23:19.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f120c200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f12040cecf0 con 0x7f1204073b00 2024-04-23T18:23:19.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f1208e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f120415c770 0x7f120415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:19.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f1208e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f120415c770 0x7f120415b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49766/0 (socket says 172.21.15.28:49766) 2024-04-23T18:23:19.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f1208e00640 1 -- 172.21.15.28:0/2098737831 learned_addr learned my addr 172.21.15.28:0/2098737831 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:19.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f120a200640 1 --2- 172.21.15.28:0/2098737831 >> v2:172.21.15.137:3300/0 conn(0x7f1204073b00 0x7f120406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:19.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f1208e00640 1 -- 172.21.15.28:0/2098737831 >> v2:172.21.15.137:3300/0 conn(0x7f1204073b00 msgr2=0x7f120406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:19.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f1208e00640 1 --2- 172.21.15.28:0/2098737831 >> v2:172.21.15.137:3300/0 conn(0x7f1204073b00 0x7f120406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:19.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f1208e00640 1 -- 172.21.15.28:0/2098737831 >> v1:172.21.15.137:6789/0 conn(0x7f12041555d0 legacy=0x7f12040cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:19.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.163+0000 7f1208e00640 1 -- 172.21.15.28:0/2098737831 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120415bd00 con 0x7f120415c770 2024-04-23T18:23:19.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f1208e00640 1 --2- 172.21.15.28:0/2098737831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f120415c770 0x7f120415b300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1204144a70 tx=0x7f11f001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d53dcd7c466602 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:19.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f1203e00640 1 -- 172.21.15.28:0/2098737831 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f00b5070 con 0x7f120415c770 2024-04-23T18:23:19.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f1203e00640 1 -- 172.21.15.28:0/2098737831 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f00a8a10 con 0x7f120415c770 2024-04-23T18:23:19.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f1203e00640 1 -- 172.21.15.28:0/2098737831 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f00a8de0 con 0x7f120415c770 2024-04-23T18:23:19.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f120c200640 1 -- 172.21.15.28:0/2098737831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f120415c770 msgr2=0x7f120415b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:19.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f120c200640 1 --2- 172.21.15.28:0/2098737831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f120415c770 0x7f120415b300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1204144a70 tx=0x7f11f001ed10 comp rx=0 tx=0).stop 2024-04-23T18:23:19.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f120c200640 1 -- 172.21.15.28:0/2098737831 shutdown_connections 2024-04-23T18:23:19.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f120c200640 1 --2- 172.21.15.28:0/2098737831 >> v2:172.21.15.137:3300/0 conn(0x7f1204073b00 0x7f120406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:19.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f120c200640 1 --2- 172.21.15.28:0/2098737831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f120415c770 0x7f120415b300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:19.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f120c200640 1 -- 172.21.15.28:0/2098737831 >> 172.21.15.28:0/2098737831 conn(0x7f1204072f30 msgr2=0x7f1204073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:19.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f120c200640 1 -- 172.21.15.28:0/2098737831 shutdown_connections 2024-04-23T18:23:19.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f120c200640 1 -- 172.21.15.28:0/2098737831 wait complete. 2024-04-23T18:23:19.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f120c200640 1 Processor -- start 2024-04-23T18:23:19.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.167+0000 7f120c200640 1 -- start start 2024-04-23T18:23:19.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120c200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1204073b00 0x7f12040c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:19.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120c200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12041555d0 0x7f1204141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:19.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120c200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f120415c770 0x7f120413a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:19.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120c200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12041559b0 con 0x7f120415c770 2024-04-23T18:23:19.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120c200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12040ce980 con 0x7f1204073b00 2024-04-23T18:23:19.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120c200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f120406bf20 con 0x7f12041555d0 2024-04-23T18:23:19.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120a200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f120415c770 0x7f120413a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:19.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120a200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f120415c770 0x7f120413a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49776/0 (socket says 172.21.15.28:49776) 2024-04-23T18:23:19.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120a200640 1 -- 172.21.15.28:0/3568216662 learned_addr learned my addr 172.21.15.28:0/3568216662 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:19.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f1208e00640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12041555d0 0x7f1204141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:19.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f1209800640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1204073b00 0x7f12040c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:19.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120a200640 1 -- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12041555d0 msgr2=0x7f1204141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:19.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120a200640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12041555d0 0x7f1204141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:19.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120a200640 1 -- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1204073b00 msgr2=0x7f12040c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:19.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120a200640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1204073b00 0x7f12040c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:19.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120a200640 1 -- 172.21.15.28:0/3568216662 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1204143000 con 0x7f120415c770 2024-04-23T18:23:19.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120a200640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f120415c770 0x7f120413a460 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009dd0 tx=0x7f11fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:19.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f1201600640 1 -- 172.21.15.28:0/3568216662 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc018020 con 0x7f120415c770 2024-04-23T18:23:19.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f1201600640 1 -- 172.21.15.28:0/3568216662 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11fc014480 con 0x7f120415c770 2024-04-23T18:23:19.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f1201600640 1 -- 172.21.15.28:0/3568216662 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc014870 con 0x7f120415c770 2024-04-23T18:23:19.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120c200640 1 -- 172.21.15.28:0/3568216662 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12040c5f60 con 0x7f120415c770 2024-04-23T18:23:19.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120c200640 1 -- 172.21.15.28:0/3568216662 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1204159560 con 0x7f120415c770 2024-04-23T18:23:19.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f120c200640 1 -- 172.21.15.28:0/3568216662 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1204068cd0 con 0x7f120415c770 2024-04-23T18:23:19.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.171+0000 7f1201600640 1 -- 172.21.15.28:0/3568216662 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f11fc01b020 con 0x7f120415c770 2024-04-23T18:23:19.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.175+0000 7f1201600640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f11e4068380 0x7f11e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:19.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.175+0000 7f1201600640 1 -- 172.21.15.28:0/3568216662 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f11fc0878f0 con 0x7f120415c770 2024-04-23T18:23:19.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.175+0000 7f1209800640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f11e4068380 0x7f11e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:19.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.175+0000 7f1209800640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f11e4068380 0x7f11e406a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f11f8001650 tx=0x7f11f8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:19.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.179+0000 7f1201600640 1 -- 172.21.15.28:0/3568216662 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f11fc022070 con 0x7f120415c770 2024-04-23T18:23:19.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.339+0000 7f120c200640 1 -- 172.21.15.28:0/3568216662 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12040c9750 con 0x7f11e4068380 2024-04-23T18:23:19.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.363+0000 7f1201600640 1 -- 172.21.15.28:0/3568216662 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332251 (secure 0 0 0) 0x7f12040c9750 con 0x7f11e4068380 2024-04-23T18:23:19.361 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:19.363 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:23:19.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 -- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f11e4068380 msgr2=0x7f11e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:19.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f11e4068380 0x7f11e406a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f11f8001650 tx=0x7f11f8009040 comp rx=0 tx=0).stop 2024-04-23T18:23:19.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 -- 172.21.15.28:0/3568216662 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f120415c770 msgr2=0x7f120413a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:19.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f120415c770 0x7f120413a460 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009dd0 tx=0x7f11fc00c490 comp rx=0 tx=0).stop 2024-04-23T18:23:19.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 -- 172.21.15.28:0/3568216662 shutdown_connections 2024-04-23T18:23:19.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f11e4068380 0x7f11e406a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:19.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f12041555d0 0x7f1204141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:19.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f120415c770 0x7f120413a460 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:19.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 --2- 172.21.15.28:0/3568216662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1204073b00 0x7f12040c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:19.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 -- 172.21.15.28:0/3568216662 >> 172.21.15.28:0/3568216662 conn(0x7f1204072f30 msgr2=0x7f12040cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:19.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 -- 172.21.15.28:0/3568216662 shutdown_connections 2024-04-23T18:23:19.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:19.367+0000 7f120c200640 1 -- 172.21.15.28:0/3568216662 wait complete. 2024-04-23T18:23:19.381 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-04-23T18:23:19.336727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232024,"kb_used_data":3388,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742696,"statfs":{"total":773094113280,"available":772856520704,"internally_reserved":0,"allocated":3469312,"data_stored":2048170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":258,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003014"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714103+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:23:13.714103+0000","last_peered":"2024-04-23T18:23:13.714103+0000","last_clean":"2024-04-23T18:23:13.714103+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:23:13.714103+0000","last_undegraded":"2024-04-23T18:23:13.714103+0000","last_fullsized":"2024-04-23T18:23:13.714103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:38.512479+0000","last_change":"2024-04-23T18:23:14.399010+0000","last_active":"2024-04-23T18:23:14.399010+0000","last_peered":"2024-04-23T18:22:38.512479+0000","last_clean":"2024-04-23T18:22:38.512479+0000","last_became_active":"2024-04-23T18:22:33.374636+0000","last_became_peered":"2024-04-23T18:22:33.374636+0000","last_unstale":"2024-04-23T18:22:38.512479+0000","last_undegraded":"2024-04-23T18:22:38.512479+0000","last_fullsized":"2024-04-23T18:22:38.512479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.703975+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:23:13.703975+0000","last_peered":"2024-04-23T18:23:13.703975+0000","last_clean":"2024-04-23T18:23:13.703975+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:23:13.703975+0000","last_undegraded":"2024-04-23T18:23:13.703975+0000","last_fullsized":"2024-04-23T18:23:13.703975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705142+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:23:13.705142+0000","last_peered":"2024-04-23T18:23:13.705142+0000","last_clean":"2024-04-23T18:23:13.705142+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:23:13.705142+0000","last_undegraded":"2024-04-23T18:23:13.705142+0000","last_fullsized":"2024-04-23T18:23:13.705142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713925+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:23:13.713925+0000","last_peered":"2024-04-23T18:23:13.713925+0000","last_clean":"2024-04-23T18:23:13.713925+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:23:13.713925+0000","last_undegraded":"2024-04-23T18:23:13.713925+0000","last_fullsized":"2024-04-23T18:23:13.713925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711813+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:23:13.711813+0000","last_peered":"2024-04-23T18:23:13.711813+0000","last_clean":"2024-04-23T18:23:13.711813+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:23:13.711813+0000","last_undegraded":"2024-04-23T18:23:13.711813+0000","last_fullsized":"2024-04-23T18:23:13.711813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724579+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:23:13.724579+0000","last_peered":"2024-04-23T18:23:13.724579+0000","last_clean":"2024-04-23T18:23:13.724579+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:23:13.724579+0000","last_undegraded":"2024-04-23T18:23:13.724579+0000","last_fullsized":"2024-04-23T18:23:13.724579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714242+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:23:13.714242+0000","last_peered":"2024-04-23T18:23:13.714242+0000","last_clean":"2024-04-23T18:23:13.714242+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:23:13.714242+0000","last_undegraded":"2024-04-23T18:23:13.714242+0000","last_fullsized":"2024-04-23T18:23:13.714242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.720246+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:23:13.720246+0000","last_peered":"2024-04-23T18:23:13.720246+0000","last_clean":"2024-04-23T18:23:13.720246+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:23:13.720246+0000","last_undegraded":"2024-04-23T18:23:13.720246+0000","last_fullsized":"2024-04-23T18:23:13.720246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724028+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:23:13.724028+0000","last_peered":"2024-04-23T18:23:13.724028+0000","last_clean":"2024-04-23T18:23:13.724028+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:23:13.724028+0000","last_undegraded":"2024-04-23T18:23:13.724028+0000","last_fullsized":"2024-04-23T18:23:13.724028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716404+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:23:13.716404+0000","last_peered":"2024-04-23T18:23:13.716404+0000","last_clean":"2024-04-23T18:23:13.716404+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:23:13.716404+0000","last_undegraded":"2024-04-23T18:23:13.716404+0000","last_fullsized":"2024-04-23T18:23:13.716404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715137+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:23:13.715137+0000","last_peered":"2024-04-23T18:23:13.715137+0000","last_clean":"2024-04-23T18:23:13.715137+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:23:13.715137+0000","last_undegraded":"2024-04-23T18:23:13.715137+0000","last_fullsized":"2024-04-23T18:23:13.715137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708248+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:23:13.708248+0000","last_peered":"2024-04-23T18:23:13.708248+0000","last_clean":"2024-04-23T18:23:13.708248+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:23:13.708248+0000","last_undegraded":"2024-04-23T18:23:13.708248+0000","last_fullsized":"2024-04-23T18:23:13.708248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723698+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:23:13.723698+0000","last_peered":"2024-04-23T18:23:13.723698+0000","last_clean":"2024-04-23T18:23:13.723698+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:23:13.723698+0000","last_undegraded":"2024-04-23T18:23:13.723698+0000","last_fullsized":"2024-04-23T18:23:13.723698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717018+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:23:13.717018+0000","last_peered":"2024-04-23T18:23:13.717018+0000","last_clean":"2024-04-23T18:23:13.717018+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:23:13.717018+0000","last_undegraded":"2024-04-23T18:23:13.717018+0000","last_fullsized":"2024-04-23T18:23:13.717018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704708+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:23:13.704708+0000","last_peered":"2024-04-23T18:23:13.704708+0000","last_clean":"2024-04-23T18:23:13.704708+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:23:13.704708+0000","last_undegraded":"2024-04-23T18:23:13.704708+0000","last_fullsized":"2024-04-23T18:23:13.704708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707492+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:23:13.707492+0000","last_peered":"2024-04-23T18:23:13.707492+0000","last_clean":"2024-04-23T18:23:13.707492+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:23:13.707492+0000","last_undegraded":"2024-04-23T18:23:13.707492+0000","last_fullsized":"2024-04-23T18:23:13.707492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715538+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:23:13.715538+0000","last_peered":"2024-04-23T18:23:13.715538+0000","last_clean":"2024-04-23T18:23:13.715538+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:23:13.715538+0000","last_undegraded":"2024-04-23T18:23:13.715538+0000","last_fullsized":"2024-04-23T18:23:13.715538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704209+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:23:13.704209+0000","last_peered":"2024-04-23T18:23:13.704209+0000","last_clean":"2024-04-23T18:23:13.704209+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:23:13.704209+0000","last_undegraded":"2024-04-23T18:23:13.704209+0000","last_fullsized":"2024-04-23T18:23:13.704209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707276+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:23:13.707276+0000","last_peered":"2024-04-23T18:23:13.707276+0000","last_clean":"2024-04-23T18:23:13.707276+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:23:13.707276+0000","last_undegraded":"2024-04-23T18:23:13.707276+0000","last_fullsized":"2024-04-23T18:23:13.707276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709100+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:23:13.709100+0000","last_peered":"2024-04-23T18:23:13.709100+0000","last_clean":"2024-04-23T18:23:13.709100+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:23:13.709100+0000","last_undegraded":"2024-04-23T18:23:13.709100+0000","last_fullsized":"2024-04-23T18:23:13.709100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715948+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:23:13.715948+0000","last_peered":"2024-04-23T18:23:13.715948+0000","last_clean":"2024-04-23T18:23:13.715948+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:23:13.715948+0000","last_undegraded":"2024-04-23T18:23:13.715948+0000","last_fullsized":"2024-04-23T18:23:13.715948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722449+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:23:13.722449+0000","last_peered":"2024-04-23T18:23:13.722449+0000","last_clean":"2024-04-23T18:23:13.722449+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:23:13.722449+0000","last_undegraded":"2024-04-23T18:23:13.722449+0000","last_fullsized":"2024-04-23T18:23:13.722449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717671+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:23:13.717671+0000","last_peered":"2024-04-23T18:23:13.717671+0000","last_clean":"2024-04-23T18:23:13.717671+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:23:13.717671+0000","last_undegraded":"2024-04-23T18:23:13.717671+0000","last_fullsized":"2024-04-23T18:23:13.717671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713208+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:23:13.713208+0000","last_peered":"2024-04-23T18:23:13.713208+0000","last_clean":"2024-04-23T18:23:13.713208+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:23:13.713208+0000","last_undegraded":"2024-04-23T18:23:13.713208+0000","last_fullsized":"2024-04-23T18:23:13.713208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715074+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:23:13.715074+0000","last_peered":"2024-04-23T18:23:13.715074+0000","last_clean":"2024-04-23T18:23:13.715074+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:23:13.715074+0000","last_undegraded":"2024-04-23T18:23:13.715074+0000","last_fullsized":"2024-04-23T18:23:13.715074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715116+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:23:13.715116+0000","last_peered":"2024-04-23T18:23:13.715116+0000","last_clean":"2024-04-23T18:23:13.715116+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:23:13.715116+0000","last_undegraded":"2024-04-23T18:23:13.715116+0000","last_fullsized":"2024-04-23T18:23:13.715116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705498+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:23:13.705498+0000","last_peered":"2024-04-23T18:23:13.705498+0000","last_clean":"2024-04-23T18:23:13.705498+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:23:13.705498+0000","last_undegraded":"2024-04-23T18:23:13.705498+0000","last_fullsized":"2024-04-23T18:23:13.705498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708857+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:23:13.708857+0000","last_peered":"2024-04-23T18:23:13.708857+0000","last_clean":"2024-04-23T18:23:13.708857+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:23:13.708857+0000","last_undegraded":"2024-04-23T18:23:13.708857+0000","last_fullsized":"2024-04-23T18:23:13.708857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.703875+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:23:13.703875+0000","last_peered":"2024-04-23T18:23:13.703875+0000","last_clean":"2024-04-23T18:23:13.703875+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:23:13.703875+0000","last_undegraded":"2024-04-23T18:23:13.703875+0000","last_fullsized":"2024-04-23T18:23:13.703875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707790+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:23:13.707790+0000","last_peered":"2024-04-23T18:23:13.707790+0000","last_clean":"2024-04-23T18:23:13.707790+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:23:13.707790+0000","last_undegraded":"2024-04-23T18:23:13.707790+0000","last_fullsized":"2024-04-23T18:23:13.707790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724832+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:23:13.724832+0000","last_peered":"2024-04-23T18:23:13.724832+0000","last_clean":"2024-04-23T18:23:13.724832+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:23:13.724832+0000","last_undegraded":"2024-04-23T18:23:13.724832+0000","last_fullsized":"2024-04-23T18:23:13.724832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713574+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:23:13.713574+0000","last_peered":"2024-04-23T18:23:13.713574+0000","last_clean":"2024-04-23T18:23:13.713574+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:23:13.713574+0000","last_undegraded":"2024-04-23T18:23:13.713574+0000","last_fullsized":"2024-04-23T18:23:13.713574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716655+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:23:13.716655+0000","last_peered":"2024-04-23T18:23:13.716655+0000","last_clean":"2024-04-23T18:23:13.716655+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:23:13.716655+0000","last_undegraded":"2024-04-23T18:23:13.716655+0000","last_fullsized":"2024-04-23T18:23:13.716655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707875+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:23:13.707875+0000","last_peered":"2024-04-23T18:23:13.707875+0000","last_clean":"2024-04-23T18:23:13.707875+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:23:13.707875+0000","last_undegraded":"2024-04-23T18:23:13.707875+0000","last_fullsized":"2024-04-23T18:23:13.707875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707060+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:23:13.707060+0000","last_peered":"2024-04-23T18:23:13.707060+0000","last_clean":"2024-04-23T18:23:13.707060+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:23:13.707060+0000","last_undegraded":"2024-04-23T18:23:13.707060+0000","last_fullsized":"2024-04-23T18:23:13.707060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.721077+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:23:13.721077+0000","last_peered":"2024-04-23T18:23:13.721077+0000","last_clean":"2024-04-23T18:23:13.721077+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:23:13.721077+0000","last_undegraded":"2024-04-23T18:23:13.721077+0000","last_fullsized":"2024-04-23T18:23:13.721077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717386+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:23:13.717386+0000","last_peered":"2024-04-23T18:23:13.717386+0000","last_clean":"2024-04-23T18:23:13.717386+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:23:13.717386+0000","last_undegraded":"2024-04-23T18:23:13.717386+0000","last_fullsized":"2024-04-23T18:23:13.717386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707660+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:23:13.707660+0000","last_peered":"2024-04-23T18:23:13.707660+0000","last_clean":"2024-04-23T18:23:13.707660+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:23:13.707660+0000","last_undegraded":"2024-04-23T18:23:13.707660+0000","last_fullsized":"2024-04-23T18:23:13.707660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707152+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:23:13.707152+0000","last_peered":"2024-04-23T18:23:13.707152+0000","last_clean":"2024-04-23T18:23:13.707152+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:23:13.707152+0000","last_undegraded":"2024-04-23T18:23:13.707152+0000","last_fullsized":"2024-04-23T18:23:13.707152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709779+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:23:13.709779+0000","last_peered":"2024-04-23T18:23:13.709779+0000","last_clean":"2024-04-23T18:23:13.709779+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:23:13.709779+0000","last_undegraded":"2024-04-23T18:23:13.709779+0000","last_fullsized":"2024-04-23T18:23:13.709779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:37.402011+0000","last_change":"2024-04-23T18:23:14.399026+0000","last_active":"2024-04-23T18:22:36.376251+0000","last_peered":"2024-04-23T18:22:36.376251+0000","last_clean":"2024-04-23T18:22:36.376251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:37.402011+0000","last_undegraded":"2024-04-23T18:22:37.402011+0000","last_fullsized":"2024-04-23T18:22:37.402011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712220+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:23:13.712220+0000","last_peered":"2024-04-23T18:23:13.712220+0000","last_clean":"2024-04-23T18:23:13.712220+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:23:13.712220+0000","last_undegraded":"2024-04-23T18:23:13.712220+0000","last_fullsized":"2024-04-23T18:23:13.712220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722563+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:23:13.722563+0000","last_peered":"2024-04-23T18:23:13.722563+0000","last_clean":"2024-04-23T18:23:13.722563+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:23:13.722563+0000","last_undegraded":"2024-04-23T18:23:13.722563+0000","last_fullsized":"2024-04-23T18:23:13.722563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713085+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:23:13.713085+0000","last_peered":"2024-04-23T18:23:13.713085+0000","last_clean":"2024-04-23T18:23:13.713085+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:23:13.713085+0000","last_undegraded":"2024-04-23T18:23:13.713085+0000","last_fullsized":"2024-04-23T18:23:13.713085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704661+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:23:13.704661+0000","last_peered":"2024-04-23T18:23:13.704661+0000","last_clean":"2024-04-23T18:23:13.704661+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:23:13.704661+0000","last_undegraded":"2024-04-23T18:23:13.704661+0000","last_fullsized":"2024-04-23T18:23:13.704661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714295+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:23:13.714295+0000","last_peered":"2024-04-23T18:23:13.714295+0000","last_clean":"2024-04-23T18:23:13.714295+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:23:13.714295+0000","last_undegraded":"2024-04-23T18:23:13.714295+0000","last_fullsized":"2024-04-23T18:23:13.714295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722744+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:23:13.722744+0000","last_peered":"2024-04-23T18:23:13.722744+0000","last_clean":"2024-04-23T18:23:13.722744+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:23:13.722744+0000","last_undegraded":"2024-04-23T18:23:13.722744+0000","last_fullsized":"2024-04-23T18:23:13.722744+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712815+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:23:13.712815+0000","last_peered":"2024-04-23T18:23:13.712815+0000","last_clean":"2024-04-23T18:23:13.712815+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:23:13.712815+0000","last_undegraded":"2024-04-23T18:23:13.712815+0000","last_fullsized":"2024-04-23T18:23:13.712815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724334+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:23:13.724334+0000","last_peered":"2024-04-23T18:23:13.724334+0000","last_clean":"2024-04-23T18:23:13.724334+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:23:13.724334+0000","last_undegraded":"2024-04-23T18:23:13.724334+0000","last_fullsized":"2024-04-23T18:23:13.724334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710819+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:23:13.710819+0000","last_peered":"2024-04-23T18:23:13.710819+0000","last_clean":"2024-04-23T18:23:13.710819+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:23:13.710819+0000","last_undegraded":"2024-04-23T18:23:13.710819+0000","last_fullsized":"2024-04-23T18:23:13.710819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707782+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:23:13.707782+0000","last_peered":"2024-04-23T18:23:13.707782+0000","last_clean":"2024-04-23T18:23:13.707782+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:23:13.707782+0000","last_undegraded":"2024-04-23T18:23:13.707782+0000","last_fullsized":"2024-04-23T18:23:13.707782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716205+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:23:13.716205+0000","last_peered":"2024-04-23T18:23:13.716205+0000","last_clean":"2024-04-23T18:23:13.716205+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:23:13.716205+0000","last_undegraded":"2024-04-23T18:23:13.716205+0000","last_fullsized":"2024-04-23T18:23:13.716205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708424+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:23:13.708424+0000","last_peered":"2024-04-23T18:23:13.708424+0000","last_clean":"2024-04-23T18:23:13.708424+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:23:13.708424+0000","last_undegraded":"2024-04-23T18:23:13.708424+0000","last_fullsized":"2024-04-23T18:23:13.708424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"peering","last_fresh":"2024-04-23T18:22:39.394570+0000","last_change":"2024-04-23T18:23:13.712613+0000","last_active":"2024-04-23T18:23:13.712613+0000","last_peered":"2024-04-23T18:22:39.394570+0000","last_clean":"2024-04-23T18:22:39.394570+0000","last_became_active":"2024-04-23T18:22:37.421745+0000","last_became_peered":"2024-04-23T18:22:37.421745+0000","last_unstale":"2024-04-23T18:22:39.394570+0000","last_undegraded":"2024-04-23T18:22:39.394570+0000","last_fullsized":"2024-04-23T18:22:39.394570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,4,5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.725226+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:23:13.725226+0000","last_peered":"2024-04-23T18:23:13.725226+0000","last_clean":"2024-04-23T18:23:13.725226+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:23:13.725226+0000","last_undegraded":"2024-04-23T18:23:13.725226+0000","last_fullsized":"2024-04-23T18:23:13.725226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711073+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:23:13.711073+0000","last_peered":"2024-04-23T18:23:13.711073+0000","last_clean":"2024-04-23T18:23:13.711073+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:23:13.711073+0000","last_undegraded":"2024-04-23T18:23:13.711073+0000","last_fullsized":"2024-04-23T18:23:13.711073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710196+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:23:13.710196+0000","last_peered":"2024-04-23T18:23:13.710196+0000","last_clean":"2024-04-23T18:23:13.710196+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:23:13.710196+0000","last_undegraded":"2024-04-23T18:23:13.710196+0000","last_fullsized":"2024-04-23T18:23:13.710196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724766+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:23:13.724766+0000","last_peered":"2024-04-23T18:23:13.724766+0000","last_clean":"2024-04-23T18:23:13.724766+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:23:13.724766+0000","last_undegraded":"2024-04-23T18:23:13.724766+0000","last_fullsized":"2024-04-23T18:23:13.724766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.718445+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:23:13.718445+0000","last_peered":"2024-04-23T18:23:13.718445+0000","last_clean":"2024-04-23T18:23:13.718445+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:23:13.718445+0000","last_undegraded":"2024-04-23T18:23:13.718445+0000","last_fullsized":"2024-04-23T18:23:13.718445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711927+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:23:13.711927+0000","last_peered":"2024-04-23T18:23:13.711927+0000","last_clean":"2024-04-23T18:23:13.711927+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:23:13.711927+0000","last_undegraded":"2024-04-23T18:23:13.711927+0000","last_fullsized":"2024-04-23T18:23:13.711927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:33.374695+0000","last_change":"2024-04-23T18:23:14.398956+0000","last_active":"2024-04-23T18:22:32.337166+0000","last_peered":"2024-04-23T18:22:32.337166+0000","last_clean":"2024-04-23T18:22:32.337166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:33.374695+0000","last_undegraded":"2024-04-23T18:22:33.374695+0000","last_fullsized":"2024-04-23T18:22:33.374695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'15","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709549+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:23:13.709549+0000","last_peered":"2024-04-23T18:23:13.709549+0000","last_clean":"2024-04-23T18:23:13.709549+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:23:13.709549+0000","last_undegraded":"2024-04-23T18:23:13.709549+0000","last_fullsized":"2024-04-23T18:23:13.709549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712978+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:23:13.712978+0000","last_peered":"2024-04-23T18:23:13.712978+0000","last_clean":"2024-04-23T18:23:13.712978+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:23:13.712978+0000","last_undegraded":"2024-04-23T18:23:13.712978+0000","last_fullsized":"2024-04-23T18:23:13.712978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707934+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:23:13.707934+0000","last_peered":"2024-04-23T18:23:13.707934+0000","last_clean":"2024-04-23T18:23:13.707934+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:23:13.707934+0000","last_undegraded":"2024-04-23T18:23:13.707934+0000","last_fullsized":"2024-04-23T18:23:13.707934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708251+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:23:13.708251+0000","last_peered":"2024-04-23T18:23:13.708251+0000","last_clean":"2024-04-23T18:23:13.708251+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:23:13.708251+0000","last_undegraded":"2024-04-23T18:23:13.708251+0000","last_fullsized":"2024-04-23T18:23:13.708251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704942+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:23:13.704942+0000","last_peered":"2024-04-23T18:23:13.704942+0000","last_clean":"2024-04-23T18:23:13.704942+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:23:13.704942+0000","last_undegraded":"2024-04-23T18:23:13.704942+0000","last_fullsized":"2024-04-23T18:23:13.704942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723425+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:23:13.723425+0000","last_peered":"2024-04-23T18:23:13.723425+0000","last_clean":"2024-04-23T18:23:13.723425+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:23:13.723425+0000","last_undegraded":"2024-04-23T18:23:13.723425+0000","last_fullsized":"2024-04-23T18:23:13.723425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.717077+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:23:13.717077+0000","last_peered":"2024-04-23T18:23:13.717077+0000","last_clean":"2024-04-23T18:23:13.717077+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:23:13.717077+0000","last_undegraded":"2024-04-23T18:23:13.717077+0000","last_fullsized":"2024-04-23T18:23:13.717077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705662+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:23:13.705662+0000","last_peered":"2024-04-23T18:23:13.705662+0000","last_clean":"2024-04-23T18:23:13.705662+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:23:13.705662+0000","last_undegraded":"2024-04-23T18:23:13.705662+0000","last_fullsized":"2024-04-23T18:23:13.705662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713070+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:23:13.713070+0000","last_peered":"2024-04-23T18:23:13.713070+0000","last_clean":"2024-04-23T18:23:13.713070+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:23:13.713070+0000","last_undegraded":"2024-04-23T18:23:13.713070+0000","last_fullsized":"2024-04-23T18:23:13.713070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'6","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713237+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:23:13.713237+0000","last_peered":"2024-04-23T18:23:13.713237+0000","last_clean":"2024-04-23T18:23:13.713237+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:23:13.713237+0000","last_undegraded":"2024-04-23T18:23:13.713237+0000","last_fullsized":"2024-04-23T18:23:13.713237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716173+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:23:13.716173+0000","last_peered":"2024-04-23T18:23:13.716173+0000","last_clean":"2024-04-23T18:23:13.716173+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:23:13.716173+0000","last_undegraded":"2024-04-23T18:23:13.716173+0000","last_fullsized":"2024-04-23T18:23:13.716173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724257+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:23:13.724257+0000","last_peered":"2024-04-23T18:23:13.724257+0000","last_clean":"2024-04-23T18:23:13.724257+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:23:13.724257+0000","last_undegraded":"2024-04-23T18:23:13.724257+0000","last_fullsized":"2024-04-23T18:23:13.724257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712704+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:23:13.712704+0000","last_peered":"2024-04-23T18:23:13.712704+0000","last_clean":"2024-04-23T18:23:13.712704+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:23:13.712704+0000","last_undegraded":"2024-04-23T18:23:13.712704+0000","last_fullsized":"2024-04-23T18:23:13.712704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:37.396053+0000","last_change":"2024-04-23T18:23:14.399300+0000","last_active":"2024-04-23T18:22:36.376251+0000","last_peered":"2024-04-23T18:22:36.376251+0000","last_clean":"2024-04-23T18:22:36.376251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T18:22:37.396053+0000","last_undegraded":"2024-04-23T18:22:37.396053+0000","last_fullsized":"2024-04-23T18:22:37.396053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715884+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:23:13.715884+0000","last_peered":"2024-04-23T18:23:13.715884+0000","last_clean":"2024-04-23T18:23:13.715884+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:23:13.715884+0000","last_undegraded":"2024-04-23T18:23:13.715884+0000","last_fullsized":"2024-04-23T18:23:13.715884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708327+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:23:13.708327+0000","last_peered":"2024-04-23T18:23:13.708327+0000","last_clean":"2024-04-23T18:23:13.708327+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:23:13.708327+0000","last_undegraded":"2024-04-23T18:23:13.708327+0000","last_fullsized":"2024-04-23T18:23:13.708327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.720845+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:23:13.720845+0000","last_peered":"2024-04-23T18:23:13.720845+0000","last_clean":"2024-04-23T18:23:13.720845+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:23:13.720845+0000","last_undegraded":"2024-04-23T18:23:13.720845+0000","last_fullsized":"2024-04-23T18:23:13.720845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714022+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:23:13.714022+0000","last_peered":"2024-04-23T18:23:13.714022+0000","last_clean":"2024-04-23T18:23:13.714022+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:23:13.714022+0000","last_undegraded":"2024-04-23T18:23:13.714022+0000","last_fullsized":"2024-04-23T18:23:13.714022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714003+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:23:13.714003+0000","last_peered":"2024-04-23T18:23:13.714003+0000","last_clean":"2024-04-23T18:23:13.714003+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:23:13.714003+0000","last_undegraded":"2024-04-23T18:23:13.714003+0000","last_fullsized":"2024-04-23T18:23:13.714003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704014+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:23:13.704014+0000","last_peered":"2024-04-23T18:23:13.704014+0000","last_clean":"2024-04-23T18:23:13.704014+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:23:13.704014+0000","last_undegraded":"2024-04-23T18:23:13.704014+0000","last_fullsized":"2024-04-23T18:23:13.704014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713743+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:23:13.713743+0000","last_peered":"2024-04-23T18:23:13.713743+0000","last_clean":"2024-04-23T18:23:13.713743+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:23:13.713743+0000","last_undegraded":"2024-04-23T18:23:13.713743+0000","last_fullsized":"2024-04-23T18:23:13.713743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714758+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:23:13.714758+0000","last_peered":"2024-04-23T18:23:13.714758+0000","last_clean":"2024-04-23T18:23:13.714758+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:23:13.714758+0000","last_undegraded":"2024-04-23T18:23:13.714758+0000","last_fullsized":"2024-04-23T18:23:13.714758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704911+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:23:13.704911+0000","last_peered":"2024-04-23T18:23:13.704911+0000","last_clean":"2024-04-23T18:23:13.704911+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:23:13.704911+0000","last_undegraded":"2024-04-23T18:23:13.704911+0000","last_fullsized":"2024-04-23T18:23:13.704911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712345+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:23:13.712345+0000","last_peered":"2024-04-23T18:23:13.712345+0000","last_clean":"2024-04-23T18:23:13.712345+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:23:13.712345+0000","last_undegraded":"2024-04-23T18:23:13.712345+0000","last_fullsized":"2024-04-23T18:23:13.712345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707146+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:23:13.707146+0000","last_peered":"2024-04-23T18:23:13.707146+0000","last_clean":"2024-04-23T18:23:13.707146+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:23:13.707146+0000","last_undegraded":"2024-04-23T18:23:13.707146+0000","last_fullsized":"2024-04-23T18:23:13.707146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711003+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:23:13.711003+0000","last_peered":"2024-04-23T18:23:13.711003+0000","last_clean":"2024-04-23T18:23:13.711003+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:23:13.711003+0000","last_undegraded":"2024-04-23T18:23:13.711003+0000","last_fullsized":"2024-04-23T18:23:13.711003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.714572+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:23:13.714572+0000","last_peered":"2024-04-23T18:23:13.714572+0000","last_clean":"2024-04-23T18:23:13.714572+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:23:13.714572+0000","last_undegraded":"2024-04-23T18:23:13.714572+0000","last_fullsized":"2024-04-23T18:23:13.714572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704115+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:23:13.704115+0000","last_peered":"2024-04-23T18:23:13.704115+0000","last_clean":"2024-04-23T18:23:13.704115+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:23:13.704115+0000","last_undegraded":"2024-04-23T18:23:13.704115+0000","last_fullsized":"2024-04-23T18:23:13.704115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704366+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:23:13.704366+0000","last_peered":"2024-04-23T18:23:13.704366+0000","last_clean":"2024-04-23T18:23:13.704366+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:23:13.704366+0000","last_undegraded":"2024-04-23T18:23:13.704366+0000","last_fullsized":"2024-04-23T18:23:13.704366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716051+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:23:13.716051+0000","last_peered":"2024-04-23T18:23:13.716051+0000","last_clean":"2024-04-23T18:23:13.716051+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:23:13.716051+0000","last_undegraded":"2024-04-23T18:23:13.716051+0000","last_fullsized":"2024-04-23T18:23:13.716051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713149+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:23:13.713149+0000","last_peered":"2024-04-23T18:23:13.713149+0000","last_clean":"2024-04-23T18:23:13.713149+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:23:13.713149+0000","last_undegraded":"2024-04-23T18:23:13.713149+0000","last_fullsized":"2024-04-23T18:23:13.713149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709902+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:23:13.709902+0000","last_peered":"2024-04-23T18:23:13.709902+0000","last_clean":"2024-04-23T18:23:13.709902+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:23:13.709902+0000","last_undegraded":"2024-04-23T18:23:13.709902+0000","last_fullsized":"2024-04-23T18:23:13.709902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705652+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:23:13.705652+0000","last_peered":"2024-04-23T18:23:13.705652+0000","last_clean":"2024-04-23T18:23:13.705652+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:23:13.705652+0000","last_undegraded":"2024-04-23T18:23:13.705652+0000","last_fullsized":"2024-04-23T18:23:13.705652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715614+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:23:13.715614+0000","last_peered":"2024-04-23T18:23:13.715614+0000","last_clean":"2024-04-23T18:23:13.715614+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:23:13.715614+0000","last_undegraded":"2024-04-23T18:23:13.715614+0000","last_fullsized":"2024-04-23T18:23:13.715614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704937+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:23:13.704937+0000","last_peered":"2024-04-23T18:23:13.704937+0000","last_clean":"2024-04-23T18:23:13.704937+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:23:13.704937+0000","last_undegraded":"2024-04-23T18:23:13.704937+0000","last_fullsized":"2024-04-23T18:23:13.704937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707678+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:23:13.707678+0000","last_peered":"2024-04-23T18:23:13.707678+0000","last_clean":"2024-04-23T18:23:13.707678+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:23:13.707678+0000","last_undegraded":"2024-04-23T18:23:13.707678+0000","last_fullsized":"2024-04-23T18:23:13.707678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.709677+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:23:13.709677+0000","last_peered":"2024-04-23T18:23:13.709677+0000","last_clean":"2024-04-23T18:23:13.709677+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:23:13.709677+0000","last_undegraded":"2024-04-23T18:23:13.709677+0000","last_fullsized":"2024-04-23T18:23:13.709677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716889+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:23:13.716889+0000","last_peered":"2024-04-23T18:23:13.716889+0000","last_clean":"2024-04-23T18:23:13.716889+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:23:13.716889+0000","last_undegraded":"2024-04-23T18:23:13.716889+0000","last_fullsized":"2024-04-23T18:23:13.716889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713039+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:23:13.713039+0000","last_peered":"2024-04-23T18:23:13.713039+0000","last_clean":"2024-04-23T18:23:13.713039+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:23:13.713039+0000","last_undegraded":"2024-04-23T18:23:13.713039+0000","last_fullsized":"2024-04-23T18:23:13.713039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705260+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:23:13.705260+0000","last_peered":"2024-04-23T18:23:13.705260+0000","last_clean":"2024-04-23T18:23:13.705260+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:23:13.705260+0000","last_undegraded":"2024-04-23T18:23:13.705260+0000","last_fullsized":"2024-04-23T18:23:13.705260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708044+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:23:13.708044+0000","last_peered":"2024-04-23T18:23:13.708044+0000","last_clean":"2024-04-23T18:23:13.708044+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:23:13.708044+0000","last_undegraded":"2024-04-23T18:23:13.708044+0000","last_fullsized":"2024-04-23T18:23:13.708044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715561+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:23:13.715561+0000","last_peered":"2024-04-23T18:23:13.715561+0000","last_clean":"2024-04-23T18:23:13.715561+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:23:13.715561+0000","last_undegraded":"2024-04-23T18:23:13.715561+0000","last_fullsized":"2024-04-23T18:23:13.715561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.705373+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:23:13.705373+0000","last_peered":"2024-04-23T18:23:13.705373+0000","last_clean":"2024-04-23T18:23:13.705373+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:23:13.705373+0000","last_undegraded":"2024-04-23T18:23:13.705373+0000","last_fullsized":"2024-04-23T18:23:13.705373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710750+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:23:13.710750+0000","last_peered":"2024-04-23T18:23:13.710750+0000","last_clean":"2024-04-23T18:23:13.710750+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:23:13.710750+0000","last_undegraded":"2024-04-23T18:23:13.710750+0000","last_fullsized":"2024-04-23T18:23:13.710750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704180+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:23:13.704180+0000","last_peered":"2024-04-23T18:23:13.704180+0000","last_clean":"2024-04-23T18:23:13.704180+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:23:13.704180+0000","last_undegraded":"2024-04-23T18:23:13.704180+0000","last_fullsized":"2024-04-23T18:23:13.704180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":2,"reported_epoch":25,"state":"peering","last_fresh":"2024-04-23T18:22:38.519804+0000","last_change":"2024-04-23T18:23:14.398989+0000","last_active":"2024-04-23T18:23:14.398989+0000","last_peered":"2024-04-23T18:22:38.519804+0000","last_clean":"2024-04-23T18:22:38.519804+0000","last_became_active":"2024-04-23T18:22:33.396752+0000","last_became_peered":"2024-04-23T18:22:33.396752+0000","last_unstale":"2024-04-23T18:22:38.519804+0000","last_undegraded":"2024-04-23T18:22:38.519804+0000","last_fullsized":"2024-04-23T18:22:38.519804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712922+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:23:13.712922+0000","last_peered":"2024-04-23T18:23:13.712922+0000","last_clean":"2024-04-23T18:23:13.712922+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:23:13.712922+0000","last_undegraded":"2024-04-23T18:23:13.712922+0000","last_fullsized":"2024-04-23T18:23:13.712922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712299+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:23:13.712299+0000","last_peered":"2024-04-23T18:23:13.712299+0000","last_clean":"2024-04-23T18:23:13.712299+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:23:13.712299+0000","last_undegraded":"2024-04-23T18:23:13.712299+0000","last_fullsized":"2024-04-23T18:23:13.712299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724741+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:23:13.724741+0000","last_peered":"2024-04-23T18:23:13.724741+0000","last_clean":"2024-04-23T18:23:13.724741+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:23:13.724741+0000","last_undegraded":"2024-04-23T18:23:13.724741+0000","last_fullsized":"2024-04-23T18:23:13.724741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.711311+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:23:13.711311+0000","last_peered":"2024-04-23T18:23:13.711311+0000","last_clean":"2024-04-23T18:23:13.711311+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:23:13.711311+0000","last_undegraded":"2024-04-23T18:23:13.711311+0000","last_fullsized":"2024-04-23T18:23:13.711311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.716888+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:23:13.716888+0000","last_peered":"2024-04-23T18:23:13.716888+0000","last_clean":"2024-04-23T18:23:13.716888+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:23:13.716888+0000","last_undegraded":"2024-04-23T18:23:13.716888+0000","last_fullsized":"2024-04-23T18:23:13.716888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.710505+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:23:13.710505+0000","last_peered":"2024-04-23T18:23:13.710505+0000","last_clean":"2024-04-23T18:23:13.710505+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:23:13.710505+0000","last_undegraded":"2024-04-23T18:23:13.710505+0000","last_fullsized":"2024-04-23T18:23:13.710505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.707148+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:23:13.707148+0000","last_peered":"2024-04-23T18:23:13.707148+0000","last_clean":"2024-04-23T18:23:13.707148+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:23:13.707148+0000","last_undegraded":"2024-04-23T18:23:13.707148+0000","last_fullsized":"2024-04-23T18:23:13.707148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.712966+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:23:13.712966+0000","last_peered":"2024-04-23T18:23:13.712966+0000","last_clean":"2024-04-23T18:23:13.712966+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:23:13.712966+0000","last_undegraded":"2024-04-23T18:23:13.712966+0000","last_fullsized":"2024-04-23T18:23:13.712966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.704612+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:23:13.704612+0000","last_peered":"2024-04-23T18:23:13.704612+0000","last_clean":"2024-04-23T18:23:13.704612+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:23:13.704612+0000","last_undegraded":"2024-04-23T18:23:13.704612+0000","last_fullsized":"2024-04-23T18:23:13.704612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715731+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:23:13.715731+0000","last_peered":"2024-04-23T18:23:13.715731+0000","last_clean":"2024-04-23T18:23:13.715731+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:23:13.715731+0000","last_undegraded":"2024-04-23T18:23:13.715731+0000","last_fullsized":"2024-04-23T18:23:13.715731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713268+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:23:13.713268+0000","last_peered":"2024-04-23T18:23:13.713268+0000","last_clean":"2024-04-23T18:23:13.713268+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:23:13.713268+0000","last_undegraded":"2024-04-23T18:23:13.713268+0000","last_fullsized":"2024-04-23T18:23:13.713268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.715336+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:23:13.715336+0000","last_peered":"2024-04-23T18:23:13.715336+0000","last_clean":"2024-04-23T18:23:13.715336+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:23:13.715336+0000","last_undegraded":"2024-04-23T18:23:13.715336+0000","last_fullsized":"2024-04-23T18:23:13.715336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.725146+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:23:13.725146+0000","last_peered":"2024-04-23T18:23:13.725146+0000","last_clean":"2024-04-23T18:23:13.725146+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:23:13.725146+0000","last_undegraded":"2024-04-23T18:23:13.725146+0000","last_fullsized":"2024-04-23T18:23:13.725146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"peering","last_fresh":"2024-04-23T18:22:38.511717+0000","last_change":"2024-04-23T18:23:13.704483+0000","last_active":"2024-04-23T18:23:13.704483+0000","last_peered":"2024-04-23T18:22:38.511717+0000","last_clean":"2024-04-23T18:22:38.511717+0000","last_became_active":"2024-04-23T18:22:33.397476+0000","last_became_peered":"2024-04-23T18:22:33.397476+0000","last_unstale":"2024-04-23T18:22:38.511717+0000","last_undegraded":"2024-04-23T18:22:38.511717+0000","last_fullsized":"2024-04-23T18:22:38.511717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.723094+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:23:13.723094+0000","last_peered":"2024-04-23T18:23:13.723094+0000","last_clean":"2024-04-23T18:23:13.723094+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:23:13.723094+0000","last_undegraded":"2024-04-23T18:23:13.723094+0000","last_fullsized":"2024-04-23T18:23:13.723094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713507+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:23:13.713507+0000","last_peered":"2024-04-23T18:23:13.713507+0000","last_clean":"2024-04-23T18:23:13.713507+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:23:13.713507+0000","last_undegraded":"2024-04-23T18:23:13.713507+0000","last_fullsized":"2024-04-23T18:23:13.713507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.722558+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:23:13.722558+0000","last_peered":"2024-04-23T18:23:13.722558+0000","last_clean":"2024-04-23T18:23:13.722558+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:23:13.722558+0000","last_undegraded":"2024-04-23T18:23:13.722558+0000","last_fullsized":"2024-04-23T18:23:13.722558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713966+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:23:13.713966+0000","last_peered":"2024-04-23T18:23:13.713966+0000","last_clean":"2024-04-23T18:23:13.713966+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:23:13.713966+0000","last_undegraded":"2024-04-23T18:23:13.713966+0000","last_fullsized":"2024-04-23T18:23:13.713966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.713681+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:23:13.713681+0000","last_peered":"2024-04-23T18:23:13.713681+0000","last_clean":"2024-04-23T18:23:13.713681+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:23:13.713681+0000","last_undegraded":"2024-04-23T18:23:13.713681+0000","last_fullsized":"2024-04-23T18:23:13.713681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.708751+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:23:13.708751+0000","last_peered":"2024-04-23T18:23:13.708751+0000","last_clean":"2024-04-23T18:23:13.708751+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:23:13.708751+0000","last_undegraded":"2024-04-23T18:23:13.708751+0000","last_fullsized":"2024-04-23T18:23:13.708751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-23T18:23:13.724963+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:23:13.724963+0000","last_peered":"2024-04-23T18:23:13.724963+0000","last_clean":"2024-04-23T18:23:13.724963+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:23:13.724963+0000","last_undegraded":"2024-04-23T18:23:13.724963+0000","last_fullsized":"2024-04-23T18:23:13.724963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":699078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":108772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":101228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":111948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":286720,"data_stored":108212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":108338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":698422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:23:22.387 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:23:22.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.543+0000 7f2d7f800640 1 Processor -- start 2024-04-23T18:23:22.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.543+0000 7f2d7f800640 1 -- start start 2024-04-23T18:23:22.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d780738c0 0x7f2d780c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7f800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2d780c79e0 0x7f2d7815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7f800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d78075970 con 0x7f2d780b2310 2024-04-23T18:23:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7f800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f2d7806cbd0 con 0x7f2d780c79e0 2024-04-23T18:23:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2d78155a70 con 0x7f2d780738c0 2024-04-23T18:23:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7d800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2d780c79e0 0x7f2d7815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d77e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2d780b2310 0x7f2d780c2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49958/0 (socket says 172.21.15.28:49958) 2024-04-23T18:23:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d77e00640 1 -- 172.21.15.28:0/697379220 learned_addr learned my addr 172.21.15.28:0/697379220 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7d800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2d780c79e0 0x7f2d7815b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49780/0 (socket says 172.21.15.28:49780) 2024-04-23T18:23:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7ce00640 1 --2- 172.21.15.28:0/697379220 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d780738c0 0x7f2d780c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7d800640 1 -- 172.21.15.28:0/697379220 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d780738c0 msgr2=0x7f2d780c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:22.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7d800640 1 --2- 172.21.15.28:0/697379220 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d780738c0 0x7f2d780c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7d800640 1 -- 172.21.15.28:0/697379220 >> v1:172.21.15.28:6789/0 conn(0x7f2d780b2310 legacy=0x7f2d780c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:22.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.547+0000 7f2d7d800640 1 -- 172.21.15.28:0/697379220 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d78075c10 con 0x7f2d780c79e0 2024-04-23T18:23:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d7d800640 1 --2- 172.21.15.28:0/697379220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2d780c79e0 0x7f2d7815b2a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009d90 tx=0x7f2d7001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc5ca5d31bb6c41 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d77400640 1 -- 172.21.15.28:0/697379220 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d700b4070 con 0x7f2d780c79e0 2024-04-23T18:23:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d77400640 1 -- 172.21.15.28:0/697379220 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d700af600 con 0x7f2d780c79e0 2024-04-23T18:23:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d77400640 1 -- 172.21.15.28:0/697379220 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d700af9d0 con 0x7f2d780c79e0 2024-04-23T18:23:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d7f800640 1 -- 172.21.15.28:0/697379220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2d780c79e0 msgr2=0x7f2d7815b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d7f800640 1 --2- 172.21.15.28:0/697379220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2d780c79e0 0x7f2d7815b2a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009d90 tx=0x7f2d7001f150 comp rx=0 tx=0).stop 2024-04-23T18:23:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d7f800640 1 -- 172.21.15.28:0/697379220 shutdown_connections 2024-04-23T18:23:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d7f800640 1 --2- 172.21.15.28:0/697379220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2d780c79e0 0x7f2d7815b2a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d7f800640 1 --2- 172.21.15.28:0/697379220 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d780738c0 0x7f2d780c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d7f800640 1 -- 172.21.15.28:0/697379220 >> 172.21.15.28:0/697379220 conn(0x7f2d780ccfe0 msgr2=0x7f2d780cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:22.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d7f800640 1 -- 172.21.15.28:0/697379220 shutdown_connections 2024-04-23T18:23:22.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d7f800640 1 -- 172.21.15.28:0/697379220 wait complete. 2024-04-23T18:23:22.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d7f800640 1 Processor -- start 2024-04-23T18:23:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.551+0000 7f2d7f800640 1 -- start start 2024-04-23T18:23:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7f800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2d780738c0 0x7f2d7815c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d780b2310 0x7f2d781f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d780c79e0 0x7f2d780b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7f800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2d780c90a0 con 0x7f2d780738c0 2024-04-23T18:23:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2d780c4240 con 0x7f2d780b2310 2024-04-23T18:23:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2d780c2710 con 0x7f2d780c79e0 2024-04-23T18:23:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7ce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2d780738c0 0x7f2d7815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7ce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2d780738c0 0x7f2d7815c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49796/0 (socket says 172.21.15.28:49796) 2024-04-23T18:23:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7ce00640 1 -- 172.21.15.28:0/1027764191 learned_addr learned my addr 172.21.15.28:0/1027764191 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d77e00640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d780b2310 0x7f2d781f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7d800640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d780c79e0 0x7f2d780b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7ce00640 1 -- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d780c79e0 msgr2=0x7f2d780b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7ce00640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d780c79e0 0x7f2d780b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7ce00640 1 -- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d780b2310 msgr2=0x7f2d781f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7ce00640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d780b2310 0x7f2d781f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7ce00640 1 -- 172.21.15.28:0/1027764191 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d781f20a0 con 0x7f2d780738c0 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7d800640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d780c79e0 0x7f2d780b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7ce00640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2d780738c0 0x7f2d7815c400 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00d830 tx=0x7f2d6c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d74c00640 1 -- 172.21.15.28:0/1027764191 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00b6c0 con 0x7f2d780738c0 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d74c00640 1 -- 172.21.15.28:0/1027764191 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c019070 con 0x7f2d780738c0 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d74c00640 1 -- 172.21.15.28:0/1027764191 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00ba60 con 0x7f2d780738c0 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7f800640 1 -- 172.21.15.28:0/1027764191 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7815cab0 con 0x7f2d780738c0 2024-04-23T18:23:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7f800640 1 -- 172.21.15.28:0/1027764191 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7815d070 con 0x7f2d780738c0 2024-04-23T18:23:22.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d7f800640 1 -- 172.21.15.28:0/1027764191 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d78068cd0 con 0x7f2d780738c0 2024-04-23T18:23:22.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.555+0000 7f2d74c00640 1 -- 172.21.15.28:0/1027764191 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d6c01e460 con 0x7f2d780738c0 2024-04-23T18:23:22.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.559+0000 7f2d74c00640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2d58068380 0x7f2d5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.559+0000 7f2d74c00640 1 -- 172.21.15.28:0/1027764191 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2d6c0875b0 con 0x7f2d780738c0 2024-04-23T18:23:22.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.559+0000 7f2d77e00640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2d58068380 0x7f2d5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.559+0000 7f2d77e00640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2d58068380 0x7f2d5806a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2d780b1480 tx=0x7f2d64009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.563+0000 7f2d74c00640 1 -- 172.21.15.28:0/1027764191 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d6c057640 con 0x7f2d780738c0 2024-04-23T18:23:22.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.723+0000 7f2d7f800640 1 -- 172.21.15.28:0/1027764191 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d78075690 con 0x7f2d58068380 2024-04-23T18:23:22.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.747+0000 7f2d74c00640 1 -- 172.21.15.28:0/1027764191 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332662 (secure 0 0 0) 0x7f2d78075690 con 0x7f2d58068380 2024-04-23T18:23:22.746 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:22.748 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:23:22.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 -- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2d58068380 msgr2=0x7f2d5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:22.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2d58068380 0x7f2d5806a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2d780b1480 tx=0x7f2d64009040 comp rx=0 tx=0).stop 2024-04-23T18:23:22.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 -- 172.21.15.28:0/1027764191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2d780738c0 msgr2=0x7f2d7815c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:22.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2d780738c0 0x7f2d7815c400 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00d830 tx=0x7f2d6c00dcf0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 -- 172.21.15.28:0/1027764191 shutdown_connections 2024-04-23T18:23:22.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2d58068380 0x7f2d5806a840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2d780c79e0 0x7f2d780b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2d780b2310 0x7f2d781f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 --2- 172.21.15.28:0/1027764191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2d780738c0 0x7f2d7815c400 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 -- 172.21.15.28:0/1027764191 >> 172.21.15.28:0/1027764191 conn(0x7f2d780ccfe0 msgr2=0x7f2d7806e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:22.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 -- 172.21.15.28:0/1027764191 shutdown_connections 2024-04-23T18:23:22.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.751+0000 7f2d7f800640 1 -- 172.21.15.28:0/1027764191 wait complete. 2024-04-23T18:23:22.767 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-04-23T18:23:21.337315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232156,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742564,"statfs":{"total":773094113280,"available":772856385536,"internally_reserved":0,"allocated":3579904,"data_stored":2111044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":258,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002415"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720048+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:23:14.720048+0000","last_peered":"2024-04-23T18:23:14.720048+0000","last_clean":"2024-04-23T18:23:14.720048+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:23:14.720048+0000","last_undegraded":"2024-04-23T18:23:14.720048+0000","last_fullsized":"2024-04-23T18:23:14.720048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.723733+0000","last_change":"2024-04-23T18:23:14.723733+0000","last_active":"2024-04-23T18:23:14.723733+0000","last_peered":"2024-04-23T18:23:14.723733+0000","last_clean":"2024-04-23T18:23:14.723733+0000","last_became_active":"2024-04-23T18:23:14.723423+0000","last_became_peered":"2024-04-23T18:23:14.723423+0000","last_unstale":"2024-04-23T18:23:14.723733+0000","last_undegraded":"2024-04-23T18:23:14.723733+0000","last_fullsized":"2024-04-23T18:23:14.723733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:28:08.520812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716440+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:23:14.716440+0000","last_peered":"2024-04-23T18:23:14.716440+0000","last_clean":"2024-04-23T18:23:14.716440+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:23:14.716440+0000","last_undegraded":"2024-04-23T18:23:14.716440+0000","last_fullsized":"2024-04-23T18:23:14.716440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716917+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:23:14.716917+0000","last_peered":"2024-04-23T18:23:14.716917+0000","last_clean":"2024-04-23T18:23:14.716917+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:23:14.716917+0000","last_undegraded":"2024-04-23T18:23:14.716917+0000","last_fullsized":"2024-04-23T18:23:14.716917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719959+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:23:14.719959+0000","last_peered":"2024-04-23T18:23:14.719959+0000","last_clean":"2024-04-23T18:23:14.719959+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:23:14.719959+0000","last_undegraded":"2024-04-23T18:23:14.719959+0000","last_fullsized":"2024-04-23T18:23:14.719959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716999+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:23:14.716999+0000","last_peered":"2024-04-23T18:23:14.716999+0000","last_clean":"2024-04-23T18:23:14.716999+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:23:14.716999+0000","last_undegraded":"2024-04-23T18:23:14.716999+0000","last_fullsized":"2024-04-23T18:23:14.716999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786679+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:23:14.786679+0000","last_peered":"2024-04-23T18:23:14.786679+0000","last_clean":"2024-04-23T18:23:14.786679+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:23:14.786679+0000","last_undegraded":"2024-04-23T18:23:14.786679+0000","last_fullsized":"2024-04-23T18:23:14.786679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726701+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:23:14.726701+0000","last_peered":"2024-04-23T18:23:14.726701+0000","last_clean":"2024-04-23T18:23:14.726701+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:23:14.726701+0000","last_undegraded":"2024-04-23T18:23:14.726701+0000","last_fullsized":"2024-04-23T18:23:14.726701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718807+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:23:14.718807+0000","last_peered":"2024-04-23T18:23:14.718807+0000","last_clean":"2024-04-23T18:23:14.718807+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:23:14.718807+0000","last_undegraded":"2024-04-23T18:23:14.718807+0000","last_fullsized":"2024-04-23T18:23:14.718807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785845+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:23:14.785845+0000","last_peered":"2024-04-23T18:23:14.785845+0000","last_clean":"2024-04-23T18:23:14.785845+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:23:14.785845+0000","last_undegraded":"2024-04-23T18:23:14.785845+0000","last_fullsized":"2024-04-23T18:23:14.785845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727443+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:23:14.727443+0000","last_peered":"2024-04-23T18:23:14.727443+0000","last_clean":"2024-04-23T18:23:14.727443+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:23:14.727443+0000","last_undegraded":"2024-04-23T18:23:14.727443+0000","last_fullsized":"2024-04-23T18:23:14.727443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717439+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:23:14.717439+0000","last_peered":"2024-04-23T18:23:14.717439+0000","last_clean":"2024-04-23T18:23:14.717439+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:23:14.717439+0000","last_undegraded":"2024-04-23T18:23:14.717439+0000","last_fullsized":"2024-04-23T18:23:14.717439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717804+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:23:14.717804+0000","last_peered":"2024-04-23T18:23:14.717804+0000","last_clean":"2024-04-23T18:23:14.717804+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:23:14.717804+0000","last_undegraded":"2024-04-23T18:23:14.717804+0000","last_fullsized":"2024-04-23T18:23:14.717804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786164+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:23:14.786164+0000","last_peered":"2024-04-23T18:23:14.786164+0000","last_clean":"2024-04-23T18:23:14.786164+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:23:14.786164+0000","last_undegraded":"2024-04-23T18:23:14.786164+0000","last_fullsized":"2024-04-23T18:23:14.786164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720834+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:23:14.720834+0000","last_peered":"2024-04-23T18:23:14.720834+0000","last_clean":"2024-04-23T18:23:14.720834+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:23:14.720834+0000","last_undegraded":"2024-04-23T18:23:14.720834+0000","last_fullsized":"2024-04-23T18:23:14.720834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716667+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:23:14.716667+0000","last_peered":"2024-04-23T18:23:14.716667+0000","last_clean":"2024-04-23T18:23:14.716667+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:23:14.716667+0000","last_undegraded":"2024-04-23T18:23:14.716667+0000","last_fullsized":"2024-04-23T18:23:14.716667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785349+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:23:14.785349+0000","last_peered":"2024-04-23T18:23:14.785349+0000","last_clean":"2024-04-23T18:23:14.785349+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:23:14.785349+0000","last_undegraded":"2024-04-23T18:23:14.785349+0000","last_fullsized":"2024-04-23T18:23:14.785349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719508+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:23:14.719508+0000","last_peered":"2024-04-23T18:23:14.719508+0000","last_clean":"2024-04-23T18:23:14.719508+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:23:14.719508+0000","last_undegraded":"2024-04-23T18:23:14.719508+0000","last_fullsized":"2024-04-23T18:23:14.719508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.715782+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:23:14.715782+0000","last_peered":"2024-04-23T18:23:14.715782+0000","last_clean":"2024-04-23T18:23:14.715782+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:23:14.715782+0000","last_undegraded":"2024-04-23T18:23:14.715782+0000","last_fullsized":"2024-04-23T18:23:14.715782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785129+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:23:14.785129+0000","last_peered":"2024-04-23T18:23:14.785129+0000","last_clean":"2024-04-23T18:23:14.785129+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:23:14.785129+0000","last_undegraded":"2024-04-23T18:23:14.785129+0000","last_fullsized":"2024-04-23T18:23:14.785129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785881+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:23:14.785881+0000","last_peered":"2024-04-23T18:23:14.785881+0000","last_clean":"2024-04-23T18:23:14.785881+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:23:14.785881+0000","last_undegraded":"2024-04-23T18:23:14.785881+0000","last_fullsized":"2024-04-23T18:23:14.785881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718375+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:23:14.718375+0000","last_peered":"2024-04-23T18:23:14.718375+0000","last_clean":"2024-04-23T18:23:14.718375+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:23:14.718375+0000","last_undegraded":"2024-04-23T18:23:14.718375+0000","last_fullsized":"2024-04-23T18:23:14.718375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785579+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:23:14.785579+0000","last_peered":"2024-04-23T18:23:14.785579+0000","last_clean":"2024-04-23T18:23:14.785579+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:23:14.785579+0000","last_undegraded":"2024-04-23T18:23:14.785579+0000","last_fullsized":"2024-04-23T18:23:14.785579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719152+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:23:14.719152+0000","last_peered":"2024-04-23T18:23:14.719152+0000","last_clean":"2024-04-23T18:23:14.719152+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:23:14.719152+0000","last_undegraded":"2024-04-23T18:23:14.719152+0000","last_fullsized":"2024-04-23T18:23:14.719152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720490+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:23:14.720490+0000","last_peered":"2024-04-23T18:23:14.720490+0000","last_clean":"2024-04-23T18:23:14.720490+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:23:14.720490+0000","last_undegraded":"2024-04-23T18:23:14.720490+0000","last_fullsized":"2024-04-23T18:23:14.720490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720768+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:23:14.720768+0000","last_peered":"2024-04-23T18:23:14.720768+0000","last_clean":"2024-04-23T18:23:14.720768+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:23:14.720768+0000","last_undegraded":"2024-04-23T18:23:14.720768+0000","last_fullsized":"2024-04-23T18:23:14.720768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717864+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:23:14.717864+0000","last_peered":"2024-04-23T18:23:14.717864+0000","last_clean":"2024-04-23T18:23:14.717864+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:23:14.717864+0000","last_undegraded":"2024-04-23T18:23:14.717864+0000","last_fullsized":"2024-04-23T18:23:14.717864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716665+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:23:14.716665+0000","last_peered":"2024-04-23T18:23:14.716665+0000","last_clean":"2024-04-23T18:23:14.716665+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:23:14.716665+0000","last_undegraded":"2024-04-23T18:23:14.716665+0000","last_fullsized":"2024-04-23T18:23:14.716665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786066+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:23:14.786066+0000","last_peered":"2024-04-23T18:23:14.786066+0000","last_clean":"2024-04-23T18:23:14.786066+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:23:14.786066+0000","last_undegraded":"2024-04-23T18:23:14.786066+0000","last_fullsized":"2024-04-23T18:23:14.786066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.715351+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:23:14.715351+0000","last_peered":"2024-04-23T18:23:14.715351+0000","last_clean":"2024-04-23T18:23:14.715351+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:23:14.715351+0000","last_undegraded":"2024-04-23T18:23:14.715351+0000","last_fullsized":"2024-04-23T18:23:14.715351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785661+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:23:14.785661+0000","last_peered":"2024-04-23T18:23:14.785661+0000","last_clean":"2024-04-23T18:23:14.785661+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:23:14.785661+0000","last_undegraded":"2024-04-23T18:23:14.785661+0000","last_fullsized":"2024-04-23T18:23:14.785661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786983+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:23:14.786983+0000","last_peered":"2024-04-23T18:23:14.786983+0000","last_clean":"2024-04-23T18:23:14.786983+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:23:14.786983+0000","last_undegraded":"2024-04-23T18:23:14.786983+0000","last_fullsized":"2024-04-23T18:23:14.786983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719126+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:23:14.719126+0000","last_peered":"2024-04-23T18:23:14.719126+0000","last_clean":"2024-04-23T18:23:14.719126+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:23:14.719126+0000","last_undegraded":"2024-04-23T18:23:14.719126+0000","last_fullsized":"2024-04-23T18:23:14.719126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727755+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:23:14.727755+0000","last_peered":"2024-04-23T18:23:14.727755+0000","last_clean":"2024-04-23T18:23:14.727755+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:23:14.727755+0000","last_undegraded":"2024-04-23T18:23:14.727755+0000","last_fullsized":"2024-04-23T18:23:14.727755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785774+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:23:14.785774+0000","last_peered":"2024-04-23T18:23:14.785774+0000","last_clean":"2024-04-23T18:23:14.785774+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:23:14.785774+0000","last_undegraded":"2024-04-23T18:23:14.785774+0000","last_fullsized":"2024-04-23T18:23:14.785774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785067+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:23:14.785067+0000","last_peered":"2024-04-23T18:23:14.785067+0000","last_clean":"2024-04-23T18:23:14.785067+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:23:14.785067+0000","last_undegraded":"2024-04-23T18:23:14.785067+0000","last_fullsized":"2024-04-23T18:23:14.785067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719826+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:23:14.719826+0000","last_peered":"2024-04-23T18:23:14.719826+0000","last_clean":"2024-04-23T18:23:14.719826+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:23:14.719826+0000","last_undegraded":"2024-04-23T18:23:14.719826+0000","last_fullsized":"2024-04-23T18:23:14.719826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727647+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:23:14.727647+0000","last_peered":"2024-04-23T18:23:14.727647+0000","last_clean":"2024-04-23T18:23:14.727647+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:23:14.727647+0000","last_undegraded":"2024-04-23T18:23:14.727647+0000","last_fullsized":"2024-04-23T18:23:14.727647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785661+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:23:14.785661+0000","last_peered":"2024-04-23T18:23:14.785661+0000","last_clean":"2024-04-23T18:23:14.785661+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:23:14.785661+0000","last_undegraded":"2024-04-23T18:23:14.785661+0000","last_fullsized":"2024-04-23T18:23:14.785661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785439+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:23:14.785439+0000","last_peered":"2024-04-23T18:23:14.785439+0000","last_clean":"2024-04-23T18:23:14.785439+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:23:14.785439+0000","last_undegraded":"2024-04-23T18:23:14.785439+0000","last_fullsized":"2024-04-23T18:23:14.785439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719226+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:23:14.719226+0000","last_peered":"2024-04-23T18:23:14.719226+0000","last_clean":"2024-04-23T18:23:14.719226+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:23:14.719226+0000","last_undegraded":"2024-04-23T18:23:14.719226+0000","last_fullsized":"2024-04-23T18:23:14.719226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.730523+0000","last_change":"2024-04-23T18:23:14.730523+0000","last_active":"2024-04-23T18:23:14.730523+0000","last_peered":"2024-04-23T18:23:14.730523+0000","last_clean":"2024-04-23T18:23:14.730523+0000","last_became_active":"2024-04-23T18:23:14.729941+0000","last_became_peered":"2024-04-23T18:23:14.729941+0000","last_unstale":"2024-04-23T18:23:14.730523+0000","last_undegraded":"2024-04-23T18:23:14.730523+0000","last_fullsized":"2024-04-23T18:23:14.730523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:54.938281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718289+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:23:14.718289+0000","last_peered":"2024-04-23T18:23:14.718289+0000","last_clean":"2024-04-23T18:23:14.718289+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:23:14.718289+0000","last_undegraded":"2024-04-23T18:23:14.718289+0000","last_fullsized":"2024-04-23T18:23:14.718289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785120+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:23:14.785120+0000","last_peered":"2024-04-23T18:23:14.785120+0000","last_clean":"2024-04-23T18:23:14.785120+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:23:14.785120+0000","last_undegraded":"2024-04-23T18:23:14.785120+0000","last_fullsized":"2024-04-23T18:23:14.785120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720358+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:23:14.720358+0000","last_peered":"2024-04-23T18:23:14.720358+0000","last_clean":"2024-04-23T18:23:14.720358+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:23:14.720358+0000","last_undegraded":"2024-04-23T18:23:14.720358+0000","last_fullsized":"2024-04-23T18:23:14.720358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716356+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:23:14.716356+0000","last_peered":"2024-04-23T18:23:14.716356+0000","last_clean":"2024-04-23T18:23:14.716356+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:23:14.716356+0000","last_undegraded":"2024-04-23T18:23:14.716356+0000","last_fullsized":"2024-04-23T18:23:14.716356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726479+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:23:14.726479+0000","last_peered":"2024-04-23T18:23:14.726479+0000","last_clean":"2024-04-23T18:23:14.726479+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:23:14.726479+0000","last_undegraded":"2024-04-23T18:23:14.726479+0000","last_fullsized":"2024-04-23T18:23:14.726479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785469+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:23:14.785469+0000","last_peered":"2024-04-23T18:23:14.785469+0000","last_clean":"2024-04-23T18:23:14.785469+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:23:14.785469+0000","last_undegraded":"2024-04-23T18:23:14.785469+0000","last_fullsized":"2024-04-23T18:23:14.785469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718385+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:23:14.718385+0000","last_peered":"2024-04-23T18:23:14.718385+0000","last_clean":"2024-04-23T18:23:14.718385+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:23:14.718385+0000","last_undegraded":"2024-04-23T18:23:14.718385+0000","last_fullsized":"2024-04-23T18:23:14.718385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786333+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:23:14.786333+0000","last_peered":"2024-04-23T18:23:14.786333+0000","last_clean":"2024-04-23T18:23:14.786333+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:23:14.786333+0000","last_undegraded":"2024-04-23T18:23:14.786333+0000","last_fullsized":"2024-04-23T18:23:14.786333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718528+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:23:14.718528+0000","last_peered":"2024-04-23T18:23:14.718528+0000","last_clean":"2024-04-23T18:23:14.718528+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:23:14.718528+0000","last_undegraded":"2024-04-23T18:23:14.718528+0000","last_fullsized":"2024-04-23T18:23:14.718528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717503+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:23:14.717503+0000","last_peered":"2024-04-23T18:23:14.717503+0000","last_clean":"2024-04-23T18:23:14.717503+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:23:14.717503+0000","last_undegraded":"2024-04-23T18:23:14.717503+0000","last_fullsized":"2024-04-23T18:23:14.717503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726989+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:23:14.726989+0000","last_peered":"2024-04-23T18:23:14.726989+0000","last_clean":"2024-04-23T18:23:14.726989+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:23:14.726989+0000","last_undegraded":"2024-04-23T18:23:14.726989+0000","last_fullsized":"2024-04-23T18:23:14.726989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785757+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:23:14.785757+0000","last_peered":"2024-04-23T18:23:14.785757+0000","last_clean":"2024-04-23T18:23:14.785757+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:23:14.785757+0000","last_undegraded":"2024-04-23T18:23:14.785757+0000","last_fullsized":"2024-04-23T18:23:14.785757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.728059+0000","last_change":"2024-04-23T18:23:14.728059+0000","last_active":"2024-04-23T18:23:14.728059+0000","last_peered":"2024-04-23T18:23:14.728059+0000","last_clean":"2024-04-23T18:23:14.728059+0000","last_became_active":"2024-04-23T18:23:14.727676+0000","last_became_peered":"2024-04-23T18:23:14.727676+0000","last_unstale":"2024-04-23T18:23:14.728059+0000","last_undegraded":"2024-04-23T18:23:14.728059+0000","last_fullsized":"2024-04-23T18:23:14.728059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:26.449657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786784+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:23:14.786784+0000","last_peered":"2024-04-23T18:23:14.786784+0000","last_clean":"2024-04-23T18:23:14.786784+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:23:14.786784+0000","last_undegraded":"2024-04-23T18:23:14.786784+0000","last_fullsized":"2024-04-23T18:23:14.786784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718568+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:23:14.718568+0000","last_peered":"2024-04-23T18:23:14.718568+0000","last_clean":"2024-04-23T18:23:14.718568+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:23:14.718568+0000","last_undegraded":"2024-04-23T18:23:14.718568+0000","last_fullsized":"2024-04-23T18:23:14.718568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.724384+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:23:14.724384+0000","last_peered":"2024-04-23T18:23:14.724384+0000","last_clean":"2024-04-23T18:23:14.724384+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:23:14.724384+0000","last_undegraded":"2024-04-23T18:23:14.724384+0000","last_fullsized":"2024-04-23T18:23:14.724384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786335+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:23:14.786335+0000","last_peered":"2024-04-23T18:23:14.786335+0000","last_clean":"2024-04-23T18:23:14.786335+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:23:14.786335+0000","last_undegraded":"2024-04-23T18:23:14.786335+0000","last_fullsized":"2024-04-23T18:23:14.786335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720263+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:23:14.720263+0000","last_peered":"2024-04-23T18:23:14.720263+0000","last_clean":"2024-04-23T18:23:14.720263+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:23:14.720263+0000","last_undegraded":"2024-04-23T18:23:14.720263+0000","last_fullsized":"2024-04-23T18:23:14.720263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716932+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:23:14.716932+0000","last_peered":"2024-04-23T18:23:14.716932+0000","last_clean":"2024-04-23T18:23:14.716932+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:23:14.716932+0000","last_undegraded":"2024-04-23T18:23:14.716932+0000","last_fullsized":"2024-04-23T18:23:14.716932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.723945+0000","last_change":"2024-04-23T18:23:14.723945+0000","last_active":"2024-04-23T18:23:14.723945+0000","last_peered":"2024-04-23T18:23:14.723945+0000","last_clean":"2024-04-23T18:23:14.723945+0000","last_became_active":"2024-04-23T18:23:14.723676+0000","last_became_peered":"2024-04-23T18:23:14.723676+0000","last_unstale":"2024-04-23T18:23:14.723945+0000","last_undegraded":"2024-04-23T18:23:14.723945+0000","last_fullsized":"2024-04-23T18:23:14.723945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:46.330533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717858+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:23:14.717858+0000","last_peered":"2024-04-23T18:23:14.717858+0000","last_clean":"2024-04-23T18:23:14.717858+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:23:14.717858+0000","last_undegraded":"2024-04-23T18:23:14.717858+0000","last_fullsized":"2024-04-23T18:23:14.717858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720260+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:23:14.720260+0000","last_peered":"2024-04-23T18:23:14.720260+0000","last_clean":"2024-04-23T18:23:14.720260+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:23:14.720260+0000","last_undegraded":"2024-04-23T18:23:14.720260+0000","last_fullsized":"2024-04-23T18:23:14.720260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719088+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:23:14.719088+0000","last_peered":"2024-04-23T18:23:14.719088+0000","last_clean":"2024-04-23T18:23:14.719088+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:23:14.719088+0000","last_undegraded":"2024-04-23T18:23:14.719088+0000","last_fullsized":"2024-04-23T18:23:14.719088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718085+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:23:14.718085+0000","last_peered":"2024-04-23T18:23:14.718085+0000","last_clean":"2024-04-23T18:23:14.718085+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:23:14.718085+0000","last_undegraded":"2024-04-23T18:23:14.718085+0000","last_fullsized":"2024-04-23T18:23:14.718085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716759+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:23:14.716759+0000","last_peered":"2024-04-23T18:23:14.716759+0000","last_clean":"2024-04-23T18:23:14.716759+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:23:14.716759+0000","last_undegraded":"2024-04-23T18:23:14.716759+0000","last_fullsized":"2024-04-23T18:23:14.716759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785879+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:23:14.785879+0000","last_peered":"2024-04-23T18:23:14.785879+0000","last_clean":"2024-04-23T18:23:14.785879+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:23:14.785879+0000","last_undegraded":"2024-04-23T18:23:14.785879+0000","last_fullsized":"2024-04-23T18:23:14.785879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727384+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:23:14.727384+0000","last_peered":"2024-04-23T18:23:14.727384+0000","last_clean":"2024-04-23T18:23:14.727384+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:23:14.727384+0000","last_undegraded":"2024-04-23T18:23:14.727384+0000","last_fullsized":"2024-04-23T18:23:14.727384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717167+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:23:14.717167+0000","last_peered":"2024-04-23T18:23:14.717167+0000","last_clean":"2024-04-23T18:23:14.717167+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:23:14.717167+0000","last_undegraded":"2024-04-23T18:23:14.717167+0000","last_fullsized":"2024-04-23T18:23:14.717167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718932+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:23:14.718932+0000","last_peered":"2024-04-23T18:23:14.718932+0000","last_clean":"2024-04-23T18:23:14.718932+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:23:14.718932+0000","last_undegraded":"2024-04-23T18:23:14.718932+0000","last_fullsized":"2024-04-23T18:23:14.718932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719601+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:23:14.719601+0000","last_peered":"2024-04-23T18:23:14.719601+0000","last_clean":"2024-04-23T18:23:14.719601+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:23:14.719601+0000","last_undegraded":"2024-04-23T18:23:14.719601+0000","last_fullsized":"2024-04-23T18:23:14.719601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727150+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:23:14.727150+0000","last_peered":"2024-04-23T18:23:14.727150+0000","last_clean":"2024-04-23T18:23:14.727150+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:23:14.727150+0000","last_undegraded":"2024-04-23T18:23:14.727150+0000","last_fullsized":"2024-04-23T18:23:14.727150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786068+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:23:14.786068+0000","last_peered":"2024-04-23T18:23:14.786068+0000","last_clean":"2024-04-23T18:23:14.786068+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:23:14.786068+0000","last_undegraded":"2024-04-23T18:23:14.786068+0000","last_fullsized":"2024-04-23T18:23:14.786068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719278+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:23:14.719278+0000","last_peered":"2024-04-23T18:23:14.719278+0000","last_clean":"2024-04-23T18:23:14.719278+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:23:14.719278+0000","last_undegraded":"2024-04-23T18:23:14.719278+0000","last_fullsized":"2024-04-23T18:23:14.719278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.730758+0000","last_change":"2024-04-23T18:23:14.730758+0000","last_active":"2024-04-23T18:23:14.730758+0000","last_peered":"2024-04-23T18:23:14.730758+0000","last_clean":"2024-04-23T18:23:14.730758+0000","last_became_active":"2024-04-23T18:23:14.729264+0000","last_became_peered":"2024-04-23T18:23:14.729264+0000","last_unstale":"2024-04-23T18:23:14.730758+0000","last_undegraded":"2024-04-23T18:23:14.730758+0000","last_fullsized":"2024-04-23T18:23:14.730758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:25:09.741395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720212+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:23:14.720212+0000","last_peered":"2024-04-23T18:23:14.720212+0000","last_clean":"2024-04-23T18:23:14.720212+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:23:14.720212+0000","last_undegraded":"2024-04-23T18:23:14.720212+0000","last_fullsized":"2024-04-23T18:23:14.720212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785748+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:23:14.785748+0000","last_peered":"2024-04-23T18:23:14.785748+0000","last_clean":"2024-04-23T18:23:14.785748+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:23:14.785748+0000","last_undegraded":"2024-04-23T18:23:14.785748+0000","last_fullsized":"2024-04-23T18:23:14.785748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719388+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:23:14.719388+0000","last_peered":"2024-04-23T18:23:14.719388+0000","last_clean":"2024-04-23T18:23:14.719388+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:23:14.719388+0000","last_undegraded":"2024-04-23T18:23:14.719388+0000","last_fullsized":"2024-04-23T18:23:14.719388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720016+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:23:14.720016+0000","last_peered":"2024-04-23T18:23:14.720016+0000","last_clean":"2024-04-23T18:23:14.720016+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:23:14.720016+0000","last_undegraded":"2024-04-23T18:23:14.720016+0000","last_fullsized":"2024-04-23T18:23:14.720016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727603+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:23:14.727603+0000","last_peered":"2024-04-23T18:23:14.727603+0000","last_clean":"2024-04-23T18:23:14.727603+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:23:14.727603+0000","last_undegraded":"2024-04-23T18:23:14.727603+0000","last_fullsized":"2024-04-23T18:23:14.727603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.715596+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:23:14.715596+0000","last_peered":"2024-04-23T18:23:14.715596+0000","last_clean":"2024-04-23T18:23:14.715596+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:23:14.715596+0000","last_undegraded":"2024-04-23T18:23:14.715596+0000","last_fullsized":"2024-04-23T18:23:14.715596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727332+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:23:14.727332+0000","last_peered":"2024-04-23T18:23:14.727332+0000","last_clean":"2024-04-23T18:23:14.727332+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:23:14.727332+0000","last_undegraded":"2024-04-23T18:23:14.727332+0000","last_fullsized":"2024-04-23T18:23:14.727332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720337+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:23:14.720337+0000","last_peered":"2024-04-23T18:23:14.720337+0000","last_clean":"2024-04-23T18:23:14.720337+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:23:14.720337+0000","last_undegraded":"2024-04-23T18:23:14.720337+0000","last_fullsized":"2024-04-23T18:23:14.720337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.715979+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:23:14.715979+0000","last_peered":"2024-04-23T18:23:14.715979+0000","last_clean":"2024-04-23T18:23:14.715979+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:23:14.715979+0000","last_undegraded":"2024-04-23T18:23:14.715979+0000","last_fullsized":"2024-04-23T18:23:14.715979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720157+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:23:14.720157+0000","last_peered":"2024-04-23T18:23:14.720157+0000","last_clean":"2024-04-23T18:23:14.720157+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:23:14.720157+0000","last_undegraded":"2024-04-23T18:23:14.720157+0000","last_fullsized":"2024-04-23T18:23:14.720157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785006+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:23:14.785006+0000","last_peered":"2024-04-23T18:23:14.785006+0000","last_clean":"2024-04-23T18:23:14.785006+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:23:14.785006+0000","last_undegraded":"2024-04-23T18:23:14.785006+0000","last_fullsized":"2024-04-23T18:23:14.785006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.725673+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:23:14.725673+0000","last_peered":"2024-04-23T18:23:14.725673+0000","last_clean":"2024-04-23T18:23:14.725673+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:23:14.725673+0000","last_undegraded":"2024-04-23T18:23:14.725673+0000","last_fullsized":"2024-04-23T18:23:14.725673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719897+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:23:14.719897+0000","last_peered":"2024-04-23T18:23:14.719897+0000","last_clean":"2024-04-23T18:23:14.719897+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:23:14.719897+0000","last_undegraded":"2024-04-23T18:23:14.719897+0000","last_fullsized":"2024-04-23T18:23:14.719897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.715698+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:23:14.715698+0000","last_peered":"2024-04-23T18:23:14.715698+0000","last_clean":"2024-04-23T18:23:14.715698+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:23:14.715698+0000","last_undegraded":"2024-04-23T18:23:14.715698+0000","last_fullsized":"2024-04-23T18:23:14.715698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716298+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:23:14.716298+0000","last_peered":"2024-04-23T18:23:14.716298+0000","last_clean":"2024-04-23T18:23:14.716298+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:23:14.716298+0000","last_undegraded":"2024-04-23T18:23:14.716298+0000","last_fullsized":"2024-04-23T18:23:14.716298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718177+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:23:14.718177+0000","last_peered":"2024-04-23T18:23:14.718177+0000","last_clean":"2024-04-23T18:23:14.718177+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:23:14.718177+0000","last_undegraded":"2024-04-23T18:23:14.718177+0000","last_fullsized":"2024-04-23T18:23:14.718177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719510+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:23:14.719510+0000","last_peered":"2024-04-23T18:23:14.719510+0000","last_clean":"2024-04-23T18:23:14.719510+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:23:14.719510+0000","last_undegraded":"2024-04-23T18:23:14.719510+0000","last_fullsized":"2024-04-23T18:23:14.719510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718303+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:23:14.718303+0000","last_peered":"2024-04-23T18:23:14.718303+0000","last_clean":"2024-04-23T18:23:14.718303+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:23:14.718303+0000","last_undegraded":"2024-04-23T18:23:14.718303+0000","last_fullsized":"2024-04-23T18:23:14.718303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716780+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:23:14.716780+0000","last_peered":"2024-04-23T18:23:14.716780+0000","last_clean":"2024-04-23T18:23:14.716780+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:23:14.716780+0000","last_undegraded":"2024-04-23T18:23:14.716780+0000","last_fullsized":"2024-04-23T18:23:14.716780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717854+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:23:14.717854+0000","last_peered":"2024-04-23T18:23:14.717854+0000","last_clean":"2024-04-23T18:23:14.717854+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:23:14.717854+0000","last_undegraded":"2024-04-23T18:23:14.717854+0000","last_fullsized":"2024-04-23T18:23:14.717854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717198+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:23:14.717198+0000","last_peered":"2024-04-23T18:23:14.717198+0000","last_clean":"2024-04-23T18:23:14.717198+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:23:14.717198+0000","last_undegraded":"2024-04-23T18:23:14.717198+0000","last_fullsized":"2024-04-23T18:23:14.717198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718028+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:23:14.718028+0000","last_peered":"2024-04-23T18:23:14.718028+0000","last_clean":"2024-04-23T18:23:14.718028+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:23:14.718028+0000","last_undegraded":"2024-04-23T18:23:14.718028+0000","last_fullsized":"2024-04-23T18:23:14.718028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719096+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:23:14.719096+0000","last_peered":"2024-04-23T18:23:14.719096+0000","last_clean":"2024-04-23T18:23:14.719096+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:23:14.719096+0000","last_undegraded":"2024-04-23T18:23:14.719096+0000","last_fullsized":"2024-04-23T18:23:14.719096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726974+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:23:14.726974+0000","last_peered":"2024-04-23T18:23:14.726974+0000","last_clean":"2024-04-23T18:23:14.726974+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:23:14.726974+0000","last_undegraded":"2024-04-23T18:23:14.726974+0000","last_fullsized":"2024-04-23T18:23:14.726974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719410+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:23:14.719410+0000","last_peered":"2024-04-23T18:23:14.719410+0000","last_clean":"2024-04-23T18:23:14.719410+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:23:14.719410+0000","last_undegraded":"2024-04-23T18:23:14.719410+0000","last_fullsized":"2024-04-23T18:23:14.719410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717413+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:23:14.717413+0000","last_peered":"2024-04-23T18:23:14.717413+0000","last_clean":"2024-04-23T18:23:14.717413+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:23:14.717413+0000","last_undegraded":"2024-04-23T18:23:14.717413+0000","last_fullsized":"2024-04-23T18:23:14.717413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785648+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:23:14.785648+0000","last_peered":"2024-04-23T18:23:14.785648+0000","last_clean":"2024-04-23T18:23:14.785648+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:23:14.785648+0000","last_undegraded":"2024-04-23T18:23:14.785648+0000","last_fullsized":"2024-04-23T18:23:14.785648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720102+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:23:14.720102+0000","last_peered":"2024-04-23T18:23:14.720102+0000","last_clean":"2024-04-23T18:23:14.720102+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:23:14.720102+0000","last_undegraded":"2024-04-23T18:23:14.720102+0000","last_fullsized":"2024-04-23T18:23:14.720102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716562+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:23:14.716562+0000","last_peered":"2024-04-23T18:23:14.716562+0000","last_clean":"2024-04-23T18:23:14.716562+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:23:14.716562+0000","last_undegraded":"2024-04-23T18:23:14.716562+0000","last_fullsized":"2024-04-23T18:23:14.716562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.725409+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:23:14.725409+0000","last_peered":"2024-04-23T18:23:14.725409+0000","last_clean":"2024-04-23T18:23:14.725409+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:23:14.725409+0000","last_undegraded":"2024-04-23T18:23:14.725409+0000","last_fullsized":"2024-04-23T18:23:14.725409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716135+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:23:14.716135+0000","last_peered":"2024-04-23T18:23:14.716135+0000","last_clean":"2024-04-23T18:23:14.716135+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:23:14.716135+0000","last_undegraded":"2024-04-23T18:23:14.716135+0000","last_fullsized":"2024-04-23T18:23:14.716135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.787713+0000","last_change":"2024-04-23T18:23:14.787713+0000","last_active":"2024-04-23T18:23:14.787713+0000","last_peered":"2024-04-23T18:23:14.787713+0000","last_clean":"2024-04-23T18:23:14.787713+0000","last_became_active":"2024-04-23T18:23:14.787340+0000","last_became_peered":"2024-04-23T18:23:14.787340+0000","last_unstale":"2024-04-23T18:23:14.787713+0000","last_undegraded":"2024-04-23T18:23:14.787713+0000","last_fullsized":"2024-04-23T18:23:14.787713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:44:54.939264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719231+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:23:14.719231+0000","last_peered":"2024-04-23T18:23:14.719231+0000","last_clean":"2024-04-23T18:23:14.719231+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:23:14.719231+0000","last_undegraded":"2024-04-23T18:23:14.719231+0000","last_fullsized":"2024-04-23T18:23:14.719231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719014+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:23:14.719014+0000","last_peered":"2024-04-23T18:23:14.719014+0000","last_clean":"2024-04-23T18:23:14.719014+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:23:14.719014+0000","last_undegraded":"2024-04-23T18:23:14.719014+0000","last_fullsized":"2024-04-23T18:23:14.719014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786787+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:23:14.786787+0000","last_peered":"2024-04-23T18:23:14.786787+0000","last_clean":"2024-04-23T18:23:14.786787+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:23:14.786787+0000","last_undegraded":"2024-04-23T18:23:14.786787+0000","last_fullsized":"2024-04-23T18:23:14.786787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718479+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:23:14.718479+0000","last_peered":"2024-04-23T18:23:14.718479+0000","last_clean":"2024-04-23T18:23:14.718479+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:23:14.718479+0000","last_undegraded":"2024-04-23T18:23:14.718479+0000","last_fullsized":"2024-04-23T18:23:14.718479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.728196+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:23:14.728196+0000","last_peered":"2024-04-23T18:23:14.728196+0000","last_clean":"2024-04-23T18:23:14.728196+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:23:14.728196+0000","last_undegraded":"2024-04-23T18:23:14.728196+0000","last_fullsized":"2024-04-23T18:23:14.728196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.725144+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:23:14.725144+0000","last_peered":"2024-04-23T18:23:14.725144+0000","last_clean":"2024-04-23T18:23:14.725144+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:23:14.725144+0000","last_undegraded":"2024-04-23T18:23:14.725144+0000","last_fullsized":"2024-04-23T18:23:14.725144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785074+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:23:14.785074+0000","last_peered":"2024-04-23T18:23:14.785074+0000","last_clean":"2024-04-23T18:23:14.785074+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:23:14.785074+0000","last_undegraded":"2024-04-23T18:23:14.785074+0000","last_fullsized":"2024-04-23T18:23:14.785074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718841+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:23:14.718841+0000","last_peered":"2024-04-23T18:23:14.718841+0000","last_clean":"2024-04-23T18:23:14.718841+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:23:14.718841+0000","last_undegraded":"2024-04-23T18:23:14.718841+0000","last_fullsized":"2024-04-23T18:23:14.718841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716572+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:23:14.716572+0000","last_peered":"2024-04-23T18:23:14.716572+0000","last_clean":"2024-04-23T18:23:14.716572+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:23:14.716572+0000","last_undegraded":"2024-04-23T18:23:14.716572+0000","last_fullsized":"2024-04-23T18:23:14.716572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719965+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:23:14.719965+0000","last_peered":"2024-04-23T18:23:14.719965+0000","last_clean":"2024-04-23T18:23:14.719965+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:23:14.719965+0000","last_undegraded":"2024-04-23T18:23:14.719965+0000","last_fullsized":"2024-04-23T18:23:14.719965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718809+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:23:14.718809+0000","last_peered":"2024-04-23T18:23:14.718809+0000","last_clean":"2024-04-23T18:23:14.718809+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:23:14.718809+0000","last_undegraded":"2024-04-23T18:23:14.718809+0000","last_fullsized":"2024-04-23T18:23:14.718809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719820+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:23:14.719820+0000","last_peered":"2024-04-23T18:23:14.719820+0000","last_clean":"2024-04-23T18:23:14.719820+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:23:14.719820+0000","last_undegraded":"2024-04-23T18:23:14.719820+0000","last_fullsized":"2024-04-23T18:23:14.719820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786748+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:23:14.786748+0000","last_peered":"2024-04-23T18:23:14.786748+0000","last_clean":"2024-04-23T18:23:14.786748+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:23:14.786748+0000","last_undegraded":"2024-04-23T18:23:14.786748+0000","last_fullsized":"2024-04-23T18:23:14.786748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.787765+0000","last_change":"2024-04-23T18:23:14.787765+0000","last_active":"2024-04-23T18:23:14.787765+0000","last_peered":"2024-04-23T18:23:14.787765+0000","last_clean":"2024-04-23T18:23:14.787765+0000","last_became_active":"2024-04-23T18:23:14.787444+0000","last_became_peered":"2024-04-23T18:23:14.787444+0000","last_unstale":"2024-04-23T18:23:14.787765+0000","last_undegraded":"2024-04-23T18:23:14.787765+0000","last_fullsized":"2024-04-23T18:23:14.787765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:12.714842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785324+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:23:14.785324+0000","last_peered":"2024-04-23T18:23:14.785324+0000","last_clean":"2024-04-23T18:23:14.785324+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:23:14.785324+0000","last_undegraded":"2024-04-23T18:23:14.785324+0000","last_fullsized":"2024-04-23T18:23:14.785324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726690+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:23:14.726690+0000","last_peered":"2024-04-23T18:23:14.726690+0000","last_clean":"2024-04-23T18:23:14.726690+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:23:14.726690+0000","last_undegraded":"2024-04-23T18:23:14.726690+0000","last_fullsized":"2024-04-23T18:23:14.726690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785630+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:23:14.785630+0000","last_peered":"2024-04-23T18:23:14.785630+0000","last_clean":"2024-04-23T18:23:14.785630+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:23:14.785630+0000","last_undegraded":"2024-04-23T18:23:14.785630+0000","last_fullsized":"2024-04-23T18:23:14.785630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726614+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:23:14.726614+0000","last_peered":"2024-04-23T18:23:14.726614+0000","last_clean":"2024-04-23T18:23:14.726614+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:23:14.726614+0000","last_undegraded":"2024-04-23T18:23:14.726614+0000","last_fullsized":"2024-04-23T18:23:14.726614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719851+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:23:14.719851+0000","last_peered":"2024-04-23T18:23:14.719851+0000","last_clean":"2024-04-23T18:23:14.719851+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:23:14.719851+0000","last_undegraded":"2024-04-23T18:23:14.719851+0000","last_fullsized":"2024-04-23T18:23:14.719851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786008+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:23:14.786008+0000","last_peered":"2024-04-23T18:23:14.786008+0000","last_clean":"2024-04-23T18:23:14.786008+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:23:14.786008+0000","last_undegraded":"2024-04-23T18:23:14.786008+0000","last_fullsized":"2024-04-23T18:23:14.786008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786608+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:23:14.786608+0000","last_peered":"2024-04-23T18:23:14.786608+0000","last_clean":"2024-04-23T18:23:14.786608+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:23:14.786608+0000","last_undegraded":"2024-04-23T18:23:14.786608+0000","last_fullsized":"2024-04-23T18:23:14.786608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":892928,"data_stored":706045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":119139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":115739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":115333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":303104,"data_stored":118915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":299008,"data_stored":115179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":115305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":888832,"data_stored":705389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:23:22.772 INFO:tasks.quiescer.ceph_manager:clean! 2024-04-23T18:23:22.772 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:23:22.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1abe600640 1 Processor -- start 2024-04-23T18:23:22.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1abe600640 1 -- start start 2024-04-23T18:23:22.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1abe600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1ab80ce990 0x7f1ab80c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1abe600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab8158e00 0x7f1ab814f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1abe600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab80c5be0 con 0x7f1ab80ced70 2024-04-23T18:23:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1abe600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1ab80c97f0 con 0x7f1ab80ce990 2024-04-23T18:23:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1abe600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab80c5e80 con 0x7f1ab8158e00 2024-04-23T18:23:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6a00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1ab80ced70 0x7f1ab80c90e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49970/0 (socket says 172.21.15.28:49970) 2024-04-23T18:23:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6a00640 1 -- 172.21.15.28:0/2392980659 learned_addr learned my addr 172.21.15.28:0/2392980659 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab7400640 1 --2- 172.21.15.28:0/2392980659 >> v2:172.21.15.137:3300/0 conn(0x7f1ab80ce990 0x7f1ab80c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab7e00640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab8158e00 0x7f1ab814f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 384139970 0 0) 0x7f1ab80c5be0 con 0x7f1ab80ced70 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a9c003530 con 0x7f1ab80ced70 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1138448254 0 0) 0x7f1a9c003530 con 0x7f1ab80ced70 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab8158e00 msgr2=0x7f1ab814f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab8158e00 0x7f1ab814f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 >> v2:172.21.15.137:3300/0 conn(0x7f1ab80ce990 msgr2=0x7f1ab80c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 --2- 172.21.15.28:0/2392980659 >> v2:172.21.15.137:3300/0 conn(0x7f1ab80ce990 0x7f1ab80c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab80c6140 con 0x7f1ab80ced70 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f1aa4001680 con 0x7f1ab80ced70 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 >> v1:172.21.15.28:6789/0 conn(0x7f1ab80ced70 legacy=0x7f1ab80c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 0x7f1a9c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a9c004810 0x7f1a9c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab8158e00 0x7f1a9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab80c97f0 con 0x7f1a9c0039c0 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab80c5e80 con 0x7f1a9c004810 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9c00b9d0 con 0x7f1ab8158e00 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab7400640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 0x7f1a9c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6a00640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a9c004810 0x7f1a9c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab7e00640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab8158e00 0x7f1a9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab7400640 1 -- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab8158e00 msgr2=0x7f1a9c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab7400640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab8158e00 0x7f1a9c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab7400640 1 -- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a9c004810 msgr2=0x7f1a9c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab7400640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a9c004810 0x7f1a9c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab7400640 1 -- 172.21.15.28:0/2392980659 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c003530 con 0x7f1a9c0039c0 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab7e00640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab8158e00 0x7f1a9c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:22.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.959+0000 7f1ab6a00640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a9c004810 0x7f1a9c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:22.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.963+0000 7f1ab7400640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 0x7f1a9c003e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009b10 tx=0x7f1aa801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f659004ac0e44582 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.963+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80b2070 con 0x7f1a9c0039c0 2024-04-23T18:23:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.963+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa80a5570 con 0x7f1a9c0039c0 2024-04-23T18:23:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.963+0000 7f1ab6000640 1 -- 172.21.15.28:0/2392980659 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80096b0 con 0x7f1a9c0039c0 2024-04-23T18:23:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.963+0000 7f1abe600640 1 -- 172.21.15.28:0/2392980659 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 msgr2=0x7f1a9c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.963+0000 7f1abe600640 1 --2- 172.21.15.28:0/2392980659 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 0x7f1a9c003e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009b10 tx=0x7f1aa801ca80 comp rx=0 tx=0).stop 2024-04-23T18:23:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.963+0000 7f1ab7e00640 1 -- 172.21.15.28:0/2392980659 reap_dead start 2024-04-23T18:23:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.963+0000 7f1abe600640 1 -- 172.21.15.28:0/2392980659 shutdown_connections 2024-04-23T18:23:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.963+0000 7f1abe600640 1 -- 172.21.15.28:0/2392980659 >> 172.21.15.28:0/2392980659 conn(0x7f1ab80709e0 msgr2=0x7f1ab8070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.963+0000 7f1abe600640 1 -- 172.21.15.28:0/2392980659 shutdown_connections 2024-04-23T18:23:22.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.963+0000 7f1abe600640 1 -- 172.21.15.28:0/2392980659 wait complete. 2024-04-23T18:23:22.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1abe600640 1 Processor -- start 2024-04-23T18:23:22.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1abe600640 1 -- start start 2024-04-23T18:23:22.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1abe600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 0x7f1ab8156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1abe600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ab806cb20 0x7f1ab80c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1abe600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab814bb60 0x7f1ab814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1abe600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab80c8b20 con 0x7f1a9c0039c0 2024-04-23T18:23:22.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1abe600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab80c80c0 con 0x7f1ab806cb20 2024-04-23T18:23:22.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1abe600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab8163780 con 0x7f1ab814bb60 2024-04-23T18:23:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1ab7400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 0x7f1ab8156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1ab7400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 0x7f1ab8156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49814/0 (socket says 172.21.15.28:49814) 2024-04-23T18:23:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1ab7400640 1 -- 172.21.15.28:0/2875410374 learned_addr learned my addr 172.21.15.28:0/2875410374 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1ab7e00640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab814bb60 0x7f1ab814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1ab6a00640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ab806cb20 0x7f1ab80c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1ab7400640 1 -- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab814bb60 msgr2=0x7f1ab814bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1ab7400640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab814bb60 0x7f1ab814bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1ab7400640 1 -- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ab806cb20 msgr2=0x7f1ab80c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1ab7400640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ab806cb20 0x7f1ab80c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1ab7400640 1 -- 172.21.15.28:0/2875410374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab81f7280 con 0x7f1a9c0039c0 2024-04-23T18:23:22.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1ab7400640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 0x7f1ab8156180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009b10 tx=0x7f1a9c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1aaf400640 1 -- 172.21.15.28:0/2875410374 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80b2040 con 0x7f1a9c0039c0 2024-04-23T18:23:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1aaf400640 1 -- 172.21.15.28:0/2875410374 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa800f000 con 0x7f1a9c0039c0 2024-04-23T18:23:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1abe600640 1 -- 172.21.15.28:0/2875410374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab806ba80 con 0x7f1a9c0039c0 2024-04-23T18:23:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1aaf400640 1 -- 172.21.15.28:0/2875410374 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8004020 con 0x7f1a9c0039c0 2024-04-23T18:23:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.967+0000 7f1abe600640 1 -- 172.21.15.28:0/2875410374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab806c040 con 0x7f1a9c0039c0 2024-04-23T18:23:22.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.971+0000 7f1abe600640 1 -- 172.21.15.28:0/2875410374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab8068cd0 con 0x7f1a9c0039c0 2024-04-23T18:23:22.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.971+0000 7f1aaf400640 1 -- 172.21.15.28:0/2875410374 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1aa80c0020 con 0x7f1a9c0039c0 2024-04-23T18:23:22.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.971+0000 7f1aaf400640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a98068380 0x7f1a9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:22.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.971+0000 7f1aaf400640 1 -- 172.21.15.28:0/2875410374 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1aa8120c20 con 0x7f1a9c0039c0 2024-04-23T18:23:22.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.971+0000 7f1ab6a00640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a98068380 0x7f1a9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:22.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.971+0000 7f1ab6a00640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a98068380 0x7f1a9806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1ab81583e0 tx=0x7f1aa4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:22.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:22.975+0000 7f1aaf400640 1 -- 172.21.15.28:0/2875410374 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1aa8016800 con 0x7f1a9c0039c0 2024-04-23T18:23:23.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.135+0000 7f1abe600640 1 -- 172.21.15.28:0/2875410374 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ab81596f0 con 0x7f1a98068380 2024-04-23T18:23:23.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.159+0000 7f1aaf400640 1 -- 172.21.15.28:0/2875410374 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332662 (secure 0 0 0) 0x7f1ab81596f0 con 0x7f1a98068380 2024-04-23T18:23:23.157 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:23.159 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:23:23.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 -- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a98068380 msgr2=0x7f1a9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a98068380 0x7f1a9806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1ab81583e0 tx=0x7f1aa4009040 comp rx=0 tx=0).stop 2024-04-23T18:23:23.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 -- 172.21.15.28:0/2875410374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 msgr2=0x7f1ab8156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 0x7f1ab8156180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009b10 tx=0x7f1a9c005840 comp rx=0 tx=0).stop 2024-04-23T18:23:23.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 -- 172.21.15.28:0/2875410374 shutdown_connections 2024-04-23T18:23:23.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a98068380 0x7f1a9806a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1ab814bb60 0x7f1ab814bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ab806cb20 0x7f1ab80c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 --2- 172.21.15.28:0/2875410374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1a9c0039c0 0x7f1ab8156180 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 -- 172.21.15.28:0/2875410374 >> 172.21.15.28:0/2875410374 conn(0x7f1ab80709e0 msgr2=0x7f1ab80cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:23.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 -- 172.21.15.28:0/2875410374 shutdown_connections 2024-04-23T18:23:23.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.163+0000 7f1abe600640 1 -- 172.21.15.28:0/2875410374 wait complete. 2024-04-23T18:23:23.177 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-04-23T18:23:21.337315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232156,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742564,"statfs":{"total":773094113280,"available":772856385536,"internally_reserved":0,"allocated":3579904,"data_stored":2111044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":258,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002415"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720048+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:23:14.720048+0000","last_peered":"2024-04-23T18:23:14.720048+0000","last_clean":"2024-04-23T18:23:14.720048+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:23:14.720048+0000","last_undegraded":"2024-04-23T18:23:14.720048+0000","last_fullsized":"2024-04-23T18:23:14.720048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.723733+0000","last_change":"2024-04-23T18:23:14.723733+0000","last_active":"2024-04-23T18:23:14.723733+0000","last_peered":"2024-04-23T18:23:14.723733+0000","last_clean":"2024-04-23T18:23:14.723733+0000","last_became_active":"2024-04-23T18:23:14.723423+0000","last_became_peered":"2024-04-23T18:23:14.723423+0000","last_unstale":"2024-04-23T18:23:14.723733+0000","last_undegraded":"2024-04-23T18:23:14.723733+0000","last_fullsized":"2024-04-23T18:23:14.723733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:28:08.520812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716440+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:23:14.716440+0000","last_peered":"2024-04-23T18:23:14.716440+0000","last_clean":"2024-04-23T18:23:14.716440+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:23:14.716440+0000","last_undegraded":"2024-04-23T18:23:14.716440+0000","last_fullsized":"2024-04-23T18:23:14.716440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716917+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:23:14.716917+0000","last_peered":"2024-04-23T18:23:14.716917+0000","last_clean":"2024-04-23T18:23:14.716917+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:23:14.716917+0000","last_undegraded":"2024-04-23T18:23:14.716917+0000","last_fullsized":"2024-04-23T18:23:14.716917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719959+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:23:14.719959+0000","last_peered":"2024-04-23T18:23:14.719959+0000","last_clean":"2024-04-23T18:23:14.719959+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:23:14.719959+0000","last_undegraded":"2024-04-23T18:23:14.719959+0000","last_fullsized":"2024-04-23T18:23:14.719959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716999+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:23:14.716999+0000","last_peered":"2024-04-23T18:23:14.716999+0000","last_clean":"2024-04-23T18:23:14.716999+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:23:14.716999+0000","last_undegraded":"2024-04-23T18:23:14.716999+0000","last_fullsized":"2024-04-23T18:23:14.716999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786679+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:23:14.786679+0000","last_peered":"2024-04-23T18:23:14.786679+0000","last_clean":"2024-04-23T18:23:14.786679+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:23:14.786679+0000","last_undegraded":"2024-04-23T18:23:14.786679+0000","last_fullsized":"2024-04-23T18:23:14.786679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726701+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:23:14.726701+0000","last_peered":"2024-04-23T18:23:14.726701+0000","last_clean":"2024-04-23T18:23:14.726701+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:23:14.726701+0000","last_undegraded":"2024-04-23T18:23:14.726701+0000","last_fullsized":"2024-04-23T18:23:14.726701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718807+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:23:14.718807+0000","last_peered":"2024-04-23T18:23:14.718807+0000","last_clean":"2024-04-23T18:23:14.718807+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:23:14.718807+0000","last_undegraded":"2024-04-23T18:23:14.718807+0000","last_fullsized":"2024-04-23T18:23:14.718807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785845+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:23:14.785845+0000","last_peered":"2024-04-23T18:23:14.785845+0000","last_clean":"2024-04-23T18:23:14.785845+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:23:14.785845+0000","last_undegraded":"2024-04-23T18:23:14.785845+0000","last_fullsized":"2024-04-23T18:23:14.785845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727443+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:23:14.727443+0000","last_peered":"2024-04-23T18:23:14.727443+0000","last_clean":"2024-04-23T18:23:14.727443+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:23:14.727443+0000","last_undegraded":"2024-04-23T18:23:14.727443+0000","last_fullsized":"2024-04-23T18:23:14.727443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717439+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:23:14.717439+0000","last_peered":"2024-04-23T18:23:14.717439+0000","last_clean":"2024-04-23T18:23:14.717439+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:23:14.717439+0000","last_undegraded":"2024-04-23T18:23:14.717439+0000","last_fullsized":"2024-04-23T18:23:14.717439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717804+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:23:14.717804+0000","last_peered":"2024-04-23T18:23:14.717804+0000","last_clean":"2024-04-23T18:23:14.717804+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:23:14.717804+0000","last_undegraded":"2024-04-23T18:23:14.717804+0000","last_fullsized":"2024-04-23T18:23:14.717804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786164+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:23:14.786164+0000","last_peered":"2024-04-23T18:23:14.786164+0000","last_clean":"2024-04-23T18:23:14.786164+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:23:14.786164+0000","last_undegraded":"2024-04-23T18:23:14.786164+0000","last_fullsized":"2024-04-23T18:23:14.786164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720834+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:23:14.720834+0000","last_peered":"2024-04-23T18:23:14.720834+0000","last_clean":"2024-04-23T18:23:14.720834+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:23:14.720834+0000","last_undegraded":"2024-04-23T18:23:14.720834+0000","last_fullsized":"2024-04-23T18:23:14.720834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716667+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:23:14.716667+0000","last_peered":"2024-04-23T18:23:14.716667+0000","last_clean":"2024-04-23T18:23:14.716667+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:23:14.716667+0000","last_undegraded":"2024-04-23T18:23:14.716667+0000","last_fullsized":"2024-04-23T18:23:14.716667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785349+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:23:14.785349+0000","last_peered":"2024-04-23T18:23:14.785349+0000","last_clean":"2024-04-23T18:23:14.785349+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:23:14.785349+0000","last_undegraded":"2024-04-23T18:23:14.785349+0000","last_fullsized":"2024-04-23T18:23:14.785349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719508+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:23:14.719508+0000","last_peered":"2024-04-23T18:23:14.719508+0000","last_clean":"2024-04-23T18:23:14.719508+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:23:14.719508+0000","last_undegraded":"2024-04-23T18:23:14.719508+0000","last_fullsized":"2024-04-23T18:23:14.719508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.715782+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:23:14.715782+0000","last_peered":"2024-04-23T18:23:14.715782+0000","last_clean":"2024-04-23T18:23:14.715782+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:23:14.715782+0000","last_undegraded":"2024-04-23T18:23:14.715782+0000","last_fullsized":"2024-04-23T18:23:14.715782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785129+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:23:14.785129+0000","last_peered":"2024-04-23T18:23:14.785129+0000","last_clean":"2024-04-23T18:23:14.785129+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:23:14.785129+0000","last_undegraded":"2024-04-23T18:23:14.785129+0000","last_fullsized":"2024-04-23T18:23:14.785129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785881+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:23:14.785881+0000","last_peered":"2024-04-23T18:23:14.785881+0000","last_clean":"2024-04-23T18:23:14.785881+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:23:14.785881+0000","last_undegraded":"2024-04-23T18:23:14.785881+0000","last_fullsized":"2024-04-23T18:23:14.785881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718375+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:23:14.718375+0000","last_peered":"2024-04-23T18:23:14.718375+0000","last_clean":"2024-04-23T18:23:14.718375+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:23:14.718375+0000","last_undegraded":"2024-04-23T18:23:14.718375+0000","last_fullsized":"2024-04-23T18:23:14.718375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785579+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:23:14.785579+0000","last_peered":"2024-04-23T18:23:14.785579+0000","last_clean":"2024-04-23T18:23:14.785579+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:23:14.785579+0000","last_undegraded":"2024-04-23T18:23:14.785579+0000","last_fullsized":"2024-04-23T18:23:14.785579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719152+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:23:14.719152+0000","last_peered":"2024-04-23T18:23:14.719152+0000","last_clean":"2024-04-23T18:23:14.719152+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:23:14.719152+0000","last_undegraded":"2024-04-23T18:23:14.719152+0000","last_fullsized":"2024-04-23T18:23:14.719152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720490+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:23:14.720490+0000","last_peered":"2024-04-23T18:23:14.720490+0000","last_clean":"2024-04-23T18:23:14.720490+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:23:14.720490+0000","last_undegraded":"2024-04-23T18:23:14.720490+0000","last_fullsized":"2024-04-23T18:23:14.720490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720768+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:23:14.720768+0000","last_peered":"2024-04-23T18:23:14.720768+0000","last_clean":"2024-04-23T18:23:14.720768+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:23:14.720768+0000","last_undegraded":"2024-04-23T18:23:14.720768+0000","last_fullsized":"2024-04-23T18:23:14.720768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717864+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:23:14.717864+0000","last_peered":"2024-04-23T18:23:14.717864+0000","last_clean":"2024-04-23T18:23:14.717864+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:23:14.717864+0000","last_undegraded":"2024-04-23T18:23:14.717864+0000","last_fullsized":"2024-04-23T18:23:14.717864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716665+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:23:14.716665+0000","last_peered":"2024-04-23T18:23:14.716665+0000","last_clean":"2024-04-23T18:23:14.716665+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:23:14.716665+0000","last_undegraded":"2024-04-23T18:23:14.716665+0000","last_fullsized":"2024-04-23T18:23:14.716665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786066+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:23:14.786066+0000","last_peered":"2024-04-23T18:23:14.786066+0000","last_clean":"2024-04-23T18:23:14.786066+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:23:14.786066+0000","last_undegraded":"2024-04-23T18:23:14.786066+0000","last_fullsized":"2024-04-23T18:23:14.786066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.715351+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:23:14.715351+0000","last_peered":"2024-04-23T18:23:14.715351+0000","last_clean":"2024-04-23T18:23:14.715351+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:23:14.715351+0000","last_undegraded":"2024-04-23T18:23:14.715351+0000","last_fullsized":"2024-04-23T18:23:14.715351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785661+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:23:14.785661+0000","last_peered":"2024-04-23T18:23:14.785661+0000","last_clean":"2024-04-23T18:23:14.785661+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:23:14.785661+0000","last_undegraded":"2024-04-23T18:23:14.785661+0000","last_fullsized":"2024-04-23T18:23:14.785661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786983+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:23:14.786983+0000","last_peered":"2024-04-23T18:23:14.786983+0000","last_clean":"2024-04-23T18:23:14.786983+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:23:14.786983+0000","last_undegraded":"2024-04-23T18:23:14.786983+0000","last_fullsized":"2024-04-23T18:23:14.786983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719126+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:23:14.719126+0000","last_peered":"2024-04-23T18:23:14.719126+0000","last_clean":"2024-04-23T18:23:14.719126+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:23:14.719126+0000","last_undegraded":"2024-04-23T18:23:14.719126+0000","last_fullsized":"2024-04-23T18:23:14.719126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727755+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:23:14.727755+0000","last_peered":"2024-04-23T18:23:14.727755+0000","last_clean":"2024-04-23T18:23:14.727755+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:23:14.727755+0000","last_undegraded":"2024-04-23T18:23:14.727755+0000","last_fullsized":"2024-04-23T18:23:14.727755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785774+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:23:14.785774+0000","last_peered":"2024-04-23T18:23:14.785774+0000","last_clean":"2024-04-23T18:23:14.785774+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:23:14.785774+0000","last_undegraded":"2024-04-23T18:23:14.785774+0000","last_fullsized":"2024-04-23T18:23:14.785774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785067+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:23:14.785067+0000","last_peered":"2024-04-23T18:23:14.785067+0000","last_clean":"2024-04-23T18:23:14.785067+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:23:14.785067+0000","last_undegraded":"2024-04-23T18:23:14.785067+0000","last_fullsized":"2024-04-23T18:23:14.785067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719826+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:23:14.719826+0000","last_peered":"2024-04-23T18:23:14.719826+0000","last_clean":"2024-04-23T18:23:14.719826+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:23:14.719826+0000","last_undegraded":"2024-04-23T18:23:14.719826+0000","last_fullsized":"2024-04-23T18:23:14.719826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727647+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:23:14.727647+0000","last_peered":"2024-04-23T18:23:14.727647+0000","last_clean":"2024-04-23T18:23:14.727647+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:23:14.727647+0000","last_undegraded":"2024-04-23T18:23:14.727647+0000","last_fullsized":"2024-04-23T18:23:14.727647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785661+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:23:14.785661+0000","last_peered":"2024-04-23T18:23:14.785661+0000","last_clean":"2024-04-23T18:23:14.785661+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:23:14.785661+0000","last_undegraded":"2024-04-23T18:23:14.785661+0000","last_fullsized":"2024-04-23T18:23:14.785661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785439+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:23:14.785439+0000","last_peered":"2024-04-23T18:23:14.785439+0000","last_clean":"2024-04-23T18:23:14.785439+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:23:14.785439+0000","last_undegraded":"2024-04-23T18:23:14.785439+0000","last_fullsized":"2024-04-23T18:23:14.785439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719226+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:23:14.719226+0000","last_peered":"2024-04-23T18:23:14.719226+0000","last_clean":"2024-04-23T18:23:14.719226+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:23:14.719226+0000","last_undegraded":"2024-04-23T18:23:14.719226+0000","last_fullsized":"2024-04-23T18:23:14.719226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.730523+0000","last_change":"2024-04-23T18:23:14.730523+0000","last_active":"2024-04-23T18:23:14.730523+0000","last_peered":"2024-04-23T18:23:14.730523+0000","last_clean":"2024-04-23T18:23:14.730523+0000","last_became_active":"2024-04-23T18:23:14.729941+0000","last_became_peered":"2024-04-23T18:23:14.729941+0000","last_unstale":"2024-04-23T18:23:14.730523+0000","last_undegraded":"2024-04-23T18:23:14.730523+0000","last_fullsized":"2024-04-23T18:23:14.730523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:54.938281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718289+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:23:14.718289+0000","last_peered":"2024-04-23T18:23:14.718289+0000","last_clean":"2024-04-23T18:23:14.718289+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:23:14.718289+0000","last_undegraded":"2024-04-23T18:23:14.718289+0000","last_fullsized":"2024-04-23T18:23:14.718289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785120+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:23:14.785120+0000","last_peered":"2024-04-23T18:23:14.785120+0000","last_clean":"2024-04-23T18:23:14.785120+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:23:14.785120+0000","last_undegraded":"2024-04-23T18:23:14.785120+0000","last_fullsized":"2024-04-23T18:23:14.785120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720358+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:23:14.720358+0000","last_peered":"2024-04-23T18:23:14.720358+0000","last_clean":"2024-04-23T18:23:14.720358+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:23:14.720358+0000","last_undegraded":"2024-04-23T18:23:14.720358+0000","last_fullsized":"2024-04-23T18:23:14.720358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716356+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:23:14.716356+0000","last_peered":"2024-04-23T18:23:14.716356+0000","last_clean":"2024-04-23T18:23:14.716356+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:23:14.716356+0000","last_undegraded":"2024-04-23T18:23:14.716356+0000","last_fullsized":"2024-04-23T18:23:14.716356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726479+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:23:14.726479+0000","last_peered":"2024-04-23T18:23:14.726479+0000","last_clean":"2024-04-23T18:23:14.726479+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:23:14.726479+0000","last_undegraded":"2024-04-23T18:23:14.726479+0000","last_fullsized":"2024-04-23T18:23:14.726479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785469+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:23:14.785469+0000","last_peered":"2024-04-23T18:23:14.785469+0000","last_clean":"2024-04-23T18:23:14.785469+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:23:14.785469+0000","last_undegraded":"2024-04-23T18:23:14.785469+0000","last_fullsized":"2024-04-23T18:23:14.785469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718385+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:23:14.718385+0000","last_peered":"2024-04-23T18:23:14.718385+0000","last_clean":"2024-04-23T18:23:14.718385+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:23:14.718385+0000","last_undegraded":"2024-04-23T18:23:14.718385+0000","last_fullsized":"2024-04-23T18:23:14.718385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786333+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:23:14.786333+0000","last_peered":"2024-04-23T18:23:14.786333+0000","last_clean":"2024-04-23T18:23:14.786333+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:23:14.786333+0000","last_undegraded":"2024-04-23T18:23:14.786333+0000","last_fullsized":"2024-04-23T18:23:14.786333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718528+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:23:14.718528+0000","last_peered":"2024-04-23T18:23:14.718528+0000","last_clean":"2024-04-23T18:23:14.718528+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:23:14.718528+0000","last_undegraded":"2024-04-23T18:23:14.718528+0000","last_fullsized":"2024-04-23T18:23:14.718528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717503+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:23:14.717503+0000","last_peered":"2024-04-23T18:23:14.717503+0000","last_clean":"2024-04-23T18:23:14.717503+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:23:14.717503+0000","last_undegraded":"2024-04-23T18:23:14.717503+0000","last_fullsized":"2024-04-23T18:23:14.717503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726989+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:23:14.726989+0000","last_peered":"2024-04-23T18:23:14.726989+0000","last_clean":"2024-04-23T18:23:14.726989+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:23:14.726989+0000","last_undegraded":"2024-04-23T18:23:14.726989+0000","last_fullsized":"2024-04-23T18:23:14.726989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785757+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:23:14.785757+0000","last_peered":"2024-04-23T18:23:14.785757+0000","last_clean":"2024-04-23T18:23:14.785757+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:23:14.785757+0000","last_undegraded":"2024-04-23T18:23:14.785757+0000","last_fullsized":"2024-04-23T18:23:14.785757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.728059+0000","last_change":"2024-04-23T18:23:14.728059+0000","last_active":"2024-04-23T18:23:14.728059+0000","last_peered":"2024-04-23T18:23:14.728059+0000","last_clean":"2024-04-23T18:23:14.728059+0000","last_became_active":"2024-04-23T18:23:14.727676+0000","last_became_peered":"2024-04-23T18:23:14.727676+0000","last_unstale":"2024-04-23T18:23:14.728059+0000","last_undegraded":"2024-04-23T18:23:14.728059+0000","last_fullsized":"2024-04-23T18:23:14.728059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:26.449657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786784+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:23:14.786784+0000","last_peered":"2024-04-23T18:23:14.786784+0000","last_clean":"2024-04-23T18:23:14.786784+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:23:14.786784+0000","last_undegraded":"2024-04-23T18:23:14.786784+0000","last_fullsized":"2024-04-23T18:23:14.786784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718568+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:23:14.718568+0000","last_peered":"2024-04-23T18:23:14.718568+0000","last_clean":"2024-04-23T18:23:14.718568+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:23:14.718568+0000","last_undegraded":"2024-04-23T18:23:14.718568+0000","last_fullsized":"2024-04-23T18:23:14.718568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.724384+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:23:14.724384+0000","last_peered":"2024-04-23T18:23:14.724384+0000","last_clean":"2024-04-23T18:23:14.724384+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:23:14.724384+0000","last_undegraded":"2024-04-23T18:23:14.724384+0000","last_fullsized":"2024-04-23T18:23:14.724384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786335+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:23:14.786335+0000","last_peered":"2024-04-23T18:23:14.786335+0000","last_clean":"2024-04-23T18:23:14.786335+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:23:14.786335+0000","last_undegraded":"2024-04-23T18:23:14.786335+0000","last_fullsized":"2024-04-23T18:23:14.786335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720263+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:23:14.720263+0000","last_peered":"2024-04-23T18:23:14.720263+0000","last_clean":"2024-04-23T18:23:14.720263+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:23:14.720263+0000","last_undegraded":"2024-04-23T18:23:14.720263+0000","last_fullsized":"2024-04-23T18:23:14.720263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716932+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:23:14.716932+0000","last_peered":"2024-04-23T18:23:14.716932+0000","last_clean":"2024-04-23T18:23:14.716932+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:23:14.716932+0000","last_undegraded":"2024-04-23T18:23:14.716932+0000","last_fullsized":"2024-04-23T18:23:14.716932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.723945+0000","last_change":"2024-04-23T18:23:14.723945+0000","last_active":"2024-04-23T18:23:14.723945+0000","last_peered":"2024-04-23T18:23:14.723945+0000","last_clean":"2024-04-23T18:23:14.723945+0000","last_became_active":"2024-04-23T18:23:14.723676+0000","last_became_peered":"2024-04-23T18:23:14.723676+0000","last_unstale":"2024-04-23T18:23:14.723945+0000","last_undegraded":"2024-04-23T18:23:14.723945+0000","last_fullsized":"2024-04-23T18:23:14.723945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:46.330533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717858+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:23:14.717858+0000","last_peered":"2024-04-23T18:23:14.717858+0000","last_clean":"2024-04-23T18:23:14.717858+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:23:14.717858+0000","last_undegraded":"2024-04-23T18:23:14.717858+0000","last_fullsized":"2024-04-23T18:23:14.717858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720260+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:23:14.720260+0000","last_peered":"2024-04-23T18:23:14.720260+0000","last_clean":"2024-04-23T18:23:14.720260+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:23:14.720260+0000","last_undegraded":"2024-04-23T18:23:14.720260+0000","last_fullsized":"2024-04-23T18:23:14.720260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719088+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:23:14.719088+0000","last_peered":"2024-04-23T18:23:14.719088+0000","last_clean":"2024-04-23T18:23:14.719088+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:23:14.719088+0000","last_undegraded":"2024-04-23T18:23:14.719088+0000","last_fullsized":"2024-04-23T18:23:14.719088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718085+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:23:14.718085+0000","last_peered":"2024-04-23T18:23:14.718085+0000","last_clean":"2024-04-23T18:23:14.718085+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:23:14.718085+0000","last_undegraded":"2024-04-23T18:23:14.718085+0000","last_fullsized":"2024-04-23T18:23:14.718085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716759+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:23:14.716759+0000","last_peered":"2024-04-23T18:23:14.716759+0000","last_clean":"2024-04-23T18:23:14.716759+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:23:14.716759+0000","last_undegraded":"2024-04-23T18:23:14.716759+0000","last_fullsized":"2024-04-23T18:23:14.716759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785879+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:23:14.785879+0000","last_peered":"2024-04-23T18:23:14.785879+0000","last_clean":"2024-04-23T18:23:14.785879+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:23:14.785879+0000","last_undegraded":"2024-04-23T18:23:14.785879+0000","last_fullsized":"2024-04-23T18:23:14.785879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727384+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:23:14.727384+0000","last_peered":"2024-04-23T18:23:14.727384+0000","last_clean":"2024-04-23T18:23:14.727384+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:23:14.727384+0000","last_undegraded":"2024-04-23T18:23:14.727384+0000","last_fullsized":"2024-04-23T18:23:14.727384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717167+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:23:14.717167+0000","last_peered":"2024-04-23T18:23:14.717167+0000","last_clean":"2024-04-23T18:23:14.717167+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:23:14.717167+0000","last_undegraded":"2024-04-23T18:23:14.717167+0000","last_fullsized":"2024-04-23T18:23:14.717167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718932+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:23:14.718932+0000","last_peered":"2024-04-23T18:23:14.718932+0000","last_clean":"2024-04-23T18:23:14.718932+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:23:14.718932+0000","last_undegraded":"2024-04-23T18:23:14.718932+0000","last_fullsized":"2024-04-23T18:23:14.718932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719601+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:23:14.719601+0000","last_peered":"2024-04-23T18:23:14.719601+0000","last_clean":"2024-04-23T18:23:14.719601+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:23:14.719601+0000","last_undegraded":"2024-04-23T18:23:14.719601+0000","last_fullsized":"2024-04-23T18:23:14.719601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727150+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:23:14.727150+0000","last_peered":"2024-04-23T18:23:14.727150+0000","last_clean":"2024-04-23T18:23:14.727150+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:23:14.727150+0000","last_undegraded":"2024-04-23T18:23:14.727150+0000","last_fullsized":"2024-04-23T18:23:14.727150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786068+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:23:14.786068+0000","last_peered":"2024-04-23T18:23:14.786068+0000","last_clean":"2024-04-23T18:23:14.786068+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:23:14.786068+0000","last_undegraded":"2024-04-23T18:23:14.786068+0000","last_fullsized":"2024-04-23T18:23:14.786068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719278+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:23:14.719278+0000","last_peered":"2024-04-23T18:23:14.719278+0000","last_clean":"2024-04-23T18:23:14.719278+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:23:14.719278+0000","last_undegraded":"2024-04-23T18:23:14.719278+0000","last_fullsized":"2024-04-23T18:23:14.719278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.730758+0000","last_change":"2024-04-23T18:23:14.730758+0000","last_active":"2024-04-23T18:23:14.730758+0000","last_peered":"2024-04-23T18:23:14.730758+0000","last_clean":"2024-04-23T18:23:14.730758+0000","last_became_active":"2024-04-23T18:23:14.729264+0000","last_became_peered":"2024-04-23T18:23:14.729264+0000","last_unstale":"2024-04-23T18:23:14.730758+0000","last_undegraded":"2024-04-23T18:23:14.730758+0000","last_fullsized":"2024-04-23T18:23:14.730758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:25:09.741395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720212+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:23:14.720212+0000","last_peered":"2024-04-23T18:23:14.720212+0000","last_clean":"2024-04-23T18:23:14.720212+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:23:14.720212+0000","last_undegraded":"2024-04-23T18:23:14.720212+0000","last_fullsized":"2024-04-23T18:23:14.720212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785748+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:23:14.785748+0000","last_peered":"2024-04-23T18:23:14.785748+0000","last_clean":"2024-04-23T18:23:14.785748+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:23:14.785748+0000","last_undegraded":"2024-04-23T18:23:14.785748+0000","last_fullsized":"2024-04-23T18:23:14.785748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719388+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:23:14.719388+0000","last_peered":"2024-04-23T18:23:14.719388+0000","last_clean":"2024-04-23T18:23:14.719388+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:23:14.719388+0000","last_undegraded":"2024-04-23T18:23:14.719388+0000","last_fullsized":"2024-04-23T18:23:14.719388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720016+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:23:14.720016+0000","last_peered":"2024-04-23T18:23:14.720016+0000","last_clean":"2024-04-23T18:23:14.720016+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:23:14.720016+0000","last_undegraded":"2024-04-23T18:23:14.720016+0000","last_fullsized":"2024-04-23T18:23:14.720016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727603+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:23:14.727603+0000","last_peered":"2024-04-23T18:23:14.727603+0000","last_clean":"2024-04-23T18:23:14.727603+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:23:14.727603+0000","last_undegraded":"2024-04-23T18:23:14.727603+0000","last_fullsized":"2024-04-23T18:23:14.727603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.715596+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:23:14.715596+0000","last_peered":"2024-04-23T18:23:14.715596+0000","last_clean":"2024-04-23T18:23:14.715596+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:23:14.715596+0000","last_undegraded":"2024-04-23T18:23:14.715596+0000","last_fullsized":"2024-04-23T18:23:14.715596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.727332+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:23:14.727332+0000","last_peered":"2024-04-23T18:23:14.727332+0000","last_clean":"2024-04-23T18:23:14.727332+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:23:14.727332+0000","last_undegraded":"2024-04-23T18:23:14.727332+0000","last_fullsized":"2024-04-23T18:23:14.727332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720337+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:23:14.720337+0000","last_peered":"2024-04-23T18:23:14.720337+0000","last_clean":"2024-04-23T18:23:14.720337+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:23:14.720337+0000","last_undegraded":"2024-04-23T18:23:14.720337+0000","last_fullsized":"2024-04-23T18:23:14.720337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.715979+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:23:14.715979+0000","last_peered":"2024-04-23T18:23:14.715979+0000","last_clean":"2024-04-23T18:23:14.715979+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:23:14.715979+0000","last_undegraded":"2024-04-23T18:23:14.715979+0000","last_fullsized":"2024-04-23T18:23:14.715979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720157+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:23:14.720157+0000","last_peered":"2024-04-23T18:23:14.720157+0000","last_clean":"2024-04-23T18:23:14.720157+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:23:14.720157+0000","last_undegraded":"2024-04-23T18:23:14.720157+0000","last_fullsized":"2024-04-23T18:23:14.720157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785006+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:23:14.785006+0000","last_peered":"2024-04-23T18:23:14.785006+0000","last_clean":"2024-04-23T18:23:14.785006+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:23:14.785006+0000","last_undegraded":"2024-04-23T18:23:14.785006+0000","last_fullsized":"2024-04-23T18:23:14.785006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.725673+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:23:14.725673+0000","last_peered":"2024-04-23T18:23:14.725673+0000","last_clean":"2024-04-23T18:23:14.725673+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:23:14.725673+0000","last_undegraded":"2024-04-23T18:23:14.725673+0000","last_fullsized":"2024-04-23T18:23:14.725673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719897+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:23:14.719897+0000","last_peered":"2024-04-23T18:23:14.719897+0000","last_clean":"2024-04-23T18:23:14.719897+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:23:14.719897+0000","last_undegraded":"2024-04-23T18:23:14.719897+0000","last_fullsized":"2024-04-23T18:23:14.719897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.715698+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:23:14.715698+0000","last_peered":"2024-04-23T18:23:14.715698+0000","last_clean":"2024-04-23T18:23:14.715698+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:23:14.715698+0000","last_undegraded":"2024-04-23T18:23:14.715698+0000","last_fullsized":"2024-04-23T18:23:14.715698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716298+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:23:14.716298+0000","last_peered":"2024-04-23T18:23:14.716298+0000","last_clean":"2024-04-23T18:23:14.716298+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:23:14.716298+0000","last_undegraded":"2024-04-23T18:23:14.716298+0000","last_fullsized":"2024-04-23T18:23:14.716298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718177+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:23:14.718177+0000","last_peered":"2024-04-23T18:23:14.718177+0000","last_clean":"2024-04-23T18:23:14.718177+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:23:14.718177+0000","last_undegraded":"2024-04-23T18:23:14.718177+0000","last_fullsized":"2024-04-23T18:23:14.718177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719510+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:23:14.719510+0000","last_peered":"2024-04-23T18:23:14.719510+0000","last_clean":"2024-04-23T18:23:14.719510+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:23:14.719510+0000","last_undegraded":"2024-04-23T18:23:14.719510+0000","last_fullsized":"2024-04-23T18:23:14.719510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718303+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:23:14.718303+0000","last_peered":"2024-04-23T18:23:14.718303+0000","last_clean":"2024-04-23T18:23:14.718303+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:23:14.718303+0000","last_undegraded":"2024-04-23T18:23:14.718303+0000","last_fullsized":"2024-04-23T18:23:14.718303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716780+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:23:14.716780+0000","last_peered":"2024-04-23T18:23:14.716780+0000","last_clean":"2024-04-23T18:23:14.716780+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:23:14.716780+0000","last_undegraded":"2024-04-23T18:23:14.716780+0000","last_fullsized":"2024-04-23T18:23:14.716780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717854+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:23:14.717854+0000","last_peered":"2024-04-23T18:23:14.717854+0000","last_clean":"2024-04-23T18:23:14.717854+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:23:14.717854+0000","last_undegraded":"2024-04-23T18:23:14.717854+0000","last_fullsized":"2024-04-23T18:23:14.717854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717198+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:23:14.717198+0000","last_peered":"2024-04-23T18:23:14.717198+0000","last_clean":"2024-04-23T18:23:14.717198+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:23:14.717198+0000","last_undegraded":"2024-04-23T18:23:14.717198+0000","last_fullsized":"2024-04-23T18:23:14.717198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718028+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:23:14.718028+0000","last_peered":"2024-04-23T18:23:14.718028+0000","last_clean":"2024-04-23T18:23:14.718028+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:23:14.718028+0000","last_undegraded":"2024-04-23T18:23:14.718028+0000","last_fullsized":"2024-04-23T18:23:14.718028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719096+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:23:14.719096+0000","last_peered":"2024-04-23T18:23:14.719096+0000","last_clean":"2024-04-23T18:23:14.719096+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:23:14.719096+0000","last_undegraded":"2024-04-23T18:23:14.719096+0000","last_fullsized":"2024-04-23T18:23:14.719096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726974+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:23:14.726974+0000","last_peered":"2024-04-23T18:23:14.726974+0000","last_clean":"2024-04-23T18:23:14.726974+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:23:14.726974+0000","last_undegraded":"2024-04-23T18:23:14.726974+0000","last_fullsized":"2024-04-23T18:23:14.726974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719410+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:23:14.719410+0000","last_peered":"2024-04-23T18:23:14.719410+0000","last_clean":"2024-04-23T18:23:14.719410+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:23:14.719410+0000","last_undegraded":"2024-04-23T18:23:14.719410+0000","last_fullsized":"2024-04-23T18:23:14.719410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.717413+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:23:14.717413+0000","last_peered":"2024-04-23T18:23:14.717413+0000","last_clean":"2024-04-23T18:23:14.717413+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:23:14.717413+0000","last_undegraded":"2024-04-23T18:23:14.717413+0000","last_fullsized":"2024-04-23T18:23:14.717413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785648+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:23:14.785648+0000","last_peered":"2024-04-23T18:23:14.785648+0000","last_clean":"2024-04-23T18:23:14.785648+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:23:14.785648+0000","last_undegraded":"2024-04-23T18:23:14.785648+0000","last_fullsized":"2024-04-23T18:23:14.785648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.720102+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:23:14.720102+0000","last_peered":"2024-04-23T18:23:14.720102+0000","last_clean":"2024-04-23T18:23:14.720102+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:23:14.720102+0000","last_undegraded":"2024-04-23T18:23:14.720102+0000","last_fullsized":"2024-04-23T18:23:14.720102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716562+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:23:14.716562+0000","last_peered":"2024-04-23T18:23:14.716562+0000","last_clean":"2024-04-23T18:23:14.716562+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:23:14.716562+0000","last_undegraded":"2024-04-23T18:23:14.716562+0000","last_fullsized":"2024-04-23T18:23:14.716562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.725409+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:23:14.725409+0000","last_peered":"2024-04-23T18:23:14.725409+0000","last_clean":"2024-04-23T18:23:14.725409+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:23:14.725409+0000","last_undegraded":"2024-04-23T18:23:14.725409+0000","last_fullsized":"2024-04-23T18:23:14.725409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716135+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:23:14.716135+0000","last_peered":"2024-04-23T18:23:14.716135+0000","last_clean":"2024-04-23T18:23:14.716135+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:23:14.716135+0000","last_undegraded":"2024-04-23T18:23:14.716135+0000","last_fullsized":"2024-04-23T18:23:14.716135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.787713+0000","last_change":"2024-04-23T18:23:14.787713+0000","last_active":"2024-04-23T18:23:14.787713+0000","last_peered":"2024-04-23T18:23:14.787713+0000","last_clean":"2024-04-23T18:23:14.787713+0000","last_became_active":"2024-04-23T18:23:14.787340+0000","last_became_peered":"2024-04-23T18:23:14.787340+0000","last_unstale":"2024-04-23T18:23:14.787713+0000","last_undegraded":"2024-04-23T18:23:14.787713+0000","last_fullsized":"2024-04-23T18:23:14.787713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:44:54.939264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719231+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:23:14.719231+0000","last_peered":"2024-04-23T18:23:14.719231+0000","last_clean":"2024-04-23T18:23:14.719231+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:23:14.719231+0000","last_undegraded":"2024-04-23T18:23:14.719231+0000","last_fullsized":"2024-04-23T18:23:14.719231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719014+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:23:14.719014+0000","last_peered":"2024-04-23T18:23:14.719014+0000","last_clean":"2024-04-23T18:23:14.719014+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:23:14.719014+0000","last_undegraded":"2024-04-23T18:23:14.719014+0000","last_fullsized":"2024-04-23T18:23:14.719014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786787+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:23:14.786787+0000","last_peered":"2024-04-23T18:23:14.786787+0000","last_clean":"2024-04-23T18:23:14.786787+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:23:14.786787+0000","last_undegraded":"2024-04-23T18:23:14.786787+0000","last_fullsized":"2024-04-23T18:23:14.786787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718479+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:23:14.718479+0000","last_peered":"2024-04-23T18:23:14.718479+0000","last_clean":"2024-04-23T18:23:14.718479+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:23:14.718479+0000","last_undegraded":"2024-04-23T18:23:14.718479+0000","last_fullsized":"2024-04-23T18:23:14.718479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.728196+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:23:14.728196+0000","last_peered":"2024-04-23T18:23:14.728196+0000","last_clean":"2024-04-23T18:23:14.728196+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:23:14.728196+0000","last_undegraded":"2024-04-23T18:23:14.728196+0000","last_fullsized":"2024-04-23T18:23:14.728196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.725144+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:23:14.725144+0000","last_peered":"2024-04-23T18:23:14.725144+0000","last_clean":"2024-04-23T18:23:14.725144+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:23:14.725144+0000","last_undegraded":"2024-04-23T18:23:14.725144+0000","last_fullsized":"2024-04-23T18:23:14.725144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785074+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:23:14.785074+0000","last_peered":"2024-04-23T18:23:14.785074+0000","last_clean":"2024-04-23T18:23:14.785074+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:23:14.785074+0000","last_undegraded":"2024-04-23T18:23:14.785074+0000","last_fullsized":"2024-04-23T18:23:14.785074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718841+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:23:14.718841+0000","last_peered":"2024-04-23T18:23:14.718841+0000","last_clean":"2024-04-23T18:23:14.718841+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:23:14.718841+0000","last_undegraded":"2024-04-23T18:23:14.718841+0000","last_fullsized":"2024-04-23T18:23:14.718841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.716572+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:23:14.716572+0000","last_peered":"2024-04-23T18:23:14.716572+0000","last_clean":"2024-04-23T18:23:14.716572+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:23:14.716572+0000","last_undegraded":"2024-04-23T18:23:14.716572+0000","last_fullsized":"2024-04-23T18:23:14.716572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719965+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:23:14.719965+0000","last_peered":"2024-04-23T18:23:14.719965+0000","last_clean":"2024-04-23T18:23:14.719965+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:23:14.719965+0000","last_undegraded":"2024-04-23T18:23:14.719965+0000","last_fullsized":"2024-04-23T18:23:14.719965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.718809+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:23:14.718809+0000","last_peered":"2024-04-23T18:23:14.718809+0000","last_clean":"2024-04-23T18:23:14.718809+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:23:14.718809+0000","last_undegraded":"2024-04-23T18:23:14.718809+0000","last_fullsized":"2024-04-23T18:23:14.718809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719820+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:23:14.719820+0000","last_peered":"2024-04-23T18:23:14.719820+0000","last_clean":"2024-04-23T18:23:14.719820+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:23:14.719820+0000","last_undegraded":"2024-04-23T18:23:14.719820+0000","last_fullsized":"2024-04-23T18:23:14.719820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786748+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:23:14.786748+0000","last_peered":"2024-04-23T18:23:14.786748+0000","last_clean":"2024-04-23T18:23:14.786748+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:23:14.786748+0000","last_undegraded":"2024-04-23T18:23:14.786748+0000","last_fullsized":"2024-04-23T18:23:14.786748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.787765+0000","last_change":"2024-04-23T18:23:14.787765+0000","last_active":"2024-04-23T18:23:14.787765+0000","last_peered":"2024-04-23T18:23:14.787765+0000","last_clean":"2024-04-23T18:23:14.787765+0000","last_became_active":"2024-04-23T18:23:14.787444+0000","last_became_peered":"2024-04-23T18:23:14.787444+0000","last_unstale":"2024-04-23T18:23:14.787765+0000","last_undegraded":"2024-04-23T18:23:14.787765+0000","last_fullsized":"2024-04-23T18:23:14.787765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:12.714842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785324+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:23:14.785324+0000","last_peered":"2024-04-23T18:23:14.785324+0000","last_clean":"2024-04-23T18:23:14.785324+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:23:14.785324+0000","last_undegraded":"2024-04-23T18:23:14.785324+0000","last_fullsized":"2024-04-23T18:23:14.785324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726690+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:23:14.726690+0000","last_peered":"2024-04-23T18:23:14.726690+0000","last_clean":"2024-04-23T18:23:14.726690+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:23:14.726690+0000","last_undegraded":"2024-04-23T18:23:14.726690+0000","last_fullsized":"2024-04-23T18:23:14.726690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.785630+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:23:14.785630+0000","last_peered":"2024-04-23T18:23:14.785630+0000","last_clean":"2024-04-23T18:23:14.785630+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:23:14.785630+0000","last_undegraded":"2024-04-23T18:23:14.785630+0000","last_fullsized":"2024-04-23T18:23:14.785630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.726614+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:23:14.726614+0000","last_peered":"2024-04-23T18:23:14.726614+0000","last_clean":"2024-04-23T18:23:14.726614+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:23:14.726614+0000","last_undegraded":"2024-04-23T18:23:14.726614+0000","last_fullsized":"2024-04-23T18:23:14.726614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.719851+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:23:14.719851+0000","last_peered":"2024-04-23T18:23:14.719851+0000","last_clean":"2024-04-23T18:23:14.719851+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:23:14.719851+0000","last_undegraded":"2024-04-23T18:23:14.719851+0000","last_fullsized":"2024-04-23T18:23:14.719851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786008+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:23:14.786008+0000","last_peered":"2024-04-23T18:23:14.786008+0000","last_clean":"2024-04-23T18:23:14.786008+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:23:14.786008+0000","last_undegraded":"2024-04-23T18:23:14.786008+0000","last_fullsized":"2024-04-23T18:23:14.786008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.786608+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:23:14.786608+0000","last_peered":"2024-04-23T18:23:14.786608+0000","last_clean":"2024-04-23T18:23:14.786608+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:23:14.786608+0000","last_undegraded":"2024-04-23T18:23:14.786608+0000","last_fullsized":"2024-04-23T18:23:14.786608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":892928,"data_stored":706045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":119139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":115739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":115333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":303104,"data_stored":118915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":299008,"data_stored":115179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":115305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":888832,"data_stored":705389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:23:23.182 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:23:23.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6609200640 1 Processor -- start 2024-04-23T18:23:23.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6609200640 1 -- start start 2024-04-23T18:23:23.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6609200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f66041444e0 0x7f66040710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6609200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f66040c91e0 0x7f660406c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6609200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6604072dc0 0x7f6604073230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6609200640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f660415b650 con 0x7f66041444e0 2024-04-23T18:23:23.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6609200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f660415b930 con 0x7f66040c91e0 2024-04-23T18:23:23.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6609200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f660415bc10 con 0x7f6604072dc0 2024-04-23T18:23:23.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6601e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f66041444e0 0x7f66040710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6601e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f66041444e0 0x7f66040710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49820/0 (socket says 172.21.15.28:49820) 2024-04-23T18:23:23.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6601e00640 1 -- 172.21.15.28:0/3494292447 learned_addr learned my addr 172.21.15.28:0/3494292447 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:23.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6602800640 1 --2- 172.21.15.28:0/3494292447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6604072dc0 0x7f6604073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6601400640 1 --2- 172.21.15.28:0/3494292447 >> v2:172.21.15.137:3300/0 conn(0x7f66040c91e0 0x7f660406c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6601e00640 1 -- 172.21.15.28:0/3494292447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6604072dc0 msgr2=0x7f6604073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6601e00640 1 --2- 172.21.15.28:0/3494292447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6604072dc0 0x7f6604073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6601e00640 1 -- 172.21.15.28:0/3494292447 >> v2:172.21.15.137:3300/0 conn(0x7f66040c91e0 msgr2=0x7f660406c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6601e00640 1 --2- 172.21.15.28:0/3494292447 >> v2:172.21.15.137:3300/0 conn(0x7f66040c91e0 0x7f660406c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.371+0000 7f6601e00640 1 -- 172.21.15.28:0/3494292447 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660415bef0 con 0x7f66041444e0 2024-04-23T18:23:23.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6601e00640 1 --2- 172.21.15.28:0/3494292447 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66041444e0 0x7f66040710e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f66040cc6a0 tx=0x7f65f401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8743f1eade714393 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:23.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6600a00640 1 -- 172.21.15.28:0/3494292447 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f40b5070 con 0x7f66041444e0 2024-04-23T18:23:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6600a00640 1 -- 172.21.15.28:0/3494292447 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f40a89d0 con 0x7f66041444e0 2024-04-23T18:23:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6600a00640 1 -- 172.21.15.28:0/3494292447 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f40a8da0 con 0x7f66041444e0 2024-04-23T18:23:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6609200640 1 -- 172.21.15.28:0/3494292447 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66041444e0 msgr2=0x7f66040710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6609200640 1 --2- 172.21.15.28:0/3494292447 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66041444e0 0x7f66040710e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f66040cc6a0 tx=0x7f65f401ed10 comp rx=0 tx=0).stop 2024-04-23T18:23:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6609200640 1 -- 172.21.15.28:0/3494292447 shutdown_connections 2024-04-23T18:23:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6609200640 1 --2- 172.21.15.28:0/3494292447 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6604072dc0 0x7f6604073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6609200640 1 --2- 172.21.15.28:0/3494292447 >> v2:172.21.15.137:3300/0 conn(0x7f66040c91e0 0x7f660406c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6609200640 1 --2- 172.21.15.28:0/3494292447 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66041444e0 0x7f66040710e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6609200640 1 -- 172.21.15.28:0/3494292447 >> 172.21.15.28:0/3494292447 conn(0x7f66040676e0 msgr2=0x7f6604067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6609200640 1 -- 172.21.15.28:0/3494292447 shutdown_connections 2024-04-23T18:23:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6609200640 1 -- 172.21.15.28:0/3494292447 wait complete. 2024-04-23T18:23:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6609200640 1 Processor -- start 2024-04-23T18:23:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.375+0000 7f6609200640 1 -- start start 2024-04-23T18:23:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6609200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6604072dc0 0x7f6604140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6609200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66040c91e0 0x7f66041f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6609200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66041444e0 0x7f66041f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6609200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f66041448c0 con 0x7f66040c91e0 2024-04-23T18:23:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6609200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f660415b300 con 0x7f66041444e0 2024-04-23T18:23:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6609200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6604144a40 con 0x7f6604072dc0 2024-04-23T18:23:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6601400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66040c91e0 0x7f66041f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6601400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66040c91e0 0x7f66041f1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49830/0 (socket says 172.21.15.28:49830) 2024-04-23T18:23:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6601400640 1 -- 172.21.15.28:0/4133962369 learned_addr learned my addr 172.21.15.28:0/4133962369 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6601e00640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6604072dc0 0x7f6604140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6602800640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66041444e0 0x7f66041f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6601400640 1 -- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6604072dc0 msgr2=0x7f6604140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6601400640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6604072dc0 0x7f6604140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6601400640 1 -- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66041444e0 msgr2=0x7f66041f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6601400640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66041444e0 0x7f66041f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6601400640 1 -- 172.21.15.28:0/4133962369 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66040c8c30 con 0x7f66040c91e0 2024-04-23T18:23:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6602800640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66041444e0 0x7f66041f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6601400640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66040c91e0 0x7f66041f1530 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f65f000d830 tx=0x7f65f000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:23.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f65fa000640 1 -- 172.21.15.28:0/4133962369 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f000b6c0 con 0x7f66040c91e0 2024-04-23T18:23:23.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f65fa000640 1 -- 172.21.15.28:0/4133962369 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f0019070 con 0x7f66040c91e0 2024-04-23T18:23:23.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f65fa000640 1 -- 172.21.15.28:0/4133962369 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f000ba60 con 0x7f66040c91e0 2024-04-23T18:23:23.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6609200640 1 -- 172.21.15.28:0/4133962369 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66041f4a80 con 0x7f66040c91e0 2024-04-23T18:23:23.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6609200640 1 -- 172.21.15.28:0/4133962369 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66041f5040 con 0x7f66040c91e0 2024-04-23T18:23:23.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.379+0000 7f6609200640 1 -- 172.21.15.28:0/4133962369 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6604068cd0 con 0x7f66040c91e0 2024-04-23T18:23:23.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.383+0000 7f65fa000640 1 -- 172.21.15.28:0/4133962369 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f65f001e460 con 0x7f66040c91e0 2024-04-23T18:23:23.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.383+0000 7f65fa000640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f65e4068380 0x7f65e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.383+0000 7f65fa000640 1 -- 172.21.15.28:0/4133962369 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f65f00873f0 con 0x7f66040c91e0 2024-04-23T18:23:23.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.383+0000 7f6601e00640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f65e4068380 0x7f65e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.383+0000 7f6601e00640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f65e4068380 0x7f65e406a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f65f40b2000 tx=0x7f65f4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:23.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.387+0000 7f65fa000640 1 -- 172.21.15.28:0/4133962369 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f65f00575b0 con 0x7f66040c91e0 2024-04-23T18:23:23.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 -- 172.21.15.28:0/4133962369 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6604143cd0 con 0x7f66040c91e0 2024-04-23T18:23:23.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f65fa000640 1 -- 172.21.15.28:0/4133962369 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f65f0056eb0 con 0x7f66040c91e0 2024-04-23T18:23:23.581 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:23.581 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:23:23.581 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:23:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 -- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f65e4068380 msgr2=0x7f65e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f65e4068380 0x7f65e406a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f65f40b2000 tx=0x7f65f4009040 comp rx=0 tx=0).stop 2024-04-23T18:23:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 -- 172.21.15.28:0/4133962369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66040c91e0 msgr2=0x7f66041f1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66040c91e0 0x7f66041f1530 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f65f000d830 tx=0x7f65f000dcf0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 -- 172.21.15.28:0/4133962369 shutdown_connections 2024-04-23T18:23:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f65e4068380 0x7f65e406a840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66041444e0 0x7f66041f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66040c91e0 0x7f66041f1530 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 --2- 172.21.15.28:0/4133962369 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6604072dc0 0x7f6604140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 -- 172.21.15.28:0/4133962369 >> 172.21.15.28:0/4133962369 conn(0x7f66040676e0 msgr2=0x7f6604067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:23.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 -- 172.21.15.28:0/4133962369 shutdown_connections 2024-04-23T18:23:23.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.587+0000 7f6609200640 1 -- 172.21.15.28:0/4133962369 wait complete. 2024-04-23T18:23:23.602 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:23:23.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.747+0000 7ff515c00640 1 Processor -- start 2024-04-23T18:23:23.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.747+0000 7ff515c00640 1 -- start start 2024-04-23T18:23:23.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff515c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff5100c9a00 0x7ff510158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff515c00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5100c3bc0 con 0x7ff5100c9e70 2024-04-23T18:23:23.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff515c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5100c4940 con 0x7ff5101531a0 2024-04-23T18:23:23.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff515c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff5100c6790 con 0x7ff5100c9a00 2024-04-23T18:23:23.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50f400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff5100c9e70 0x7ff510072f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49984/0 (socket says 172.21.15.28:49984) 2024-04-23T18:23:23.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50f400640 1 -- 172.21.15.28:0/3946881957 learned_addr learned my addr 172.21.15.28:0/3946881957 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:23.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff506000640 1 --2- 172.21.15.28:0/3946881957 >> v2:172.21.15.137:3300/0 conn(0x7ff5100c9a00 0x7ff510158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 945345366 0 0) 0x7ff5100c3bc0 con 0x7ff5100c9e70 2024-04-23T18:23:23.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4f4003530 con 0x7ff5100c9e70 2024-04-23T18:23:23.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155712637 0 0) 0x7ff5100c4940 con 0x7ff5101531a0 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5100c3bc0 con 0x7ff5101531a0 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 14056392 0 0) 0x7ff4f4003530 con 0x7ff5100c9e70 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 >> v2:172.21.15.137:3300/0 conn(0x7ff5100c9a00 msgr2=0x7ff510158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 --2- 172.21.15.28:0/3946881957 >> v2:172.21.15.137:3300/0 conn(0x7ff5100c9a00 0x7ff510158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 >> v1:172.21.15.137:6789/0 conn(0x7ff5101531a0 legacy=0x7ff5100c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5100c6a70 con 0x7ff5100c9e70 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7ff508001a00 con 0x7ff5100c9e70 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 >> v1:172.21.15.28:6789/0 conn(0x7ff5100c9e70 legacy=0x7ff510072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 --2- 172.21.15.28:0/3946881957 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f4003b50 0x7ff4f4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 --2- 172.21.15.28:0/3946881957 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 0x7ff4f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 --2- 172.21.15.28:0/3946881957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4f40051d0 0x7ff4f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff5100c6790 con 0x7ff4f4004810 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f400bfc0 con 0x7ff4f40051d0 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f400c1c0 con 0x7ff4f4003b50 2024-04-23T18:23:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff506000640 1 --2- 172.21.15.28:0/3946881957 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 0x7ff4f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50ea00640 1 --2- 172.21.15.28:0/3946881957 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f4003b50 0x7ff4f4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50f400640 1 --2- 172.21.15.28:0/3946881957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4f40051d0 0x7ff4f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff506000640 1 -- 172.21.15.28:0/3946881957 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f4003b50 msgr2=0x7ff4f4003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff506000640 1 --2- 172.21.15.28:0/3946881957 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff4f4003b50 0x7ff4f4003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff506000640 1 -- 172.21.15.28:0/3946881957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4f40051d0 msgr2=0x7ff4f400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff506000640 1 --2- 172.21.15.28:0/3946881957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4f40051d0 0x7ff4f400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff506000640 1 -- 172.21.15.28:0/3946881957 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f4003530 con 0x7ff4f4004810 2024-04-23T18:23:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.751+0000 7ff50f400640 1 -- 172.21.15.28:0/3946881957 reap_dead start 2024-04-23T18:23:23.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff506000640 1 --2- 172.21.15.28:0/3946881957 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 0x7ff4f4004c90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009ab0 tx=0x7ff4f801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6798820afcda907 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:23.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80b2070 con 0x7ff4f4004810 2024-04-23T18:23:23.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f80a5640 con 0x7ff4f4004810 2024-04-23T18:23:23.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff50e000640 1 -- 172.21.15.28:0/3946881957 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80096b0 con 0x7ff4f4004810 2024-04-23T18:23:23.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff515c00640 1 -- 172.21.15.28:0/3946881957 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 msgr2=0x7ff4f4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff515c00640 1 --2- 172.21.15.28:0/3946881957 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 0x7ff4f4004c90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009ab0 tx=0x7ff4f801ca50 comp rx=0 tx=0).stop 2024-04-23T18:23:23.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff515c00640 1 -- 172.21.15.28:0/3946881957 shutdown_connections 2024-04-23T18:23:23.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff515c00640 1 --2- 172.21.15.28:0/3946881957 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 0x7ff4f4004c90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff515c00640 1 -- 172.21.15.28:0/3946881957 >> 172.21.15.28:0/3946881957 conn(0x7ff51006d0a0 msgr2=0x7ff5100676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:23.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff515c00640 1 -- 172.21.15.28:0/3946881957 shutdown_connections 2024-04-23T18:23:23.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff515c00640 1 -- 172.21.15.28:0/3946881957 wait complete. 2024-04-23T18:23:23.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.755+0000 7ff515c00640 1 Processor -- start 2024-04-23T18:23:23.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff515c00640 1 -- start start 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff515c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 0x7ff5101f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff515c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff51014ffa0 0x7ff5100c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff515c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5101556c0 0x7ff510155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff515c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff5100c4420 con 0x7ff4f4004810 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff515c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff5100c4140 con 0x7ff5101556c0 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff515c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff510153580 con 0x7ff51014ffa0 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff50ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 0x7ff5101f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff50ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 0x7ff5101f1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49844/0 (socket says 172.21.15.28:49844) 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff50ea00640 1 -- 172.21.15.28:0/1588935396 learned_addr learned my addr 172.21.15.28:0/1588935396 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff506000640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff51014ffa0 0x7ff5100c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff50f400640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5101556c0 0x7ff510155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff50ea00640 1 -- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff51014ffa0 msgr2=0x7ff5100c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff50ea00640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff51014ffa0 0x7ff5100c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff50ea00640 1 -- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5101556c0 msgr2=0x7ff510155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff50ea00640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5101556c0 0x7ff510155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff50ea00640 1 -- 172.21.15.28:0/1588935396 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff510156080 con 0x7ff4f4004810 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff506000640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff51014ffa0 0x7ff5100c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff50f400640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5101556c0 0x7ff510155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff50ea00640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 0x7ff5101f1da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff50000f730 tx=0x7ff50000fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff507400640 1 -- 172.21.15.28:0/1588935396 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50000fe40 con 0x7ff4f4004810 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff507400640 1 -- 172.21.15.28:0/1588935396 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff500018070 con 0x7ff4f4004810 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff515c00640 1 -- 172.21.15.28:0/1588935396 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff510154f00 con 0x7ff4f4004810 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff507400640 1 -- 172.21.15.28:0/1588935396 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50000d650 con 0x7ff4f4004810 2024-04-23T18:23:23.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff515c00640 1 -- 172.21.15.28:0/1588935396 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5100ca940 con 0x7ff4f4004810 2024-04-23T18:23:23.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.759+0000 7ff515c00640 1 -- 172.21.15.28:0/1588935396 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff510068cd0 con 0x7ff4f4004810 2024-04-23T18:23:23.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.763+0000 7ff507400640 1 -- 172.21.15.28:0/1588935396 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff50000d7f0 con 0x7ff4f4004810 2024-04-23T18:23:23.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.763+0000 7ff507400640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4ec0683b0 0x7ff4ec06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:23.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.763+0000 7ff507400640 1 -- 172.21.15.28:0/1588935396 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff500086ca0 con 0x7ff4f4004810 2024-04-23T18:23:23.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.763+0000 7ff506000640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4ec0683b0 0x7ff4ec06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:23.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.763+0000 7ff506000640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4ec0683b0 0x7ff4ec06a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009ab0 tx=0x7ff4f8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:23.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.767+0000 7ff507400640 1 -- 172.21.15.28:0/1588935396 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff510156080 con 0x7ff4f4004810 2024-04-23T18:23:23.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.931+0000 7ff515c00640 1 -- 172.21.15.28:0/1588935396 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5100c4940 con 0x7ff4f4004810 2024-04-23T18:23:23.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.931+0000 7ff507400640 1 -- 172.21.15.28:0/1588935396 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18891 (secure 0 0 0) 0x7ff50001a310 con 0x7ff4f4004810 2024-04-23T18:23:23.927 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:23.927 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:23:14.705611+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:23:23.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 -- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4ec0683b0 msgr2=0x7ff4ec06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4ec0683b0 0x7ff4ec06a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009ab0 tx=0x7ff4f8008040 comp rx=0 tx=0).stop 2024-04-23T18:23:23.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 -- 172.21.15.28:0/1588935396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 msgr2=0x7ff5101f1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 0x7ff5101f1da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff50000f730 tx=0x7ff50000fbf0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 -- 172.21.15.28:0/1588935396 shutdown_connections 2024-04-23T18:23:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4ec0683b0 0x7ff4ec06a870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff51014ffa0 0x7ff5100c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5101556c0 0x7ff510155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 --2- 172.21.15.28:0/1588935396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4f4004810 0x7ff5101f1da0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 -- 172.21.15.28:0/1588935396 >> 172.21.15.28:0/1588935396 conn(0x7ff51006d0a0 msgr2=0x7ff51014d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 -- 172.21.15.28:0/1588935396 shutdown_connections 2024-04-23T18:23:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:23.935+0000 7ff515c00640 1 -- 172.21.15.28:0/1588935396 wait complete. 2024-04-23T18:23:23.949 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T18:22:19.363864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T18:22:31.040656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T18:22:31.703845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T18:22:35.387908+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T18:23:23.949 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T18:23:24.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff470400640 1 Processor -- start 2024-04-23T18:23:24.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff470400640 1 -- start start 2024-04-23T18:23:24.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff470400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff4680c79e0 0x7ff4680701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff470400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff46815bc00 0x7ff468071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff470400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff46815e840 con 0x7ff468072430 2024-04-23T18:23:24.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff470400640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7ff46815eae0 con 0x7ff4680c79e0 2024-04-23T18:23:24.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff470400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff46815edc0 con 0x7ff46815bc00 2024-04-23T18:23:24.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff46da00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff4680c79e0 0x7ff4680701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff46da00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff4680c79e0 0x7ff4680701e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49852/0 (socket says 172.21.15.28:49852) 2024-04-23T18:23:24.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff46da00640 1 -- 172.21.15.28:0/4083892749 learned_addr learned my addr 172.21.15.28:0/4083892749 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:24.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff46d000640 1 --2- 172.21.15.28:0/4083892749 >> v2:172.21.15.137:3300/0 conn(0x7ff46815bc00 0x7ff468071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff46da00640 1 -- 172.21.15.28:0/4083892749 >> v2:172.21.15.137:3300/0 conn(0x7ff46815bc00 msgr2=0x7ff468071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:24.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff46da00640 1 --2- 172.21.15.28:0/4083892749 >> v2:172.21.15.137:3300/0 conn(0x7ff46815bc00 0x7ff468071ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff46da00640 1 -- 172.21.15.28:0/4083892749 >> v1:172.21.15.137:6789/0 conn(0x7ff468072430 legacy=0x7ff4680c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.099+0000 7ff46da00640 1 -- 172.21.15.28:0/4083892749 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46815f0a0 con 0x7ff4680c79e0 2024-04-23T18:23:24.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff46da00640 1 --2- 172.21.15.28:0/4083892749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4680c79e0 0x7ff4680701e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff468068740 tx=0x7ff45c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc76a7f3b257033 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:24.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff467e00640 1 -- 172.21.15.28:0/4083892749 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0b5070 con 0x7ff4680c79e0 2024-04-23T18:23:24.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff467e00640 1 -- 172.21.15.28:0/4083892749 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff45c0a8a10 con 0x7ff4680c79e0 2024-04-23T18:23:24.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff467e00640 1 -- 172.21.15.28:0/4083892749 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0a8de0 con 0x7ff4680c79e0 2024-04-23T18:23:24.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff470400640 1 -- 172.21.15.28:0/4083892749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4680c79e0 msgr2=0x7ff4680701e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff470400640 1 --2- 172.21.15.28:0/4083892749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4680c79e0 0x7ff4680701e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff468068740 tx=0x7ff45c01ed10 comp rx=0 tx=0).stop 2024-04-23T18:23:24.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff470400640 1 -- 172.21.15.28:0/4083892749 shutdown_connections 2024-04-23T18:23:24.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff470400640 1 --2- 172.21.15.28:0/4083892749 >> v2:172.21.15.137:3300/0 conn(0x7ff46815bc00 0x7ff468071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff470400640 1 --2- 172.21.15.28:0/4083892749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4680c79e0 0x7ff4680701e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff470400640 1 -- 172.21.15.28:0/4083892749 >> 172.21.15.28:0/4083892749 conn(0x7ff46806b9e0 msgr2=0x7ff46806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:24.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff470400640 1 -- 172.21.15.28:0/4083892749 shutdown_connections 2024-04-23T18:23:24.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.103+0000 7ff470400640 1 -- 172.21.15.28:0/4083892749 wait complete. 2024-04-23T18:23:24.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff470400640 1 Processor -- start 2024-04-23T18:23:24.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff470400640 1 -- start start 2024-04-23T18:23:24.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff470400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff468072430 0x7ff46815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff470400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4680c79e0 0x7ff4680cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff470400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff46815bc00 0x7ff468158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff470400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff4680c7dc0 con 0x7ff46815bc00 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff470400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff468070870 con 0x7ff4680c79e0 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff470400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff468072b30 con 0x7ff468072430 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff46e400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff46815bc00 0x7ff468158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff46e400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff46815bc00 0x7ff468158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49868/0 (socket says 172.21.15.28:49868) 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff46e400640 1 -- 172.21.15.28:0/373700153 learned_addr learned my addr 172.21.15.28:0/373700153 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff46d000640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4680c79e0 0x7ff4680cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff46da00640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff468072430 0x7ff46815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff46e400640 1 -- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff468072430 msgr2=0x7ff46815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff46e400640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff468072430 0x7ff46815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff46e400640 1 -- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4680c79e0 msgr2=0x7ff4680cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff46e400640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4680c79e0 0x7ff4680cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff46e400640 1 -- 172.21.15.28:0/373700153 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46815db10 con 0x7ff46815bc00 2024-04-23T18:23:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff46e400640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff46815bc00 0x7ff468158fd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c770 tx=0x7ff46000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff465600640 1 -- 172.21.15.28:0/373700153 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460003b80 con 0x7ff46815bc00 2024-04-23T18:23:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff465600640 1 -- 172.21.15.28:0/373700153 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff460003d20 con 0x7ff46815bc00 2024-04-23T18:23:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff465600640 1 -- 172.21.15.28:0/373700153 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46000aa90 con 0x7ff46815bc00 2024-04-23T18:23:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff470400640 1 -- 172.21.15.28:0/373700153 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46815af70 con 0x7ff46815bc00 2024-04-23T18:23:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.107+0000 7ff470400640 1 -- 172.21.15.28:0/373700153 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff468157f70 con 0x7ff46815bc00 2024-04-23T18:23:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.111+0000 7ff470400640 1 -- 172.21.15.28:0/373700153 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff468158840 con 0x7ff46815bc00 2024-04-23T18:23:24.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.111+0000 7ff465600640 1 -- 172.21.15.28:0/373700153 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff46000ac30 con 0x7ff46815bc00 2024-04-23T18:23:24.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.111+0000 7ff465600640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff448068380 0x7ff44806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.111+0000 7ff465600640 1 -- 172.21.15.28:0/373700153 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff460086ca0 con 0x7ff46815bc00 2024-04-23T18:23:24.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.111+0000 7ff46da00640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff448068380 0x7ff44806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.111+0000 7ff46da00640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff448068380 0x7ff44806a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0b2000 tx=0x7ff45c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:24.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.115+0000 7ff465600640 1 -- 172.21.15.28:0/373700153 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff460056dc0 con 0x7ff46815bc00 2024-04-23T18:23:24.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 -- 172.21.15.28:0/373700153 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff468068db0 con 0x7ff46815bc00 2024-04-23T18:23:24.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff465600640 1 -- 172.21.15.28:0/373700153 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7ff4600566c0 con 0x7ff46815bc00 2024-04-23T18:23:24.277 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-04-23T18:23:24.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 -- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff448068380 msgr2=0x7ff44806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff448068380 0x7ff44806a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0b2000 tx=0x7ff45c008040 comp rx=0 tx=0).stop 2024-04-23T18:23:24.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 -- 172.21.15.28:0/373700153 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff46815bc00 msgr2=0x7ff468158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff46815bc00 0x7ff468158fd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c770 tx=0x7ff46000cc30 comp rx=0 tx=0).stop 2024-04-23T18:23:24.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 -- 172.21.15.28:0/373700153 shutdown_connections 2024-04-23T18:23:24.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff448068380 0x7ff44806a840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff46815bc00 0x7ff468158fd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4680c79e0 0x7ff4680cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 --2- 172.21.15.28:0/373700153 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff468072430 0x7ff46815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 -- 172.21.15.28:0/373700153 >> 172.21.15.28:0/373700153 conn(0x7ff46806b9e0 msgr2=0x7ff4680c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:24.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 -- 172.21.15.28:0/373700153 shutdown_connections 2024-04-23T18:23:24.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.283+0000 7ff470400640 1 -- 172.21.15.28:0/373700153 wait complete. 2024-04-23T18:23:24.297 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T18:23:24.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.447+0000 7f086a200640 1 Processor -- start 2024-04-23T18:23:24.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.447+0000 7f086a200640 1 -- start start 2024-04-23T18:23:24.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f086a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f086415ea30 0x7f086415ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f086a200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0864072860 con 0x7f086406fb50 2024-04-23T18:23:24.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f086a200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08641556b0 con 0x7f08641552d0 2024-04-23T18:23:24.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f086a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f08640706f0 con 0x7f086415ea30 2024-04-23T18:23:24.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0869800640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f086406fb50 0x7f086406ffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49986/0 (socket says 172.21.15.28:49986) 2024-04-23T18:23:24.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0869800640 1 -- 172.21.15.28:0/3759640297 learned_addr learned my addr 172.21.15.28:0/3759640297 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:24.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f085be00640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f086415ea30 0x7f086415ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268420789 0 0) 0x7f085c0014a0 con 0x7f086406fb50 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0848003530 con 0x7f086406fb50 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 803759514 0 0) 0x7f0848003530 con 0x7f086406fb50 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f086415ea30 msgr2=0x7f086415ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f086415ea30 0x7f086415ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 >> v1:172.21.15.137:6789/0 conn(0x7f08641552d0 legacy=0x7f08640ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086415afb0 con 0x7f086406fb50 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f085c001bd0 con 0x7f086406fb50 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 >> v1:172.21.15.28:6789/0 conn(0x7f086406fb50 legacy=0x7f086406ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f086415ea30 0x7f08480039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0848003f30 0x7f0848004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0848004d50 0x7f08480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f084800ba00 con 0x7f0848003f30 2024-04-23T18:23:24.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f084800bbb0 con 0x7f0848004d50 2024-04-23T18:23:24.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f084800bdb0 con 0x7f086415ea30 2024-04-23T18:23:24.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f085be00640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0848003f30 0x7f0848004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0868e00640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f086415ea30 0x7f08480039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0869800640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0848004d50 0x7f08480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f085be00640 1 -- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f086415ea30 msgr2=0x7f08480039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:24.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f085be00640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f086415ea30 0x7f08480039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f085be00640 1 -- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0848004d50 msgr2=0x7f08480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:24.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f085be00640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0848004d50 0x7f08480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f085be00640 1 -- 172.21.15.28:0/3759640297 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0848003530 con 0x7f0848003f30 2024-04-23T18:23:24.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.451+0000 7f0869800640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0848004d50 0x7f08480051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:24.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f085be00640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0848003f30 0x7f0848004810 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f084c009ae0 tx=0x7f084c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cf5d55eab454e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:24.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c0096b0 con 0x7f0848003f30 2024-04-23T18:23:24.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084c0a64a0 con 0x7f0848003f30 2024-04-23T18:23:24.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f0863e00640 1 -- 172.21.15.28:0/3759640297 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c0a6890 con 0x7f0848003f30 2024-04-23T18:23:24.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f086a200640 1 -- 172.21.15.28:0/3759640297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0848003f30 msgr2=0x7f0848004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f086a200640 1 --2- 172.21.15.28:0/3759640297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0848003f30 0x7f0848004810 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f084c009ae0 tx=0x7f084c01c9b0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f0869800640 1 -- 172.21.15.28:0/3759640297 reap_dead start 2024-04-23T18:23:24.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f086a200640 1 -- 172.21.15.28:0/3759640297 shutdown_connections 2024-04-23T18:23:24.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f086a200640 1 -- 172.21.15.28:0/3759640297 >> 172.21.15.28:0/3759640297 conn(0x7f086406b9e0 msgr2=0x7f086406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:24.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f086a200640 1 -- 172.21.15.28:0/3759640297 shutdown_connections 2024-04-23T18:23:24.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f086a200640 1 -- 172.21.15.28:0/3759640297 wait complete. 2024-04-23T18:23:24.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.455+0000 7f086a200640 1 Processor -- start 2024-04-23T18:23:24.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f086a200640 1 -- start start 2024-04-23T18:23:24.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f086a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0848003f30 0x7f086414b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f086a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08641e3b20 0x7f0864153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f086a200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08641543e0 0x7f08641f0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f086a200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f086415b550 con 0x7f08641543e0 2024-04-23T18:23:24.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f086a200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f086415e5a0 con 0x7f08641e3b20 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f086a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f086415b830 con 0x7f0848003f30 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0869800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08641543e0 0x7f08641f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0869800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08641543e0 0x7f08641f0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49894/0 (socket says 172.21.15.28:49894) 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0869800640 1 -- 172.21.15.28:0/3571003665 learned_addr learned my addr 172.21.15.28:0/3571003665 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0868e00640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0848003f30 0x7f086414b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f085be00640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08641e3b20 0x7f0864153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0869800640 1 -- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0848003f30 msgr2=0x7f086414b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0869800640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0848003f30 0x7f086414b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0869800640 1 -- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08641e3b20 msgr2=0x7f0864153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0869800640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08641e3b20 0x7f0864153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0869800640 1 -- 172.21.15.28:0/3571003665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0864154b50 con 0x7f08641543e0 2024-04-23T18:23:24.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0869800640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08641543e0 0x7f08641f0640 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f085c004c00 tx=0x7f085c010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:24.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0861600640 1 -- 172.21.15.28:0/3571003665 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c01a070 con 0x7f08641543e0 2024-04-23T18:23:24.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0861600640 1 -- 172.21.15.28:0/3571003665 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f085c011040 con 0x7f08641543e0 2024-04-23T18:23:24.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f0861600640 1 -- 172.21.15.28:0/3571003665 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c00ea70 con 0x7f08641543e0 2024-04-23T18:23:24.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f086a200640 1 -- 172.21.15.28:0/3571003665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08641f4a80 con 0x7f08641543e0 2024-04-23T18:23:24.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f086a200640 1 -- 172.21.15.28:0/3571003665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0864154870 con 0x7f08641543e0 2024-04-23T18:23:24.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.459+0000 7f086a200640 1 -- 172.21.15.28:0/3571003665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0864068cd0 con 0x7f08641543e0 2024-04-23T18:23:24.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.463+0000 7f0861600640 1 -- 172.21.15.28:0/3571003665 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f085c00ec10 con 0x7f08641543e0 2024-04-23T18:23:24.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.463+0000 7f0861600640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08400683b0 0x7f084006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.463+0000 7f0861600640 1 -- 172.21.15.28:0/3571003665 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f085c089280 con 0x7f08641543e0 2024-04-23T18:23:24.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.463+0000 7f0868e00640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08400683b0 0x7f084006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.463+0000 7f0868e00640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08400683b0 0x7f084006a870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0854000c10 tx=0x7f0854009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:24.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.467+0000 7f0861600640 1 -- 172.21.15.28:0/3571003665 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0864072860 con 0x7f08641543e0 2024-04-23T18:23:24.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.631+0000 7f086a200640 1 -- 172.21.15.28:0/3571003665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0864159e60 con 0x7f08641543e0 2024-04-23T18:23:24.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.631+0000 7f0861600640 1 -- 172.21.15.28:0/3571003665 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f085c059310 con 0x7f08641543e0 2024-04-23T18:23:24.626 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:23:24.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 -- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08400683b0 msgr2=0x7f084006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08400683b0 0x7f084006a870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0854000c10 tx=0x7f0854009040 comp rx=0 tx=0).stop 2024-04-23T18:23:24.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 -- 172.21.15.28:0/3571003665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08641543e0 msgr2=0x7f08641f0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08641543e0 0x7f08641f0640 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f085c004c00 tx=0x7f085c010b70 comp rx=0 tx=0).stop 2024-04-23T18:23:24.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 -- 172.21.15.28:0/3571003665 shutdown_connections 2024-04-23T18:23:24.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f08400683b0 0x7f084006a870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f08641543e0 0x7f08641f0640 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08641e3b20 0x7f0864153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 --2- 172.21.15.28:0/3571003665 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0848003f30 0x7f086414b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 -- 172.21.15.28:0/3571003665 >> 172.21.15.28:0/3571003665 conn(0x7f086406b9e0 msgr2=0x7f0864071ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:24.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 -- 172.21.15.28:0/3571003665 shutdown_connections 2024-04-23T18:23:24.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.635+0000 7f086a200640 1 -- 172.21.15.28:0/3571003665 wait complete. 2024-04-23T18:23:24.647 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T18:23:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.795+0000 7f988ac00640 1 Processor -- start 2024-04-23T18:23:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.795+0000 7f988ac00640 1 -- start start 2024-04-23T18:23:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9884154ee0 0x7f98840713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988ac00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9884070ec0 0x7f988406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988ac00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f988406bf20 0x7f98840ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988ac00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f988415b320 con 0x7f988406bf20 2024-04-23T18:23:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988ac00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f988415b600 con 0x7f9884070ec0 2024-04-23T18:23:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f988415b8e0 con 0x7f9884154ee0 2024-04-23T18:23:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988a200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f988406bf20 0x7f98840ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988a200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f988406bf20 0x7f98840ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49902/0 (socket says 172.21.15.28:49902) 2024-04-23T18:23:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988a200640 1 -- 172.21.15.28:0/927994753 learned_addr learned my addr 172.21.15.28:0/927994753 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f9888e00640 1 --2- 172.21.15.28:0/927994753 >> v2:172.21.15.137:3300/0 conn(0x7f9884070ec0 0x7f988406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f9889800640 1 --2- 172.21.15.28:0/927994753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9884154ee0 0x7f98840713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988a200640 1 -- 172.21.15.28:0/927994753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9884154ee0 msgr2=0x7f98840713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988a200640 1 --2- 172.21.15.28:0/927994753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9884154ee0 0x7f98840713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988a200640 1 -- 172.21.15.28:0/927994753 >> v2:172.21.15.137:3300/0 conn(0x7f9884070ec0 msgr2=0x7f988406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988a200640 1 --2- 172.21.15.28:0/927994753 >> v2:172.21.15.137:3300/0 conn(0x7f9884070ec0 0x7f988406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988a200640 1 -- 172.21.15.28:0/927994753 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988415bbc0 con 0x7f988406bf20 2024-04-23T18:23:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f9889800640 1 --2- 172.21.15.28:0/927994753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9884154ee0 0x7f98840713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f9888e00640 1 --2- 172.21.15.28:0/927994753 >> v2:172.21.15.137:3300/0 conn(0x7f9884070ec0 0x7f988406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.799+0000 7f988a200640 1 --2- 172.21.15.28:0/927994753 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f988406bf20 0x7f98840ca290 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9884072460 tx=0x7f987c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78d679b6ae85583 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f9883e00640 1 -- 172.21.15.28:0/927994753 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c0b4070 con 0x7f988406bf20 2024-04-23T18:23:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f9883e00640 1 -- 172.21.15.28:0/927994753 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f987c0af400 con 0x7f988406bf20 2024-04-23T18:23:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f9883e00640 1 -- 172.21.15.28:0/927994753 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c0af7d0 con 0x7f988406bf20 2024-04-23T18:23:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 -- 172.21.15.28:0/927994753 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f988406bf20 msgr2=0x7f98840ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 --2- 172.21.15.28:0/927994753 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f988406bf20 0x7f98840ca290 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9884072460 tx=0x7f987c01f1e0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 -- 172.21.15.28:0/927994753 shutdown_connections 2024-04-23T18:23:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 --2- 172.21.15.28:0/927994753 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f988406bf20 0x7f98840ca290 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 --2- 172.21.15.28:0/927994753 >> v2:172.21.15.137:3300/0 conn(0x7f9884070ec0 0x7f988406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 --2- 172.21.15.28:0/927994753 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9884154ee0 0x7f98840713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 -- 172.21.15.28:0/927994753 >> 172.21.15.28:0/927994753 conn(0x7f98840ce5e0 msgr2=0x7f98840ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 -- 172.21.15.28:0/927994753 shutdown_connections 2024-04-23T18:23:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 -- 172.21.15.28:0/927994753 wait complete. 2024-04-23T18:23:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 Processor -- start 2024-04-23T18:23:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 -- start start 2024-04-23T18:23:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f988406bf20 0x7f988414a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9884070ec0 0x7f988415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9884154ee0 0x7f988415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9884155440 con 0x7f988406bf20 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98841552c0 con 0x7f9884070ec0 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f988415af00 con 0x7f9884154ee0 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f9889800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f988406bf20 0x7f988414a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f9889800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f988406bf20 0x7f988414a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49912/0 (socket says 172.21.15.28:49912) 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f9889800640 1 -- 172.21.15.28:0/148282268 learned_addr learned my addr 172.21.15.28:0/148282268 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f9888e00640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9884070ec0 0x7f988415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.803+0000 7f988a200640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9884154ee0 0x7f988415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9889800640 1 -- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9884154ee0 msgr2=0x7f988415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9889800640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9884154ee0 0x7f988415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9889800640 1 -- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9884070ec0 msgr2=0x7f988415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9889800640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9884070ec0 0x7f988415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9889800640 1 -- 172.21.15.28:0/148282268 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988415d9f0 con 0x7f988406bf20 2024-04-23T18:23:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9889800640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f988406bf20 0x7f988414a8c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f987800e840 tx=0x7f987800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9881600640 1 -- 172.21.15.28:0/148282268 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878017070 con 0x7f988406bf20 2024-04-23T18:23:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9881600640 1 -- 172.21.15.28:0/148282268 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f987800c8d0 con 0x7f988406bf20 2024-04-23T18:23:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f988ac00640 1 -- 172.21.15.28:0/148282268 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988415d710 con 0x7f988406bf20 2024-04-23T18:23:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9881600640 1 -- 172.21.15.28:0/148282268 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987800f040 con 0x7f988406bf20 2024-04-23T18:23:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f988ac00640 1 -- 172.21.15.28:0/148282268 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98841f1730 con 0x7f988406bf20 2024-04-23T18:23:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f988ac00640 1 -- 172.21.15.28:0/148282268 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9884068cd0 con 0x7f988406bf20 2024-04-23T18:23:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9881600640 1 -- 172.21.15.28:0/148282268 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f987801a070 con 0x7f988406bf20 2024-04-23T18:23:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9881600640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f98640683b0 0x7f986406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.807+0000 7f9881600640 1 -- 172.21.15.28:0/148282268 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f98780869c0 con 0x7f988406bf20 2024-04-23T18:23:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.811+0000 7f9888e00640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f98640683b0 0x7f986406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:24.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.811+0000 7f9888e00640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f98640683b0 0x7f986406a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f988406c7b0 tx=0x7f9870008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:24.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.811+0000 7f9881600640 1 -- 172.21.15.28:0/148282268 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9878056ae0 con 0x7f988406bf20 2024-04-23T18:23:24.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 -- 172.21.15.28:0/148282268 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f98840c9600 con 0x7f988406bf20 2024-04-23T18:23:24.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f9881600640 1 -- 172.21.15.28:0/148282268 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f98780563e0 con 0x7f988406bf20 2024-04-23T18:23:24.972 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2024-04-23T18:23:24.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 -- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f98640683b0 msgr2=0x7f986406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f98640683b0 0x7f986406a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f988406c7b0 tx=0x7f9870008040 comp rx=0 tx=0).stop 2024-04-23T18:23:24.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 -- 172.21.15.28:0/148282268 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f988406bf20 msgr2=0x7f988414a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:24.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f988406bf20 0x7f988414a8c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f987800e840 tx=0x7f987800ed00 comp rx=0 tx=0).stop 2024-04-23T18:23:24.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 -- 172.21.15.28:0/148282268 shutdown_connections 2024-04-23T18:23:24.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f98640683b0 0x7f986406a870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9884154ee0 0x7f988415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9884070ec0 0x7f988415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 --2- 172.21.15.28:0/148282268 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f988406bf20 0x7f988414a8c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:24.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 -- 172.21.15.28:0/148282268 >> 172.21.15.28:0/148282268 conn(0x7f98840ce5e0 msgr2=0x7f98840702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:24.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 -- 172.21.15.28:0/148282268 shutdown_connections 2024-04-23T18:23:24.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:24.979+0000 7f988ac00640 1 -- 172.21.15.28:0/148282268 wait complete. 2024-04-23T18:23:24.994 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T18:23:25.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f8025000640 1 Processor -- start 2024-04-23T18:23:25.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f8025000640 1 -- start start 2024-04-23T18:23:25.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f8025000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f80201552d0 0x7f80200ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f8025000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f802015f140 0x7f802006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f8025000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8020072860 con 0x7f80200ca5e0 2024-04-23T18:23:25.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f8025000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f802015e5a0 con 0x7f80201552d0 2024-04-23T18:23:25.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f8025000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f80201556b0 con 0x7f802015f140 2024-04-23T18:23:25.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f8017e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f80200ca5e0 0x7f802015ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49994/0 (socket says 172.21.15.28:49994) 2024-04-23T18:23:25.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f8017e00640 1 -- 172.21.15.28:0/428273127 learned_addr learned my addr 172.21.15.28:0/428273127 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:25.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f801fe00640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f802015f140 0x7f802006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f801f400640 1 --2- 172.21.15.28:0/428273127 >> v2:172.21.15.137:3300/0 conn(0x7f80201552d0 0x7f80200ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698016817 0 0) 0x7f8008001120 con 0x7f80200ca5e0 2024-04-23T18:23:25.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.143+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8004003530 con 0x7f80200ca5e0 2024-04-23T18:23:25.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2473888501 0 0) 0x7f8004003530 con 0x7f80200ca5e0 2024-04-23T18:23:25.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f802015f140 msgr2=0x7f802006fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:25.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f802015f140 0x7f802006fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 >> v2:172.21.15.137:3300/0 conn(0x7f80201552d0 msgr2=0x7f80200ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:25.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 --2- 172.21.15.28:0/428273127 >> v2:172.21.15.137:3300/0 conn(0x7f80201552d0 0x7f80200ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802015afb0 con 0x7f80200ca5e0 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f8008001850 con 0x7f80200ca5e0 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 >> v1:172.21.15.28:6789/0 conn(0x7f80200ca5e0 legacy=0x7f802015ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 0x7f8004003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f802015f140 0x7f8004004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8004004d50 0x7f80040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f802015e5a0 con 0x7f80040039c0 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80201556b0 con 0x7f8004004d50 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f800400b9d0 con 0x7f802015f140 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801f400640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 0x7f8004003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f8017e00640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f802015f140 0x7f8004004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801fe00640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8004004d50 0x7f80040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801f400640 1 -- 172.21.15.28:0/428273127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f802015f140 msgr2=0x7f8004004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801f400640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f802015f140 0x7f8004004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801f400640 1 -- 172.21.15.28:0/428273127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8004004d50 msgr2=0x7f80040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:25.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801f400640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8004004d50 0x7f80040051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801f400640 1 -- 172.21.15.28:0/428273127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8004003530 con 0x7f80040039c0 2024-04-23T18:23:25.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.147+0000 7f801f400640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 0x7f8004003de0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8010009ae0 tx=0x7f801001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9872ae9cc0bf7bb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:25.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80100b2070 con 0x7f80040039c0 2024-04-23T18:23:25.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80100a56a0 con 0x7f80040039c0 2024-04-23T18:23:25.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f801ea00640 1 -- 172.21.15.28:0/428273127 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80100096b0 con 0x7f80040039c0 2024-04-23T18:23:25.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 -- 172.21.15.28:0/428273127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 msgr2=0x7f8004003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 --2- 172.21.15.28:0/428273127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 0x7f8004003de0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8010009ae0 tx=0x7f801001cab0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f801fe00640 1 -- 172.21.15.28:0/428273127 reap_dead start 2024-04-23T18:23:25.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 -- 172.21.15.28:0/428273127 shutdown_connections 2024-04-23T18:23:25.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 -- 172.21.15.28:0/428273127 >> 172.21.15.28:0/428273127 conn(0x7f802006b9e0 msgr2=0x7f802006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:25.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 -- 172.21.15.28:0/428273127 shutdown_connections 2024-04-23T18:23:25.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 -- 172.21.15.28:0/428273127 wait complete. 2024-04-23T18:23:25.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 Processor -- start 2024-04-23T18:23:25.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 -- start start 2024-04-23T18:23:25.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 0x7f8020152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80200cde30 0x7f8020146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8020147120 0x7f8020147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f802015b830 con 0x7f80040039c0 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f802015b550 con 0x7f8020147120 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f8025000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f802015bb10 con 0x7f80200cde30 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f801f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 0x7f8020152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f801f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 0x7f8020152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49938/0 (socket says 172.21.15.28:49938) 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f801f400640 1 -- 172.21.15.28:0/3442628335 learned_addr learned my addr 172.21.15.28:0/3442628335 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.151+0000 7f801fe00640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8020147120 0x7f8020147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f8017e00640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80200cde30 0x7f8020146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f801f400640 1 -- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80200cde30 msgr2=0x7f8020146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f801f400640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80200cde30 0x7f8020146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f801f400640 1 -- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8020147120 msgr2=0x7f8020147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f801f400640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8020147120 0x7f8020147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f801f400640 1 -- 172.21.15.28:0/3442628335 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80201475a0 con 0x7f80040039c0 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f801fe00640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8020147120 0x7f8020147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:25.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f801f400640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 0x7f8020152010 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8010009a00 tx=0x7f8004005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:25.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f8017400640 1 -- 172.21.15.28:0/3442628335 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80100bc020 con 0x7f80040039c0 2024-04-23T18:23:25.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f8017400640 1 -- 172.21.15.28:0/3442628335 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8010004020 con 0x7f80040039c0 2024-04-23T18:23:25.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f8017400640 1 -- 172.21.15.28:0/3442628335 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80100b2040 con 0x7f80040039c0 2024-04-23T18:23:25.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f8025000640 1 -- 172.21.15.28:0/3442628335 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80201f5140 con 0x7f80040039c0 2024-04-23T18:23:25.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f8025000640 1 -- 172.21.15.28:0/3442628335 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8020145f40 con 0x7f80040039c0 2024-04-23T18:23:25.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f8025000640 1 -- 172.21.15.28:0/3442628335 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8020068cd0 con 0x7f80040039c0 2024-04-23T18:23:25.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f8017400640 1 -- 172.21.15.28:0/3442628335 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8010003620 con 0x7f80040039c0 2024-04-23T18:23:25.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f8017400640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7ffc068380 0x7f7ffc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.155+0000 7f8017400640 1 -- 172.21.15.28:0/3442628335 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f80101211b0 con 0x7f80040039c0 2024-04-23T18:23:25.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.159+0000 7f8017e00640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7ffc068380 0x7f7ffc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.159+0000 7f8017e00640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7ffc068380 0x7f7ffc06a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80200c89f0 tx=0x7f8008009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:25.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.159+0000 7f8017400640 1 -- 172.21.15.28:0/3442628335 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f80100c6020 con 0x7f80040039c0 2024-04-23T18:23:25.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 -- 172.21.15.28:0/3442628335 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f802014b860 con 0x7f80040039c0 2024-04-23T18:23:25.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8017400640 1 -- 172.21.15.28:0/3442628335 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f80201475a0 con 0x7f80040039c0 2024-04-23T18:23:25.320 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:23:25.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 -- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7ffc068380 msgr2=0x7f7ffc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7ffc068380 0x7f7ffc06a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80200c89f0 tx=0x7f8008009040 comp rx=0 tx=0).stop 2024-04-23T18:23:25.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 -- 172.21.15.28:0/3442628335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 msgr2=0x7f8020152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 0x7f8020152010 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8010009a00 tx=0x7f8004005840 comp rx=0 tx=0).stop 2024-04-23T18:23:25.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 -- 172.21.15.28:0/3442628335 shutdown_connections 2024-04-23T18:23:25.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f7ffc068380 0x7f7ffc06a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f80200cde30 0x7f8020146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8020147120 0x7f8020147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 --2- 172.21.15.28:0/3442628335 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80040039c0 0x7f8020152010 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 -- 172.21.15.28:0/3442628335 >> 172.21.15.28:0/3442628335 conn(0x7f802006b9e0 msgr2=0x7f8020071ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:25.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 -- 172.21.15.28:0/3442628335 shutdown_connections 2024-04-23T18:23:25.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.327+0000 7f8025000640 1 -- 172.21.15.28:0/3442628335 wait complete. 2024-04-23T18:23:25.342 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:23:25.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.491+0000 7fae8a200640 1 Processor -- start 2024-04-23T18:23:25.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.491+0000 7fae8a200640 1 -- start start 2024-04-23T18:23:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.491+0000 7fae8a200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fae840738c0 0x7fae840c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.491+0000 7fae8a200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae84075970 con 0x7fae840c79e0 2024-04-23T18:23:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.491+0000 7fae8a200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae84075c10 con 0x7fae840b2310 2024-04-23T18:23:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.491+0000 7fae8a200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fae8406cbd0 con 0x7fae840738c0 2024-04-23T18:23:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.491+0000 7fae83e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fae840c79e0 0x7fae84165b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:50008/0 (socket says 172.21.15.28:50008) 2024-04-23T18:23:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.491+0000 7fae83e00640 1 -- 172.21.15.28:0/3868730945 learned_addr learned my addr 172.21.15.28:0/3868730945 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.491+0000 7fae83400640 1 --2- 172.21.15.28:0/3868730945 >> v2:172.21.15.137:3300/0 conn(0x7fae840738c0 0x7fae840c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.495+0000 7fae82000640 1 -- 172.21.15.28:0/3868730945 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2523746903 0 0) 0x7fae84075970 con 0x7fae840c79e0 2024-04-23T18:23:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.495+0000 7fae82000640 1 -- 172.21.15.28:0/3868730945 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae68003530 con 0x7fae840c79e0 2024-04-23T18:23:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.495+0000 7fae82000640 1 -- 172.21.15.28:0/3868730945 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2991832292 0 0) 0x7fae68003530 con 0x7fae840c79e0 2024-04-23T18:23:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.495+0000 7fae83400640 1 -- 172.21.15.28:0/3868730945 >> v1:172.21.15.137:6789/0 conn(0x7fae840b2310 legacy=0x7fae840c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.495+0000 7fae83400640 1 -- 172.21.15.28:0/3868730945 >> v1:172.21.15.28:6789/0 conn(0x7fae840c79e0 legacy=0x7fae84165b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.495+0000 7fae83400640 1 -- 172.21.15.28:0/3868730945 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae840c8d30 con 0x7fae840738c0 2024-04-23T18:23:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.495+0000 7fae83400640 1 --2- 172.21.15.28:0/3868730945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae840738c0 0x7fae840c9530 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae740097c0 tx=0x7fae7401ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86dce99207639015 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.495+0000 7fae82000640 1 -- 172.21.15.28:0/3868730945 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740b5070 con 0x7fae840738c0 2024-04-23T18:23:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.495+0000 7fae82000640 1 -- 172.21.15.28:0/3868730945 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae740a8630 con 0x7fae840738c0 2024-04-23T18:23:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.495+0000 7fae82000640 1 -- 172.21.15.28:0/3868730945 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c001a20 con 0x7fae840738c0 2024-04-23T18:23:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 -- 172.21.15.28:0/3868730945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae840738c0 msgr2=0x7fae840c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 --2- 172.21.15.28:0/3868730945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae840738c0 0x7fae840c9530 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae740097c0 tx=0x7fae7401ebb0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 -- 172.21.15.28:0/3868730945 shutdown_connections 2024-04-23T18:23:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 --2- 172.21.15.28:0/3868730945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae840738c0 0x7fae840c9530 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 -- 172.21.15.28:0/3868730945 >> 172.21.15.28:0/3868730945 conn(0x7fae840ccfe0 msgr2=0x7fae840cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 -- 172.21.15.28:0/3868730945 shutdown_connections 2024-04-23T18:23:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 -- 172.21.15.28:0/3868730945 wait complete. 2024-04-23T18:23:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 Processor -- start 2024-04-23T18:23:25.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 -- start start 2024-04-23T18:23:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae840738c0 0x7fae840b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae840b2310 0x7fae8415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae840c79e0 0x7fae8415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fae840c4240 con 0x7fae840c79e0 2024-04-23T18:23:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fae84155a70 con 0x7fae840b2310 2024-04-23T18:23:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae8a200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fae840c90a0 con 0x7fae840738c0 2024-04-23T18:23:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae83e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae840c79e0 0x7fae8415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae83e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae840c79e0 0x7fae8415a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49946/0 (socket says 172.21.15.28:49946) 2024-04-23T18:23:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae83e00640 1 -- 172.21.15.28:0/295875573 learned_addr learned my addr 172.21.15.28:0/295875573 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae82a00640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae840b2310 0x7fae8415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae83400640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae840738c0 0x7fae840b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae83e00640 1 -- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae840738c0 msgr2=0x7fae840b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae83e00640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae840738c0 0x7fae840b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae83e00640 1 -- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae840b2310 msgr2=0x7fae8415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae83e00640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae840b2310 0x7fae8415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.499+0000 7fae83e00640 1 -- 172.21.15.28:0/295875573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae841f3ff0 con 0x7fae840c79e0 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.503+0000 7fae83e00640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae840c79e0 0x7fae8415a9f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00c840 tx=0x7fae7c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.503+0000 7fae7b400640 1 -- 172.21.15.28:0/295875573 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c018070 con 0x7fae840c79e0 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.503+0000 7fae7b400640 1 -- 172.21.15.28:0/295875573 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7c00a640 con 0x7fae840c79e0 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.503+0000 7fae7b400640 1 -- 172.21.15.28:0/295875573 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00aa70 con 0x7fae840c79e0 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.503+0000 7fae8a200640 1 -- 172.21.15.28:0/295875573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae841f4290 con 0x7fae840c79e0 2024-04-23T18:23:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.503+0000 7fae8a200640 1 -- 172.21.15.28:0/295875573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae841f4850 con 0x7fae840c79e0 2024-04-23T18:23:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.503+0000 7fae8a200640 1 -- 172.21.15.28:0/295875573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae84068cd0 con 0x7fae840c79e0 2024-04-23T18:23:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.503+0000 7fae7b400640 1 -- 172.21.15.28:0/295875573 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fae7c00ac10 con 0x7fae840c79e0 2024-04-23T18:23:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.503+0000 7fae7b400640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fae64068380 0x7fae6406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.503+0000 7fae7b400640 1 -- 172.21.15.28:0/295875573 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fae7c086550 con 0x7fae840c79e0 2024-04-23T18:23:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.503+0000 7fae83400640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fae64068380 0x7fae6406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.507+0000 7fae83400640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fae64068380 0x7fae6406a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fae740b2000 tx=0x7fae740aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:25.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.507+0000 7fae7b400640 1 -- 172.21.15.28:0/295875573 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fae7c056700 con 0x7fae840c79e0 2024-04-23T18:23:25.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.711+0000 7fae8a200640 1 -- 172.21.15.28:0/295875573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae840c2990 con 0x7fae840c79e0 2024-04-23T18:23:25.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.711+0000 7fae7b400640 1 -- 172.21.15.28:0/295875573 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7fae7c056000 con 0x7fae840c79e0 2024-04-23T18:23:25.707 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:25.707 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:23:25.707 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:23:25.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 -- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fae64068380 msgr2=0x7fae6406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fae64068380 0x7fae6406a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fae740b2000 tx=0x7fae740aa070 comp rx=0 tx=0).stop 2024-04-23T18:23:25.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 -- 172.21.15.28:0/295875573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae840c79e0 msgr2=0x7fae8415a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae840c79e0 0x7fae8415a9f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00c840 tx=0x7fae7c00cd00 comp rx=0 tx=0).stop 2024-04-23T18:23:25.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 -- 172.21.15.28:0/295875573 shutdown_connections 2024-04-23T18:23:25.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fae64068380 0x7fae6406a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae840c79e0 0x7fae8415a9f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae840b2310 0x7fae8415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 --2- 172.21.15.28:0/295875573 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fae840738c0 0x7fae840b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 -- 172.21.15.28:0/295875573 >> 172.21.15.28:0/295875573 conn(0x7fae840ccfe0 msgr2=0x7fae840c2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:25.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 -- 172.21.15.28:0/295875573 shutdown_connections 2024-04-23T18:23:25.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.715+0000 7fae8a200640 1 -- 172.21.15.28:0/295875573 wait complete. 2024-04-23T18:23:25.729 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:23:25.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c3a000640 1 Processor -- start 2024-04-23T18:23:25.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c3a000640 1 -- start start 2024-04-23T18:23:25.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c3a000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6c34073020 0x7f6c34070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c3a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c340c5750 0x7f6c34142010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c3a000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c340714f0 con 0x7f6c340c8980 2024-04-23T18:23:25.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c3a000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f6c340c5c50 con 0x7f6c34073020 2024-04-23T18:23:25.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c3a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6c340c5f30 con 0x7f6c340c5750 2024-04-23T18:23:25.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c33400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6c34073020 0x7f6c34070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c33400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6c34073020 0x7f6c34070e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49948/0 (socket says 172.21.15.28:49948) 2024-04-23T18:23:25.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c33400640 1 -- 172.21.15.28:0/265726432 learned_addr learned my addr 172.21.15.28:0/265726432 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:25.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c2aa00640 1 --2- 172.21.15.28:0/265726432 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c340c5750 0x7f6c34142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c33400640 1 -- 172.21.15.28:0/265726432 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c340c5750 msgr2=0x7f6c34142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:25.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c33400640 1 --2- 172.21.15.28:0/265726432 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c340c5750 0x7f6c34142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c33400640 1 -- 172.21.15.28:0/265726432 >> v1:172.21.15.137:6789/0 conn(0x7f6c340c8980 legacy=0x7f6c34159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.875+0000 7f6c33400640 1 -- 172.21.15.28:0/265726432 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c340c6210 con 0x7f6c34073020 2024-04-23T18:23:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c33400640 1 --2- 172.21.15.28:0/265726432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c34073020 0x7f6c34070e90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009870 tx=0x7f6c2401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6127f57e082e1c53 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c32a00640 1 -- 172.21.15.28:0/265726432 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240b5070 con 0x7f6c34073020 2024-04-23T18:23:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c32a00640 1 -- 172.21.15.28:0/265726432 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c240a8a50 con 0x7f6c34073020 2024-04-23T18:23:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c32a00640 1 -- 172.21.15.28:0/265726432 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240a8e20 con 0x7f6c34073020 2024-04-23T18:23:25.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c3a000640 1 -- 172.21.15.28:0/265726432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c34073020 msgr2=0x7f6c34070e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c3a000640 1 --2- 172.21.15.28:0/265726432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c34073020 0x7f6c34070e90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009870 tx=0x7f6c2401ed50 comp rx=0 tx=0).stop 2024-04-23T18:23:25.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c3a000640 1 -- 172.21.15.28:0/265726432 shutdown_connections 2024-04-23T18:23:25.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c3a000640 1 --2- 172.21.15.28:0/265726432 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c340c5750 0x7f6c34142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c3a000640 1 --2- 172.21.15.28:0/265726432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c34073020 0x7f6c34070e90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c3a000640 1 -- 172.21.15.28:0/265726432 >> 172.21.15.28:0/265726432 conn(0x7f6c340676e0 msgr2=0x7f6c34067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:25.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c3a000640 1 -- 172.21.15.28:0/265726432 shutdown_connections 2024-04-23T18:23:25.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.879+0000 7f6c3a000640 1 -- 172.21.15.28:0/265726432 wait complete. 2024-04-23T18:23:25.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c3a000640 1 Processor -- start 2024-04-23T18:23:25.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c3a000640 1 -- start start 2024-04-23T18:23:25.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c3a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c34073020 0x7f6c340cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c3a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c340c5750 0x7f6c341e4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c3a000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c340c8980 0x7f6c34137e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c3a000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c34073400 con 0x7f6c340c8980 2024-04-23T18:23:25.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c3a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c340c67d0 con 0x7f6c340c5750 2024-04-23T18:23:25.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c3a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6c34073580 con 0x7f6c34073020 2024-04-23T18:23:25.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c33e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c340c8980 0x7f6c34137e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c33e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c340c8980 0x7f6c34137e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49956/0 (socket says 172.21.15.28:49956) 2024-04-23T18:23:25.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c33e00640 1 -- 172.21.15.28:0/39724514 learned_addr learned my addr 172.21.15.28:0/39724514 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:25.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c33400640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c34073020 0x7f6c340cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c2aa00640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c340c5750 0x7f6c341e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c33e00640 1 -- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c34073020 msgr2=0x7f6c340cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c33e00640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c34073020 0x7f6c340cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c33e00640 1 -- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c340c5750 msgr2=0x7f6c341e4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:25.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c33e00640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c340c5750 0x7f6c341e4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:25.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c33e00640 1 -- 172.21.15.28:0/39724514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c341e3f80 con 0x7f6c340c8980 2024-04-23T18:23:25.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c33e00640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c340c8980 0x7f6c34137e90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00c730 tx=0x7f6c2c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:25.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c2be00640 1 -- 172.21.15.28:0/39724514 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c003b80 con 0x7f6c340c8980 2024-04-23T18:23:25.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c2be00640 1 -- 172.21.15.28:0/39724514 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2c003d20 con 0x7f6c340c8980 2024-04-23T18:23:25.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c2be00640 1 -- 172.21.15.28:0/39724514 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c005310 con 0x7f6c340c8980 2024-04-23T18:23:25.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c3a000640 1 -- 172.21.15.28:0/39724514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c340cac90 con 0x7f6c340c8980 2024-04-23T18:23:25.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c3a000640 1 -- 172.21.15.28:0/39724514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c340cc890 con 0x7f6c340c8980 2024-04-23T18:23:25.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.883+0000 7f6c3a000640 1 -- 172.21.15.28:0/39724514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c34068cd0 con 0x7f6c340c8980 2024-04-23T18:23:25.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.887+0000 7f6c2be00640 1 -- 172.21.15.28:0/39724514 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c2c0056c0 con 0x7f6c340c8980 2024-04-23T18:23:25.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.887+0000 7f6c2be00640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6c10068380 0x7f6c1006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:25.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.887+0000 7f6c2be00640 1 -- 172.21.15.28:0/39724514 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6c2c086d90 con 0x7f6c340c8980 2024-04-23T18:23:25.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.887+0000 7f6c33400640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6c10068380 0x7f6c1006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:25.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.887+0000 7f6c33400640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6c10068380 0x7f6c1006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c240b2000 tx=0x7f6c24009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:25.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:25.891+0000 7f6c2be00640 1 -- 172.21.15.28:0/39724514 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6c2c056eb0 con 0x7f6c340c8980 2024-04-23T18:23:26.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.055+0000 7f6c3a000640 1 -- 172.21.15.28:0/39724514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c3413f880 con 0x7f6c340c8980 2024-04-23T18:23:26.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.055+0000 7f6c2be00640 1 -- 172.21.15.28:0/39724514 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18891 (secure 0 0 0) 0x7f6c2c0567b0 con 0x7f6c340c8980 2024-04-23T18:23:26.051 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:26.051 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:23:14.705611+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:23:26.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 -- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6c10068380 msgr2=0x7f6c1006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:26.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6c10068380 0x7f6c1006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c240b2000 tx=0x7f6c24009040 comp rx=0 tx=0).stop 2024-04-23T18:23:26.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 -- 172.21.15.28:0/39724514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c340c8980 msgr2=0x7f6c34137e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:26.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c340c8980 0x7f6c34137e90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00c730 tx=0x7f6c2c00cbf0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 -- 172.21.15.28:0/39724514 shutdown_connections 2024-04-23T18:23:26.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6c10068380 0x7f6c1006a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6c340c8980 0x7f6c34137e90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c340c5750 0x7f6c341e4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 --2- 172.21.15.28:0/39724514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6c34073020 0x7f6c340cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 -- 172.21.15.28:0/39724514 >> 172.21.15.28:0/39724514 conn(0x7f6c340676e0 msgr2=0x7f6c3406b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:26.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 -- 172.21.15.28:0/39724514 shutdown_connections 2024-04-23T18:23:26.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.059+0000 7f6c3a000640 1 -- 172.21.15.28:0/39724514 wait complete. 2024-04-23T18:23:26.073 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with random seed 913573 2024-04-23T18:23:26.074 DEBUG:tasks.quiescer:Yielding 2024-04-23T18:23:26.074 INFO:teuthology.run_tasks:Running task workunit... 2024-04-23T18:23:26.086 INFO:tasks.workunit:Pulling workunits from ref 57e0caf76fdb7ab8b1358588f292d08519163844 2024-04-23T18:23:26.086 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-23T18:23:26.086 INFO:tasks.workunit:timeout=3h 2024-04-23T18:23:26.087 INFO:tasks.workunit:cleanup=True 2024-04-23T18:23:26.087 DEBUG:teuthology.orchestra.run.smithi028:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-23T18:23:26.087 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:23:26.096 INFO:teuthology.orchestra.run.smithi028.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-23T18:23:26.096 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-23T18:23:26.096 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-04-23T18:23:26.096 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:23:26.096 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-23T18:23:26.096 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-04-23 18:22:38.372267644 +0000 2024-04-23T18:23:26.096 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-04-23 18:22:48.084874788 +0000 2024-04-23T18:23:26.096 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-04-23 18:22:38.372267644 +0000 2024-04-23T18:23:26.096 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-23T18:23:26.096 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-23T18:23:26.174 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 57e0caf76fdb7ab8b1358588f292d08519163844 2024-04-23T18:23:26.225 INFO:tasks.workunit.client.0.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-23T18:23:26.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e45000640 1 Processor -- start 2024-04-23T18:23:26.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e45000640 1 -- start start 2024-04-23T18:23:26.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e45000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e40153240 0x7f6e400c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:26.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e45000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e400c9370 con 0x7f6e4015c780 2024-04-23T18:23:26.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e45000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e40067930 con 0x7f6e400ce1c0 2024-04-23T18:23:26.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e45000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6e400676e0 con 0x7f6e40153240 2024-04-23T18:23:26.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e3e800640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6e4015c780 0x7f6e40163870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:50024/0 (socket says 172.21.15.28:50024) 2024-04-23T18:23:26.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e3e800640 1 -- 172.21.15.28:0/1706829971 learned_addr learned my addr 172.21.15.28:0/1706829971 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:26.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e3de00640 1 --2- 172.21.15.28:0/1706829971 >> v2:172.21.15.137:3300/0 conn(0x7f6e40153240 0x7f6e400c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:26.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e3d400640 1 -- 172.21.15.28:0/1706829971 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317802943 0 0) 0x7f6e400c9370 con 0x7f6e4015c780 2024-04-23T18:23:26.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e3d400640 1 -- 172.21.15.28:0/1706829971 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e24003530 con 0x7f6e4015c780 2024-04-23T18:23:26.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e3de00640 1 -- 172.21.15.28:0/1706829971 >> v1:172.21.15.137:6789/0 conn(0x7f6e400ce1c0 legacy=0x7f6e400c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:26.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e3de00640 1 -- 172.21.15.28:0/1706829971 >> v1:172.21.15.28:6789/0 conn(0x7f6e4015c780 legacy=0x7f6e40163870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:26.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.239+0000 7f6e3de00640 1 -- 172.21.15.28:0/1706829971 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e40067c10 con 0x7f6e40153240 2024-04-23T18:23:26.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.243+0000 7f6e3de00640 1 --2- 172.21.15.28:0/1706829971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e40153240 0x7f6e400c8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6e300097c0 tx=0x7f6e3001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bd6523e580b786d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:26.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.243+0000 7f6e3d400640 1 -- 172.21.15.28:0/1706829971 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e300b5070 con 0x7f6e40153240 2024-04-23T18:23:26.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.243+0000 7f6e3d400640 1 -- 172.21.15.28:0/1706829971 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300a8990 con 0x7f6e40153240 2024-04-23T18:23:26.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.243+0000 7f6e3d400640 1 -- 172.21.15.28:0/1706829971 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e300a8d40 con 0x7f6e40153240 2024-04-23T18:23:26.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.243+0000 7f6e45000640 1 -- 172.21.15.28:0/1706829971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e40153240 msgr2=0x7f6e400c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:26.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.243+0000 7f6e45000640 1 --2- 172.21.15.28:0/1706829971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e40153240 0x7f6e400c8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6e300097c0 tx=0x7f6e3001ec90 comp rx=0 tx=0).stop 2024-04-23T18:23:26.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.243+0000 7f6e45000640 1 -- 172.21.15.28:0/1706829971 shutdown_connections 2024-04-23T18:23:26.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.243+0000 7f6e45000640 1 --2- 172.21.15.28:0/1706829971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e40153240 0x7f6e400c8a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.243+0000 7f6e45000640 1 -- 172.21.15.28:0/1706829971 >> 172.21.15.28:0/1706829971 conn(0x7f6e400cd6a0 msgr2=0x7f6e400cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:26.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.243+0000 7f6e45000640 1 -- 172.21.15.28:0/1706829971 shutdown_connections 2024-04-23T18:23:26.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.243+0000 7f6e45000640 1 -- 172.21.15.28:0/1706829971 wait complete. 2024-04-23T18:23:26.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e45000640 1 Processor -- start 2024-04-23T18:23:26.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e45000640 1 -- start start 2024-04-23T18:23:26.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e45000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e400ce1c0 0x7f6e40156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:26.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e45000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e40153240 0x7f6e4014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:26.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e45000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e4015c780 0x7f6e40147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:26.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e45000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4006dcd0 con 0x7f6e400ce1c0 2024-04-23T18:23:26.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e45000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e400681d0 con 0x7f6e4015c780 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e45000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e40153620 con 0x7f6e40153240 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e3de00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e400ce1c0 0x7f6e40156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e3de00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e400ce1c0 0x7f6e40156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49966/0 (socket says 172.21.15.28:49966) 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e3de00640 1 -- 172.21.15.28:0/3513202273 learned_addr learned my addr 172.21.15.28:0/3513202273 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e3e800640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e4015c780 0x7f6e40147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e37e00640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e40153240 0x7f6e4014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e3de00640 1 -- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e40153240 msgr2=0x7f6e4014e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e3de00640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e40153240 0x7f6e4014e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e3de00640 1 -- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e4015c780 msgr2=0x7f6e40147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e3de00640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e4015c780 0x7f6e40147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e3de00640 1 -- 172.21.15.28:0/3513202273 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e40073c70 con 0x7f6e400ce1c0 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e37e00640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e40153240 0x7f6e4014e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:26.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e3de00640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e400ce1c0 0x7f6e40156e40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6e300097c0 tx=0x7f6e3001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e36000640 1 -- 172.21.15.28:0/3513202273 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e300b5040 con 0x7f6e400ce1c0 2024-04-23T18:23:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e36000640 1 -- 172.21.15.28:0/3513202273 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300c0070 con 0x7f6e400ce1c0 2024-04-23T18:23:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e45000640 1 -- 172.21.15.28:0/3513202273 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4014ecb0 con 0x7f6e400ce1c0 2024-04-23T18:23:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e36000640 1 -- 172.21.15.28:0/3513202273 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30004440 con 0x7f6e400ce1c0 2024-04-23T18:23:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.247+0000 7f6e45000640 1 -- 172.21.15.28:0/3513202273 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e4014f270 con 0x7f6e400ce1c0 2024-04-23T18:23:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.251+0000 7f6e45000640 1 -- 172.21.15.28:0/3513202273 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e40068cd0 con 0x7f6e400ce1c0 2024-04-23T18:23:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.251+0000 7f6e36000640 1 -- 172.21.15.28:0/3513202273 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6e30003620 con 0x7f6e400ce1c0 2024-04-23T18:23:26.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.251+0000 7f6e36000640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e1c068380 0x7f6e1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:26.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.251+0000 7f6e36000640 1 -- 172.21.15.28:0/3513202273 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6e30124110 con 0x7f6e400ce1c0 2024-04-23T18:23:26.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.251+0000 7f6e37e00640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e1c068380 0x7f6e1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:26.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.251+0000 7f6e37e00640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e1c068380 0x7f6e1c06a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e4006f4b0 tx=0x7f6e28009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:26.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.255+0000 7f6e36000640 1 -- 172.21.15.28:0/3513202273 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6e300ca020 con 0x7f6e400ce1c0 2024-04-23T18:23:26.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.491+0000 7f6e45000640 1 -- 172.21.15.28:0/3513202273 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e400c85e0 con 0x7f6e400ce1c0 2024-04-23T18:23:26.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.491+0000 7f6e36000640 1 -- 172.21.15.28:0/3513202273 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f6e300187f0 con 0x7f6e400ce1c0 2024-04-23T18:23:26.487 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:26.487 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:23:26.488 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:23:26.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 -- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e1c068380 msgr2=0x7f6e1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:26.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e1c068380 0x7f6e1c06a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e4006f4b0 tx=0x7f6e28009040 comp rx=0 tx=0).stop 2024-04-23T18:23:26.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 -- 172.21.15.28:0/3513202273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e400ce1c0 msgr2=0x7f6e40156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:26.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e400ce1c0 0x7f6e40156e40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6e300097c0 tx=0x7f6e3001ba30 comp rx=0 tx=0).stop 2024-04-23T18:23:26.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 -- 172.21.15.28:0/3513202273 shutdown_connections 2024-04-23T18:23:26.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e1c068380 0x7f6e1c06a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e40153240 0x7f6e4014e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e4015c780 0x7f6e40147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 --2- 172.21.15.28:0/3513202273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e400ce1c0 0x7f6e40156e40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:26.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 -- 172.21.15.28:0/3513202273 >> 172.21.15.28:0/3513202273 conn(0x7f6e400cd6a0 msgr2=0x7f6e400c8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:26.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 -- 172.21.15.28:0/3513202273 shutdown_connections 2024-04-23T18:23:26.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:26.495+0000 7f6e45000640 1 -- 172.21.15.28:0/3513202273 wait complete. 2024-04-23T18:23:27.116 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T18:22:32.759537+0000', 'modified': '2024-04-23T18:23:05.612086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4297, 'mds_1': 4294, 'mds_2': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'e', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.28:6837/1362691862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6836', 'nonce': 1362691862}, {'type': 'v1', 'addr': '172.21.15.28:6837', 'nonce': 1362691862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4294': {'gid': 4294, 'name': 'd', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.137:6838/1110609151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 1110609151}, {'type': 'v1', 'addr': '172.21.15.137:6838', 'nonce': 1110609151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.137:6839/1022932690', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6837', 'nonce': 1022932690}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 1022932690}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4297, 'qdb_cluster': [4281, 4294, 4297]} 2024-04-23T18:23:27.116 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-23T18:23:27.116 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-23T18:23:27.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.271+0000 7f9db3800640 1 Processor -- start 2024-04-23T18:23:27.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.271+0000 7f9db3800640 1 -- start start 2024-04-23T18:23:27.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.271+0000 7f9db3800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9dac0cc4e0 0x7f9dac0cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.271+0000 7f9db3800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dac158190 con 0x7f9dac151fe0 2024-04-23T18:23:27.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.271+0000 7f9db3800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dac158470 con 0x7f9dac0c75a0 2024-04-23T18:23:27.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.271+0000 7f9db3800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9dac158d10 con 0x7f9dac0cc4e0 2024-04-23T18:23:27.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.271+0000 7f9db0e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9dac151fe0 0x7f9dac0c86d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:50038/0 (socket says 172.21.15.28:50038) 2024-04-23T18:23:27.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.271+0000 7f9db0e00640 1 -- 172.21.15.28:0/337178479 learned_addr learned my addr 172.21.15.28:0/337178479 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:27.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.271+0000 7f9da3e00640 1 --2- 172.21.15.28:0/337178479 >> v2:172.21.15.137:3300/0 conn(0x7f9dac0cc4e0 0x7f9dac0cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.271+0000 7f9dabe00640 1 -- 172.21.15.28:0/337178479 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3340300561 0 0) 0x7f9dac158190 con 0x7f9dac151fe0 2024-04-23T18:23:27.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.275+0000 7f9dabe00640 1 -- 172.21.15.28:0/337178479 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d90003530 con 0x7f9dac151fe0 2024-04-23T18:23:27.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.275+0000 7f9dabe00640 1 -- 172.21.15.28:0/337178479 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1166323481 0 0) 0x7f9d90003530 con 0x7f9dac151fe0 2024-04-23T18:23:27.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.275+0000 7f9da3e00640 1 -- 172.21.15.28:0/337178479 >> v1:172.21.15.137:6789/0 conn(0x7f9dac0c75a0 legacy=0x7f9dac0c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.275+0000 7f9da3e00640 1 -- 172.21.15.28:0/337178479 >> v1:172.21.15.28:6789/0 conn(0x7f9dac151fe0 legacy=0x7f9dac0c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.275+0000 7f9da3e00640 1 -- 172.21.15.28:0/337178479 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dac158750 con 0x7f9dac0cc4e0 2024-04-23T18:23:27.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.275+0000 7f9da3e00640 1 --2- 172.21.15.28:0/337178479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac0cc4e0 0x7f9dac0cc930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9d940097c0 tx=0x7f9d9401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=718b712ead3b3fa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.275+0000 7f9dabe00640 1 -- 172.21.15.28:0/337178479 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d940b0070 con 0x7f9dac0cc4e0 2024-04-23T18:23:27.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.275+0000 7f9dabe00640 1 -- 172.21.15.28:0/337178479 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d940ab400 con 0x7f9dac0cc4e0 2024-04-23T18:23:27.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.275+0000 7f9dabe00640 1 -- 172.21.15.28:0/337178479 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c001680 con 0x7f9dac0cc4e0 2024-04-23T18:23:27.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 -- 172.21.15.28:0/337178479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac0cc4e0 msgr2=0x7f9dac0cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 --2- 172.21.15.28:0/337178479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac0cc4e0 0x7f9dac0cc930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9d940097c0 tx=0x7f9d9401c330 comp rx=0 tx=0).stop 2024-04-23T18:23:27.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 -- 172.21.15.28:0/337178479 shutdown_connections 2024-04-23T18:23:27.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 --2- 172.21.15.28:0/337178479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac0cc4e0 0x7f9dac0cc930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 -- 172.21.15.28:0/337178479 >> 172.21.15.28:0/337178479 conn(0x7f9dac075e30 msgr2=0x7f9dac0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 -- 172.21.15.28:0/337178479 shutdown_connections 2024-04-23T18:23:27.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 -- 172.21.15.28:0/337178479 wait complete. 2024-04-23T18:23:27.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 Processor -- start 2024-04-23T18:23:27.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 -- start start 2024-04-23T18:23:27.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9dac0c75a0 0x7f9dac1eac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac0cc4e0 0x7f9dac1348a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dac151fe0 0x7f9dac155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac0c5610 con 0x7f9dac151fe0 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac0c5490 con 0x7f9dac0cc4e0 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9dac157d50 con 0x7f9dac0c75a0 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db1800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dac151fe0 0x7f9dac155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db1800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dac151fe0 0x7f9dac155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49972/0 (socket says 172.21.15.28:49972) 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db1800640 1 -- 172.21.15.28:0/3759847879 learned_addr learned my addr 172.21.15.28:0/3759847879 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9da3e00640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac0cc4e0 0x7f9dac1348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db0e00640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9dac0c75a0 0x7f9dac1eac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db1800640 1 -- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9dac0c75a0 msgr2=0x7f9dac1eac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db1800640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9dac0c75a0 0x7f9dac1eac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db1800640 1 -- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac0cc4e0 msgr2=0x7f9dac1348a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db1800640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac0cc4e0 0x7f9dac1348a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db1800640 1 -- 172.21.15.28:0/3759847879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dac1f2440 con 0x7f9dac151fe0 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9da3e00640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac0cc4e0 0x7f9dac1348a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:27.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db1800640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dac151fe0 0x7f9dac155b00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9da400c7a0 tx=0x7f9da400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9da9600640 1 -- 172.21.15.28:0/3759847879 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4003b80 con 0x7f9dac151fe0 2024-04-23T18:23:27.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9da9600640 1 -- 172.21.15.28:0/3759847879 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da4003d20 con 0x7f9dac151fe0 2024-04-23T18:23:27.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9da9600640 1 -- 172.21.15.28:0/3759847879 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da400aa90 con 0x7f9dac151fe0 2024-04-23T18:23:27.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.279+0000 7f9db3800640 1 -- 172.21.15.28:0/3759847879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dac151810 con 0x7f9dac151fe0 2024-04-23T18:23:27.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.283+0000 7f9db3800640 1 -- 172.21.15.28:0/3759847879 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dac1356c0 con 0x7f9dac151fe0 2024-04-23T18:23:27.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.283+0000 7f9da9600640 1 -- 172.21.15.28:0/3759847879 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9da400ac30 con 0x7f9dac151fe0 2024-04-23T18:23:27.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.283+0000 7f9da9600640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d88068380 0x7f9d8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.283+0000 7f9da9600640 1 -- 172.21.15.28:0/3759847879 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9da4086d60 con 0x7f9dac151fe0 2024-04-23T18:23:27.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.283+0000 7f9db6cea000 1 Processor -- start 2024-04-23T18:23:27.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.283+0000 7f9db0e00640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d88068380 0x7f9d8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.283+0000 7f9db6cea000 1 -- start start 2024-04-23T18:23:27.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d410fd0 0x55653d4113b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d415080 0x55653d415460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d4159a0 0x55653d415d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55653d223420 con 0x55653d4159a0 2024-04-23T18:23:27.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55653d1bdbf0 con 0x55653d410fd0 2024-04-23T18:23:27.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55653d21f3e0 con 0x55653d415080 2024-04-23T18:23:27.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db0e00640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d88068380 0x7f9d8806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c005890 tx=0x7f9d9c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db1800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d4159a0 0x55653d415d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db1800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d4159a0 0x55653d415d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49980/0 (socket says 172.21.15.28:49980) 2024-04-23T18:23:27.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db1800640 1 -- 172.21.15.28:0/881961383 learned_addr learned my addr 172.21.15.28:0/881961383 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db0e00640 1 --2- 172.21.15.28:0/881961383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d410fd0 0x55653d4113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9da3e00640 1 --2- 172.21.15.28:0/881961383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d415080 0x55653d415460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db1800640 1 -- 172.21.15.28:0/881961383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d415080 msgr2=0x55653d415460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db1800640 1 --2- 172.21.15.28:0/881961383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d415080 0x55653d415460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db1800640 1 -- 172.21.15.28:0/881961383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d410fd0 msgr2=0x55653d4113b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db1800640 1 --2- 172.21.15.28:0/881961383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d410fd0 0x55653d4113b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db1800640 1 -- 172.21.15.28:0/881961383 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653d2cb450 con 0x55653d4159a0 2024-04-23T18:23:27.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db0e00640 1 --2- 172.21.15.28:0/881961383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d410fd0 0x55653d4113b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:27.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db1800640 1 --2- 172.21.15.28:0/881961383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d4159a0 0x55653d415d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9da4052c70 tx=0x7f9da400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53f91a78bec2bbc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9da1600640 1 -- 172.21.15.28:0/881961383 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da405abc0 con 0x55653d4159a0 2024-04-23T18:23:27.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9da1600640 1 -- 172.21.15.28:0/881961383 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da405f3f0 con 0x55653d4159a0 2024-04-23T18:23:27.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9da1600640 1 -- 172.21.15.28:0/881961383 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4054b10 con 0x55653d4159a0 2024-04-23T18:23:27.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 -- 172.21.15.28:0/881961383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d4159a0 msgr2=0x55653d415d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 --2- 172.21.15.28:0/881961383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d4159a0 0x55653d415d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9da4052c70 tx=0x7f9da400f000 comp rx=0 tx=0).stop 2024-04-23T18:23:27.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 -- 172.21.15.28:0/881961383 shutdown_connections 2024-04-23T18:23:27.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 --2- 172.21.15.28:0/881961383 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d415080 0x55653d415460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 --2- 172.21.15.28:0/881961383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d4159a0 0x55653d415d80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 --2- 172.21.15.28:0/881961383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d410fd0 0x55653d4113b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 -- 172.21.15.28:0/881961383 >> 172.21.15.28:0/881961383 conn(0x55653d411e40 msgr2=0x55653d414260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 -- 172.21.15.28:0/881961383 shutdown_connections 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 -- 172.21.15.28:0/881961383 wait complete. 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 -- start start 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.287+0000 7f9db6cea000 1 Processor -- start 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d410fd0 0x55653d4182d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d418810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d4159a0 0x55653d418d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55653d1c3ec0 con 0x55653d415080 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55653d2a4120 con 0x55653d4159a0 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55653d22e350 con 0x55653d410fd0 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 10 client.0 _ll_register_callbacks cb 0x55653d2004d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9da3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d418810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9da3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d418810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49994/0 (socket says 172.21.15.28:49994) 2024-04-23T18:23:27.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9da3e00640 1 -- 172.21.15.28:0/2911624612 learned_addr learned my addr 172.21.15.28:0/2911624612 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db0e00640 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d410fd0 0x55653d4182d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db1800640 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d4159a0 0x55653d418d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9da3e00640 1 -- 172.21.15.28:0/2911624612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d410fd0 msgr2=0x55653d4182d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9da3e00640 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d410fd0 0x55653d4182d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9da3e00640 1 -- 172.21.15.28:0/2911624612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d4159a0 msgr2=0x55653d418d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9da3e00640 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d4159a0 0x55653d418d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9da3e00640 1 -- 172.21.15.28:0/2911624612 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653d268f80 con 0x55653d415080 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9da3e00640 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d418810 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9d94018f40 tx=0x7f9d9401ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93af172d497adb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9d9a000640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9d9a000640 1 -- 172.21.15.28:0/2911624612 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d940b0040 con 0x55653d415080 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9d9a000640 1 -- 172.21.15.28:0/2911624612 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9d940abc80 con 0x55653d415080 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 1 -- 172.21.15.28:0/2911624612 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9da405f3f0 con 0x55653d415080 2024-04-23T18:23:27.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9d9a000640 1 -- 172.21.15.28:0/2911624612 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f9d94006e20 con 0x55653d415080 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 10 client.5079 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 1 -- 172.21.15.28:0/2911624612 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55653d1fcf00 con 0x55653d415080 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9d9a000640 1 -- 172.21.15.28:0/2911624612 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da405f3f0 con 0x55653d415080 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9d9a000640 1 -- 172.21.15.28:0/2911624612 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f9d940c8420 con 0x55653d415080 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 10 client.5079 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 10 client.5079 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 20 client.5079 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x55653d419760 0x55653d4305e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 4 client.5079 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db6cea000 1 -- 172.21.15.28:0/2911624612 --> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55653d1bcbc0 con 0x55653d419760 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db0e00640 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x55653d419760 0x55653d4305e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9db0e00640 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x55653d419760 0x55653d4305e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cfdb56ef52e7156e server_cookie=b4a8d39d1d1948e2 in_seq=0 out_seq=0 2024-04-23T18:23:27.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.291+0000 7f9d9a000640 10 client.5079 ms_handle_connect on v2:172.21.15.28:6836/1362691862 2024-04-23T18:23:27.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9d9a000640 1 -- 172.21.15.28:0/2911624612 <== mds.2 v2:172.21.15.28:6836/1362691862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55653d1bcbc0 con 0x55653d419760 2024-04-23T18:23:27.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9d9a000640 10 client.5079 handle_command_reply: tid=0 2024-04-23T18:23:27.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 1 client.5079 shutdown 2024-04-23T18:23:27.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 1 -- 172.21.15.28:0/2911624612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 msgr2=0x55653d418810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d418810 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9d94018f40 tx=0x7f9d9401ab70 comp rx=0 tx=0).stop 2024-04-23T18:23:27.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 1 -- 172.21.15.28:0/2911624612 shutdown_connections 2024-04-23T18:23:27.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x55653d419760 0x55653d4305e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d4159a0 0x55653d418d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d418810 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9d9a000640 0 client.5079 ms_handle_reset on v2:172.21.15.28:6836/1362691862 2024-04-23T18:23:27.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2911624612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d410fd0 0x55653d4182d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 1 -- 172.21.15.28:0/2911624612 >> 172.21.15.28:0/2911624612 conn(0x55653d411e40 msgr2=0x55653d414230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 1 -- 172.21.15.28:0/2911624612 shutdown_connections 2024-04-23T18:23:27.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 1 -- 172.21.15.28:0/2911624612 wait complete. 2024-04-23T18:23:27.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.295+0000 7f9db6cea000 20 client.5079 trim_cache size 0 max 16384 2024-04-23T18:23:27.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.311+0000 7f9db6cea000 1 Processor -- start 2024-04-23T18:23:27.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.311+0000 7f9db6cea000 1 -- start start 2024-04-23T18:23:27.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.311+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d411e40 0x55653d3fa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.311+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d410fd0 0x55653d3d9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.311+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d3da180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.311+0000 7f9db6cea000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac156610 con 0x55653d415080 2024-04-23T18:23:27.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.311+0000 7f9db6cea000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac1f6530 con 0x55653d410fd0 2024-04-23T18:23:27.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.311+0000 7f9db6cea000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9dac154610 con 0x55653d411e40 2024-04-23T18:23:27.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.311+0000 7f9db1800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d3da180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db1800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d3da180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50004/0 (socket says 172.21.15.28:50004) 2024-04-23T18:23:27.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db1800640 1 -- 172.21.15.28:0/2549381848 learned_addr learned my addr 172.21.15.28:0/2549381848 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db0e00640 1 --2- 172.21.15.28:0/2549381848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d411e40 0x55653d3fa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9da3e00640 1 --2- 172.21.15.28:0/2549381848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d410fd0 0x55653d3d9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db1800640 1 -- 172.21.15.28:0/2549381848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d411e40 msgr2=0x55653d3fa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db1800640 1 --2- 172.21.15.28:0/2549381848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d411e40 0x55653d3fa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db1800640 1 -- 172.21.15.28:0/2549381848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d410fd0 msgr2=0x55653d3d9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db1800640 1 --2- 172.21.15.28:0/2549381848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d410fd0 0x55653d3d9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db1800640 1 -- 172.21.15.28:0/2549381848 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653d1a9e80 con 0x55653d415080 2024-04-23T18:23:27.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db1800640 1 --2- 172.21.15.28:0/2549381848 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d3da180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9da400f040 tx=0x7f9da405d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b967c2a2b09a777d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9da0c00640 1 -- 172.21.15.28:0/2549381848 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da405f3f0 con 0x55653d415080 2024-04-23T18:23:27.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9da0c00640 1 -- 172.21.15.28:0/2549381848 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da407a070 con 0x55653d415080 2024-04-23T18:23:27.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9da0c00640 1 -- 172.21.15.28:0/2549381848 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da405abc0 con 0x55653d415080 2024-04-23T18:23:27.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 -- 172.21.15.28:0/2549381848 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 msgr2=0x55653d3da180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2549381848 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d3da180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9da400f040 tx=0x7f9da405d050 comp rx=0 tx=0).stop 2024-04-23T18:23:27.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 -- 172.21.15.28:0/2549381848 shutdown_connections 2024-04-23T18:23:27.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2549381848 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d415080 0x55653d3da180 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2549381848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d410fd0 0x55653d3d9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2549381848 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d411e40 0x55653d3fa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 -- 172.21.15.28:0/2549381848 >> 172.21.15.28:0/2549381848 conn(0x55653d414a20 msgr2=0x55653d3d9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 -- 172.21.15.28:0/2549381848 shutdown_connections 2024-04-23T18:23:27.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 -- 172.21.15.28:0/2549381848 wait complete. 2024-04-23T18:23:27.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 -- start start 2024-04-23T18:23:27.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 Processor -- start 2024-04-23T18:23:27.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d410fd0 0x55653d433030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d411e40 0x55653d431fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d415080 0x55653d4324e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55653d222730 con 0x55653d411e40 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55653d1ef9e0 con 0x55653d415080 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55653d227a50 con 0x55653d410fd0 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db6cea000 10 client.0 _ll_register_callbacks cb 0x7f9d940ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9da3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d411e40 0x55653d431fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9da3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d411e40 0x55653d431fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50018/0 (socket says 172.21.15.28:50018) 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9da3e00640 1 -- 172.21.15.28:0/2362567028 learned_addr learned my addr 172.21.15.28:0/2362567028 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db0e00640 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d410fd0 0x55653d433030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.315+0000 7f9db1800640 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d415080 0x55653d4324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9da3e00640 1 -- 172.21.15.28:0/2362567028 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d410fd0 msgr2=0x55653d433030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9da3e00640 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d410fd0 0x55653d433030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9da3e00640 1 -- 172.21.15.28:0/2362567028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d415080 msgr2=0x55653d4324e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9da3e00640 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d415080 0x55653d4324e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9da3e00640 1 -- 172.21.15.28:0/2362567028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653d1ebb30 con 0x55653d411e40 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9da3e00640 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d411e40 0x55653d431fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9d9401c160 tx=0x7f9d94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65ff32e312f8d25 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9d9a000640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9d9a000640 1 -- 172.21.15.28:0/2362567028 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d940b0070 con 0x55653d411e40 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 -- 172.21.15.28:0/2362567028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9da407a070 con 0x55653d411e40 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9d9a000640 1 -- 172.21.15.28:0/2362567028 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9d94004450 con 0x55653d411e40 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9d9a000640 1 -- 172.21.15.28:0/2362567028 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f9d940da050 con 0x55653d411e40 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 10 client.5085 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 -- 172.21.15.28:0/2362567028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55653d2a45b0 con 0x55653d411e40 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9d9a000640 1 -- 172.21.15.28:0/2362567028 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da407a070 con 0x55653d411e40 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9d9a000640 1 -- 172.21.15.28:0/2362567028 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f9d940dd020 con 0x55653d411e40 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 10 client.5085 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 10 client.5085 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 20 client.5085 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x55653d4159a0 0x55653d450620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 4 client.5085 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T18:23:27.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 -- 172.21.15.28:0/2362567028 --> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] -- command(tid 0: {"prefix": "status"}) -- 0x55653d230e40 con 0x55653d4159a0 2024-04-23T18:23:27.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db0e00640 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x55653d4159a0 0x55653d450620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db0e00640 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x55653d4159a0 0x55653d450620 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a0a64093031c9578 server_cookie=81e46b826f0cea5b in_seq=0 out_seq=0 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9d9a000640 10 client.5085 ms_handle_connect on v2:172.21.15.28:6836/1362691862 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9d9a000640 1 -- 172.21.15.28:0/2362567028 <== mds.2 v2:172.21.15.28:6836/1362691862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55653d230e40 con 0x55653d4159a0 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9d9a000640 10 client.5085 handle_command_reply: tid=0 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 client.5085 shutdown 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 -- 172.21.15.28:0/2362567028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d411e40 msgr2=0x55653d431fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d411e40 0x55653d431fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9d9401c160 tx=0x7f9d94008040 comp rx=0 tx=0).stop 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 -- 172.21.15.28:0/2362567028 shutdown_connections 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.28:6836/1362691862,v1:172.21.15.28:6837/1362691862] conn(0x55653d4159a0 0x55653d450620 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55653d415080 0x55653d4324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55653d411e40 0x55653d431fa0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9d9a000640 0 client.5085 ms_handle_reset on v2:172.21.15.28:6836/1362691862 2024-04-23T18:23:27.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 --2- 172.21.15.28:0/2362567028 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55653d410fd0 0x55653d433030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 -- 172.21.15.28:0/2362567028 >> 172.21.15.28:0/2362567028 conn(0x55653d414a20 msgr2=0x55653d3d9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 -- 172.21.15.28:0/2362567028 shutdown_connections 2024-04-23T18:23:27.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 1 -- 172.21.15.28:0/2362567028 wait complete. 2024-04-23T18:23:27.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db6cea000 20 client.5085 trim_cache size 0 max 16384 2024-04-23T18:23:27.318 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:23:27.318 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "d84cc156-ceaf-4cae-a89c-ee7e55af72c5", 2024-04-23T18:23:27.318 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 2, 2024-04-23T18:23:27.318 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4281, 2024-04-23T18:23:27.318 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-04-23T18:23:27.318 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-04-23T18:23:27.319 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-04-23T18:23:27.319 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 26.734895861999998, 2024-04-23T18:23:27.319 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 15, 2024-04-23T18:23:27.319 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 26, 2024-04-23T18:23:27.319 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T18:23:27.319 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 60.952032162000002 2024-04-23T18:23:27.319 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:23:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db3800640 1 -- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d88068380 msgr2=0x7f9d8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db3800640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d88068380 0x7f9d8806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c005890 tx=0x7f9d9c009040 comp rx=0 tx=0).stop 2024-04-23T18:23:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db3800640 1 -- 172.21.15.28:0/3759847879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dac151fe0 msgr2=0x7f9dac155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db3800640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dac151fe0 0x7f9dac155b00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9da400c7a0 tx=0x7f9da400cc60 comp rx=0 tx=0).stop 2024-04-23T18:23:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db3800640 1 -- 172.21.15.28:0/3759847879 shutdown_connections 2024-04-23T18:23:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db3800640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d88068380 0x7f9d8806a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db3800640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9dac151fe0 0x7f9dac155b00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db3800640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac0cc4e0 0x7f9dac1348a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db3800640 1 --2- 172.21.15.28:0/3759847879 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9dac0c75a0 0x7f9dac1eac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.319+0000 7f9db3800640 1 -- 172.21.15.28:0/3759847879 >> 172.21.15.28:0/3759847879 conn(0x7f9dac075e30 msgr2=0x7f9dac154950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.323+0000 7f9db3800640 1 -- 172.21.15.28:0/3759847879 shutdown_connections 2024-04-23T18:23:27.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.323+0000 7f9db3800640 1 -- 172.21.15.28:0/3759847879 wait complete. 2024-04-23T18:23:27.335 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-23T18:23:27.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f4890e00640 1 Processor -- start 2024-04-23T18:23:27.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f4890e00640 1 -- start start 2024-04-23T18:23:27.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f4890e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f488c0cc4e0 0x7f488c0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f4890e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f488c0c75a0 0x7f488c0c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f4890e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f488c158190 con 0x7f488c151fe0 2024-04-23T18:23:27.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f4890e00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f488c0c7f30 con 0x7f488c0c75a0 2024-04-23T18:23:27.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f4890e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f488c158d10 con 0x7f488c0cc4e0 2024-04-23T18:23:27.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f488a800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f488c0c75a0 0x7f488c0c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f488a800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f488c0c75a0 0x7f488c0c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50028/0 (socket says 172.21.15.28:50028) 2024-04-23T18:23:27.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f488a800640 1 -- 172.21.15.28:0/1571873937 learned_addr learned my addr 172.21.15.28:0/1571873937 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f4883e00640 1 --2- 172.21.15.28:0/1571873937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f488c0cc4e0 0x7f488c0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f488a800640 1 -- 172.21.15.28:0/1571873937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f488c0cc4e0 msgr2=0x7f488c0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f488a800640 1 --2- 172.21.15.28:0/1571873937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f488c0cc4e0 0x7f488c0cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f488a800640 1 -- 172.21.15.28:0/1571873937 >> v1:172.21.15.137:6789/0 conn(0x7f488c151fe0 legacy=0x7f488c0c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.487+0000 7f488a800640 1 -- 172.21.15.28:0/1571873937 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c158470 con 0x7f488c0c75a0 2024-04-23T18:23:27.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f488a800640 1 --2- 172.21.15.28:0/1571873937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f488c0c75a0 0x7f488c0c79f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4884009e50 tx=0x7f488401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327533a78f505bf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4889400640 1 -- 172.21.15.28:0/1571873937 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48840a5660 con 0x7f488c0c75a0 2024-04-23T18:23:27.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4889400640 1 -- 172.21.15.28:0/1571873937 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48840a5800 con 0x7f488c0c75a0 2024-04-23T18:23:27.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4889400640 1 -- 172.21.15.28:0/1571873937 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48840a5bd0 con 0x7f488c0c75a0 2024-04-23T18:23:27.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4890e00640 1 -- 172.21.15.28:0/1571873937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f488c0c75a0 msgr2=0x7f488c0c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4890e00640 1 --2- 172.21.15.28:0/1571873937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f488c0c75a0 0x7f488c0c79f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4884009e50 tx=0x7f488401c9a0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4890e00640 1 -- 172.21.15.28:0/1571873937 shutdown_connections 2024-04-23T18:23:27.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4890e00640 1 --2- 172.21.15.28:0/1571873937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f488c0c75a0 0x7f488c0c79f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4890e00640 1 --2- 172.21.15.28:0/1571873937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f488c0cc4e0 0x7f488c0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4890e00640 1 -- 172.21.15.28:0/1571873937 >> 172.21.15.28:0/1571873937 conn(0x7f488c075e30 msgr2=0x7f488c0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4890e00640 1 -- 172.21.15.28:0/1571873937 shutdown_connections 2024-04-23T18:23:27.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4890e00640 1 -- 172.21.15.28:0/1571873937 wait complete. 2024-04-23T18:23:27.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4890e00640 1 Processor -- start 2024-04-23T18:23:27.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.491+0000 7f4890e00640 1 -- start start 2024-04-23T18:23:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4890e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f488c0c75a0 0x7f488c14c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4890e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f488c0cc4e0 0x7f488c144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4890e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c151fe0 0x7f488c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4890e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f488c0c5490 con 0x7f488c0cc4e0 2024-04-23T18:23:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4890e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f488c1523c0 con 0x7f488c151fe0 2024-04-23T18:23:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4890e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f488c0c5610 con 0x7f488c0c75a0 2024-04-23T18:23:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4883e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f488c0cc4e0 0x7f488c144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4883e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f488c0cc4e0 0x7f488c144200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50044/0 (socket says 172.21.15.28:50044) 2024-04-23T18:23:27.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4883e00640 1 -- 172.21.15.28:0/751714614 learned_addr learned my addr 172.21.15.28:0/751714614 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f488a800640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c151fe0 0x7f488c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4889e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f488c0c75a0 0x7f488c14c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4883e00640 1 -- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f488c0c75a0 msgr2=0x7f488c14c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4883e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f488c0c75a0 0x7f488c14c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4883e00640 1 -- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c151fe0 msgr2=0x7f488c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4883e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c151fe0 0x7f488c0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4883e00640 1 -- 172.21.15.28:0/751714614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c0cd470 con 0x7f488c0cc4e0 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4883e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f488c0cc4e0 0x7f488c144200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f487400d5f0 tx=0x7f487400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4882000640 1 -- 172.21.15.28:0/751714614 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48740125f0 con 0x7f488c0cc4e0 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4882000640 1 -- 172.21.15.28:0/751714614 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4874019070 con 0x7f488c0cc4e0 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4890e00640 1 -- 172.21.15.28:0/751714614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c14ca90 con 0x7f488c0cc4e0 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4882000640 1 -- 172.21.15.28:0/751714614 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48740129d0 con 0x7f488c0cc4e0 2024-04-23T18:23:27.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.495+0000 7f4890e00640 1 -- 172.21.15.28:0/751714614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c1f80f0 con 0x7f488c0cc4e0 2024-04-23T18:23:27.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4882000640 1 -- 172.21.15.28:0/751714614 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4874012b70 con 0x7f488c0cc4e0 2024-04-23T18:23:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4882000640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4868068380 0x7f486806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4882000640 1 -- 172.21.15.28:0/751714614 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4874087160 con 0x7f488c0cc4e0 2024-04-23T18:23:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4894376000 1 Processor -- start 2024-04-23T18:23:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4894376000 1 -- start start 2024-04-23T18:23:27.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4889e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4868068380 0x7f486806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4894376000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9190 0x562f4f0a9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4894376000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0a9ab0 0x562f4f0e4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4894376000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0e45c0 0x562f4f0e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4894376000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x562f4eef2420 con 0x562f4f0e45c0 2024-04-23T18:23:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4894376000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562f4ee8cbf0 con 0x562f4f0a9ab0 2024-04-23T18:23:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4894376000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x562f4eeee3e0 con 0x562f4f0a9190 2024-04-23T18:23:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f488a800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0e45c0 0x562f4f0e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f488a800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0e45c0 0x562f4f0e49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50046/0 (socket says 172.21.15.28:50046) 2024-04-23T18:23:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f488a800640 1 -- 172.21.15.28:0/2560138627 learned_addr learned my addr 172.21.15.28:0/2560138627 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4889e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4868068380 0x7f486806a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f487c0015b0 tx=0x7f487c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4883e00640 1 --2- 172.21.15.28:0/2560138627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0a9ab0 0x562f4f0e4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f4889e00640 1 --2- 172.21.15.28:0/2560138627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9190 0x562f4f0a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f488a800640 1 -- 172.21.15.28:0/2560138627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9190 msgr2=0x562f4f0a9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f488a800640 1 --2- 172.21.15.28:0/2560138627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9190 0x562f4f0a9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f488a800640 1 -- 172.21.15.28:0/2560138627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0a9ab0 msgr2=0x562f4f0e4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f488a800640 1 --2- 172.21.15.28:0/2560138627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0a9ab0 0x562f4f0e4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f488a800640 1 -- 172.21.15.28:0/2560138627 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4ef9a450 con 0x562f4f0e45c0 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f488a800640 1 --2- 172.21.15.28:0/2560138627 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0e45c0 0x562f4f0e49a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f488401a5d0 tx=0x7f4884004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88d2fa67835ba4e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f487aa00640 1 -- 172.21.15.28:0/2560138627 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48840bd070 con 0x562f4f0e45c0 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f487aa00640 1 -- 172.21.15.28:0/2560138627 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48840a5660 con 0x562f4f0e45c0 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.499+0000 7f487aa00640 1 -- 172.21.15.28:0/2560138627 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48840a5a10 con 0x562f4f0e45c0 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 -- 172.21.15.28:0/2560138627 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0e45c0 msgr2=0x562f4f0e49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 --2- 172.21.15.28:0/2560138627 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0e45c0 0x562f4f0e49a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f488401a5d0 tx=0x7f4884004ac0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 -- 172.21.15.28:0/2560138627 shutdown_connections 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 --2- 172.21.15.28:0/2560138627 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0e45c0 0x562f4f0e49a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 --2- 172.21.15.28:0/2560138627 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0a9ab0 0x562f4f0e4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 --2- 172.21.15.28:0/2560138627 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9190 0x562f4f0a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 -- 172.21.15.28:0/2560138627 >> 172.21.15.28:0/2560138627 conn(0x562f4f0e0e40 msgr2=0x562f4f0e3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 -- 172.21.15.28:0/2560138627 shutdown_connections 2024-04-23T18:23:27.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 -- 172.21.15.28:0/2560138627 wait complete. 2024-04-23T18:23:27.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 -- start start 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 Processor -- start 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f0a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9ab0 0x562f4f0a6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0e45c0 0x562f4f0a6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x562f4ee92ec0 con 0x562f4f0a9190 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562f4ef73120 con 0x562f4f0e45c0 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x562f4eefd350 con 0x562f4f0a9ab0 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 10 client.0 _ll_register_callbacks cb 0x562f4eecf4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4889e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f0a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4889e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f0a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50050/0 (socket says 172.21.15.28:50050) 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4889e00640 1 -- 172.21.15.28:0/1780366461 learned_addr learned my addr 172.21.15.28:0/1780366461 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4883e00640 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9ab0 0x562f4f0a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f488a800640 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0e45c0 0x562f4f0a6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4889e00640 1 -- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9ab0 msgr2=0x562f4f0a6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4889e00640 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9ab0 0x562f4f0a6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4889e00640 1 -- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0e45c0 msgr2=0x562f4f0a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4889e00640 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0e45c0 0x562f4f0a6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4889e00640 1 -- 172.21.15.28:0/1780366461 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4ef37f80 con 0x562f4f0a9190 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4883e00640 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9ab0 0x562f4f0a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4889e00640 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f0a5bd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f487c014db0 tx=0x7f487c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9005cf6c9b0616b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f486f400640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f486f400640 1 -- 172.21.15.28:0/1780366461 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c01a070 con 0x562f4f0a9190 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f486f400640 1 -- 172.21.15.28:0/1780366461 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f487c005110 con 0x562f4f0a9190 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.503+0000 7f4894376000 1 -- 172.21.15.28:0/1780366461 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48840a5660 con 0x562f4f0a9190 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f486f400640 1 -- 172.21.15.28:0/1780366461 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f487c02d050 con 0x562f4f0a9190 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 10 client.5097 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:27.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 -- 172.21.15.28:0/1780366461 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x562f4eecbf00 con 0x562f4f0a9190 2024-04-23T18:23:27.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f486f400640 1 -- 172.21.15.28:0/1780366461 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48840a5660 con 0x562f4f0a9190 2024-04-23T18:23:27.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f486f400640 1 -- 172.21.15.28:0/1780366461 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f487c030020 con 0x562f4f0a9190 2024-04-23T18:23:27.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 10 client.5097 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:27.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 10 client.5097 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T18:23:27.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 20 client.5097 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:27.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562f4f0f8d90 0x562f4f0fb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 4 client.5097 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:23:27.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 -- 172.21.15.28:0/1780366461 --> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f4ee8bbc0 con 0x562f4f0f8d90 2024-04-23T18:23:27.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4883e00640 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562f4f0f8d90 0x562f4f0fb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4883e00640 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562f4f0f8d90 0x562f4f0fb180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d9fe0f8c05680f5 server_cookie=c0f85784dc95703a in_seq=0 out_seq=0 2024-04-23T18:23:27.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f486f400640 10 client.5097 ms_handle_connect on v2:172.21.15.137:6836/1110609151 2024-04-23T18:23:27.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f486f400640 1 -- 172.21.15.28:0/1780366461 <== mds.1 v2:172.21.15.137:6836/1110609151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562f4ee8bbc0 con 0x562f4f0f8d90 2024-04-23T18:23:27.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f486f400640 10 client.5097 handle_command_reply: tid=0 2024-04-23T18:23:27.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 client.5097 shutdown 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 -- 172.21.15.28:0/1780366461 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 msgr2=0x562f4f0a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f0a5bd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f487c014db0 tx=0x7f487c000bd0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 -- 172.21.15.28:0/1780366461 shutdown_connections 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562f4f0f8d90 0x562f4f0fb180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9ab0 0x562f4f0a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0e45c0 0x562f4f0a6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f486f400640 0 client.5097 ms_handle_reset on v2:172.21.15.137:6836/1110609151 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 --2- 172.21.15.28:0/1780366461 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f0a5bd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.507+0000 7f4894376000 1 -- 172.21.15.28:0/1780366461 >> 172.21.15.28:0/1780366461 conn(0x562f4f0e0e40 msgr2=0x562f4f0e21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.511+0000 7f4894376000 1 -- 172.21.15.28:0/1780366461 shutdown_connections 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.511+0000 7f4894376000 1 -- 172.21.15.28:0/1780366461 wait complete. 2024-04-23T18:23:27.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.511+0000 7f4894376000 20 client.5097 trim_cache size 0 max 16384 2024-04-23T18:23:27.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4894376000 1 Processor -- start 2024-04-23T18:23:27.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4894376000 1 -- start start 2024-04-23T18:23:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4894376000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9190 0x562f4f0dee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4894376000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9ab0 0x562f4f0df3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4894376000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0e45c0 0x562f4f0fb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4894376000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f488c200d30 con 0x562f4f0a9ab0 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4894376000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f488c150c80 con 0x562f4f0e45c0 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4894376000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f488c200660 con 0x562f4f0a9190 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4883e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9ab0 0x562f4f0df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4883e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9ab0 0x562f4f0df3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50066/0 (socket says 172.21.15.28:50066) 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4883e00640 1 -- 172.21.15.28:0/2129143592 learned_addr learned my addr 172.21.15.28:0/2129143592 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4889e00640 1 --2- 172.21.15.28:0/2129143592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9190 0x562f4f0dee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f488a800640 1 --2- 172.21.15.28:0/2129143592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0e45c0 0x562f4f0fb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4883e00640 1 -- 172.21.15.28:0/2129143592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9190 msgr2=0x562f4f0dee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4883e00640 1 --2- 172.21.15.28:0/2129143592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9190 0x562f4f0dee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4883e00640 1 -- 172.21.15.28:0/2129143592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0e45c0 msgr2=0x562f4f0fb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4883e00640 1 --2- 172.21.15.28:0/2129143592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0e45c0 0x562f4f0fb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4883e00640 1 -- 172.21.15.28:0/2129143592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4ee78e80 con 0x562f4f0a9ab0 2024-04-23T18:23:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f488a800640 1 --2- 172.21.15.28:0/2129143592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0e45c0 0x562f4f0fb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:23:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f4883e00640 1 --2- 172.21.15.28:0/2129143592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9ab0 0x562f4f0df3d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f487400dfb0 tx=0x7f4874020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4d8080152c0a21 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f487a000640 1 -- 172.21.15.28:0/2129143592 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874074070 con 0x562f4f0a9ab0 2024-04-23T18:23:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f487a000640 1 -- 172.21.15.28:0/2129143592 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487405f890 con 0x562f4f0a9ab0 2024-04-23T18:23:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.527+0000 7f487a000640 1 -- 172.21.15.28:0/2129143592 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874082070 con 0x562f4f0a9ab0 2024-04-23T18:23:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 -- 172.21.15.28:0/2129143592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9ab0 msgr2=0x562f4f0df3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 --2- 172.21.15.28:0/2129143592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9ab0 0x562f4f0df3d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f487400dfb0 tx=0x7f4874020040 comp rx=0 tx=0).stop 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 -- 172.21.15.28:0/2129143592 shutdown_connections 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 --2- 172.21.15.28:0/2129143592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0e45c0 0x562f4f0fb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 --2- 172.21.15.28:0/2129143592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9ab0 0x562f4f0df3d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 --2- 172.21.15.28:0/2129143592 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0a9190 0x562f4f0dee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 -- 172.21.15.28:0/2129143592 >> 172.21.15.28:0/2129143592 conn(0x562f4f0e0e40 msgr2=0x562f4f0a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 -- 172.21.15.28:0/2129143592 shutdown_connections 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 -- 172.21.15.28:0/2129143592 wait complete. 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 -- start start 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 Processor -- start 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0a9ab0 0x562f4f153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0e45c0 0x562f4f153f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x562f4eef1730 con 0x562f4f0a9190 2024-04-23T18:23:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562f4eebe9e0 con 0x562f4f0a9ab0 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x562f4eef6a50 con 0x562f4f0e45c0 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 10 client.0 _ll_register_callbacks cb 0x7f487c014a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4889e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4889e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f1530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50082/0 (socket says 172.21.15.28:50082) 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4889e00640 1 -- 172.21.15.28:0/3362603781 learned_addr learned my addr 172.21.15.28:0/3362603781 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4883e00640 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0a9ab0 0x562f4f153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f488a800640 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0e45c0 0x562f4f153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4889e00640 1 -- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0e45c0 msgr2=0x562f4f153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4889e00640 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0e45c0 0x562f4f153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4889e00640 1 -- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0a9ab0 msgr2=0x562f4f153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4889e00640 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0a9ab0 0x562f4f153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4889e00640 1 -- 172.21.15.28:0/3362603781 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4eebab30 con 0x562f4f0a9190 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f488a800640 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0e45c0 0x562f4f153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4883e00640 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0a9ab0 0x562f4f153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4889e00640 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f1530d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f487c014db0 tx=0x7f487c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35ea760c905ca38 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f486f400640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f486f400640 1 -- 172.21.15.28:0/3362603781 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c003810 con 0x562f4f0a9190 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f486f400640 1 -- 172.21.15.28:0/3362603781 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f487c0039b0 con 0x562f4f0a9190 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 -- 172.21.15.28:0/3362603781 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f487405f890 con 0x562f4f0a9190 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f486f400640 1 -- 172.21.15.28:0/3362603781 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f487c041050 con 0x562f4f0a9190 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 10 client.5103 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.531+0000 7f4894376000 1 -- 172.21.15.28:0/3362603781 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x562f4ef735b0 con 0x562f4f0a9190 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f486f400640 1 -- 172.21.15.28:0/3362603781 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487405f890 con 0x562f4f0a9190 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f486f400640 1 -- 172.21.15.28:0/3362603781 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f487c044020 con 0x562f4f0a9190 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 10 client.5103 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 10 client.5103 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 20 client.5103 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562f4f154740 0x562f4f154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 4 client.5103 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T18:23:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 -- 172.21.15.28:0/3362603781 --> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] -- command(tid 0: {"prefix": "status"}) -- 0x562f4eeffe40 con 0x562f4f154740 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4883e00640 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562f4f154740 0x562f4f154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4883e00640 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562f4f154740 0x562f4f154b20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=66c1e5dbecadb73e server_cookie=226c3ed6d772941c in_seq=0 out_seq=0 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f486f400640 10 client.5103 ms_handle_connect on v2:172.21.15.137:6836/1110609151 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f486f400640 1 -- 172.21.15.28:0/3362603781 <== mds.1 v2:172.21.15.137:6836/1110609151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x562f4eeffe40 con 0x562f4f154740 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f486f400640 10 client.5103 handle_command_reply: tid=0 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 client.5103 shutdown 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 -- 172.21.15.28:0/3362603781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 msgr2=0x562f4f1530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f1530d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f487c014db0 tx=0x7f487c015000 comp rx=0 tx=0).stop 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 -- 172.21.15.28:0/3362603781 shutdown_connections 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:6836/1110609151,v1:172.21.15.137:6838/1110609151] conn(0x562f4f154740 0x562f4f154b20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x562f4f0e45c0 0x562f4f153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f486f400640 0 client.5103 ms_handle_reset on v2:172.21.15.137:6836/1110609151 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562f4f0a9ab0 0x562f4f153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 --2- 172.21.15.28:0/3362603781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562f4f0a9190 0x562f4f1530d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 -- 172.21.15.28:0/3362603781 >> 172.21.15.28:0/3362603781 conn(0x562f4f0e0e40 msgr2=0x562f4f0de600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 -- 172.21.15.28:0/3362603781 shutdown_connections 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 1 -- 172.21.15.28:0/3362603781 wait complete. 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4894376000 20 client.5103 trim_cache size 0 max 16384 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "d84cc156-ceaf-4cae-a89c-ee7e55af72c5", 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 1, 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4294, 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 32.049876796, 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 15, 2024-04-23T18:23:27.536 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 26, 2024-04-23T18:23:27.537 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T18:23:27.537 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 61.600799211000002 2024-04-23T18:23:27.537 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:23:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 -- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4868068380 msgr2=0x7f486806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4868068380 0x7f486806a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f487c0015b0 tx=0x7f487c009040 comp rx=0 tx=0).stop 2024-04-23T18:23:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 -- 172.21.15.28:0/751714614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f488c0cc4e0 msgr2=0x7f488c144200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f488c0cc4e0 0x7f488c144200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f487400d5f0 tx=0x7f487400dab0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 -- 172.21.15.28:0/751714614 shutdown_connections 2024-04-23T18:23:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4868068380 0x7f486806a840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f488c151fe0 0x7f488c0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f488c0cc4e0 0x7f488c144200 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 --2- 172.21.15.28:0/751714614 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f488c0c75a0 0x7f488c14c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 -- 172.21.15.28:0/751714614 >> 172.21.15.28:0/751714614 conn(0x7f488c075e30 msgr2=0x7f488c0c9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 -- 172.21.15.28:0/751714614 shutdown_connections 2024-04-23T18:23:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.535+0000 7f4890e00640 1 -- 172.21.15.28:0/751714614 wait complete. 2024-04-23T18:23:27.550 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-23T18:23:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbee00640 1 Processor -- start 2024-04-23T18:23:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbee00640 1 -- start start 2024-04-23T18:23:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4cb8073b00 0x7f4cb80cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbee00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4cb80cbe90 0x7f4cb80cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbee00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb80c6c80 con 0x7f4cb815d210 2024-04-23T18:23:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbee00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb815c580 con 0x7f4cb80cbe90 2024-04-23T18:23:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb80c6100 con 0x7f4cb8073b00 2024-04-23T18:23:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbce00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4cb80cbe90 0x7f4cb80cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbce00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4cb80cbe90 0x7f4cb80cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50086/0 (socket says 172.21.15.28:50086) 2024-04-23T18:23:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbce00640 1 -- 172.21.15.28:0/942986668 learned_addr learned my addr 172.21.15.28:0/942986668 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4caf400640 1 --2- 172.21.15.28:0/942986668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4cb8073b00 0x7f4cb80cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbce00640 1 -- 172.21.15.28:0/942986668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4cb8073b00 msgr2=0x7f4cb80cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbce00640 1 --2- 172.21.15.28:0/942986668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4cb8073b00 0x7f4cb80cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbce00640 1 -- 172.21.15.28:0/942986668 >> v1:172.21.15.28:6789/0 conn(0x7f4cb815d210 legacy=0x7f4cb81596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.699+0000 7f4cbce00640 1 -- 172.21.15.28:0/942986668 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb80c63e0 con 0x7f4cb80cbe90 2024-04-23T18:23:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cbce00640 1 --2- 172.21.15.28:0/942986668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb80cbe90 0x7f4cb80cb820 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009e50 tx=0x7f4cb001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efacf1634787793f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cb7400640 1 -- 172.21.15.28:0/942986668 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00a5750 con 0x7f4cb80cbe90 2024-04-23T18:23:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cb7400640 1 -- 172.21.15.28:0/942986668 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb00a58f0 con 0x7f4cb80cbe90 2024-04-23T18:23:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cb7400640 1 -- 172.21.15.28:0/942986668 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00a5cc0 con 0x7f4cb80cbe90 2024-04-23T18:23:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cbee00640 1 -- 172.21.15.28:0/942986668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb80cbe90 msgr2=0x7f4cb80cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cbee00640 1 --2- 172.21.15.28:0/942986668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb80cbe90 0x7f4cb80cb820 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009e50 tx=0x7f4cb001c9a0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cbee00640 1 -- 172.21.15.28:0/942986668 shutdown_connections 2024-04-23T18:23:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cbee00640 1 --2- 172.21.15.28:0/942986668 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb80cbe90 0x7f4cb80cb820 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cbee00640 1 --2- 172.21.15.28:0/942986668 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4cb8073b00 0x7f4cb80cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cbee00640 1 -- 172.21.15.28:0/942986668 >> 172.21.15.28:0/942986668 conn(0x7f4cb8072f30 msgr2=0x7f4cb8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cbee00640 1 -- 172.21.15.28:0/942986668 shutdown_connections 2024-04-23T18:23:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.703+0000 7f4cbee00640 1 -- 172.21.15.28:0/942986668 wait complete. 2024-04-23T18:23:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbee00640 1 Processor -- start 2024-04-23T18:23:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbee00640 1 -- start start 2024-04-23T18:23:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb8073b00 0x7f4cb814a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4cb80cbe90 0x7f4cb81f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbee00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb815d210 0x7f4cb8144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbee00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb80c5d50 con 0x7f4cb815d210 2024-04-23T18:23:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8159dd0 con 0x7f4cb8073b00 2024-04-23T18:23:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb814d730 con 0x7f4cb80cbe90 2024-04-23T18:23:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb815d210 0x7f4cb8144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb815d210 0x7f4cb8144f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50090/0 (socket says 172.21.15.28:50090) 2024-04-23T18:23:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbce00640 1 -- 172.21.15.28:0/3930459804 learned_addr learned my addr 172.21.15.28:0/3930459804 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb8073b00 0x7f4cb814a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4caf400640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4cb80cbe90 0x7f4cb81f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbce00640 1 -- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4cb80cbe90 msgr2=0x7f4cb81f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbce00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4cb80cbe90 0x7f4cb81f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbce00640 1 -- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb8073b00 msgr2=0x7f4cb814a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbce00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb8073b00 0x7f4cb814a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbce00640 1 -- 172.21.15.28:0/3930459804 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb815a1f0 con 0x7f4cb815d210 2024-04-23T18:23:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4caf400640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4cb80cbe90 0x7f4cb81f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbce00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb815d210 0x7f4cb8144f80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00af040 tx=0x7f4cb0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cb4c00640 1 -- 172.21.15.28:0/3930459804 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00b8670 con 0x7f4cb815d210 2024-04-23T18:23:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cb4c00640 1 -- 172.21.15.28:0/3930459804 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb00be070 con 0x7f4cb815d210 2024-04-23T18:23:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cb4c00640 1 -- 172.21.15.28:0/3930459804 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00b8a70 con 0x7f4cb815d210 2024-04-23T18:23:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbee00640 1 -- 172.21.15.28:0/3930459804 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb815bed0 con 0x7f4cb815d210 2024-04-23T18:23:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.707+0000 7f4cbee00640 1 -- 172.21.15.28:0/3930459804 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb814dcb0 con 0x7f4cb815d210 2024-04-23T18:23:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cb4c00640 1 -- 172.21.15.28:0/3930459804 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4cb00b8c10 con 0x7f4cb815d210 2024-04-23T18:23:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cb4c00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4c94068380 0x7f4c9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cb4c00640 1 -- 172.21.15.28:0/3930459804 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4cb01220b0 con 0x7f4cb815d210 2024-04-23T18:23:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4c94068380 0x7f4c9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cc228c000 1 Processor -- start 2024-04-23T18:23:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cc228c000 1 -- start start 2024-04-23T18:23:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4c94068380 0x7f4c9406a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8001650 tx=0x7f4ca8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d773cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773ccab0 0x564d77407080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d774079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cc228c000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x564d77215420 con 0x564d773cc190 2024-04-23T18:23:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cc228c000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d771afbf0 con 0x564d773ccab0 2024-04-23T18:23:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cc228c000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x564d772113e0 con 0x564d774075c0 2024-04-23T18:23:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cb7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d773cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.711+0000 7f4cb7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d773cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50096/0 (socket says 172.21.15.28:50096) 2024-04-23T18:23:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cb7e00640 1 -- 172.21.15.28:0/3237110216 learned_addr learned my addr 172.21.15.28:0/3237110216 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4caf400640 1 --2- 172.21.15.28:0/3237110216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773ccab0 0x564d77407080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cbce00640 1 --2- 172.21.15.28:0/3237110216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d774079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cb7e00640 1 -- 172.21.15.28:0/3237110216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 msgr2=0x564d774079a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/3237110216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d774079a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cb7e00640 1 -- 172.21.15.28:0/3237110216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773ccab0 msgr2=0x564d77407080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/3237110216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773ccab0 0x564d77407080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cb7e00640 1 -- 172.21.15.28:0/3237110216 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d772bd450 con 0x564d773cc190 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4caf400640 1 --2- 172.21.15.28:0/3237110216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773ccab0 0x564d77407080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/3237110216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d773cc570 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80052e0 tx=0x7f4ca8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a29d1e856b6cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cacc00640 1 -- 172.21.15.28:0/3237110216 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca800e530 con 0x564d773cc190 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cacc00640 1 -- 172.21.15.28:0/3237110216 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca800e6d0 con 0x564d773cc190 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cacc00640 1 -- 172.21.15.28:0/3237110216 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca800ea80 con 0x564d773cc190 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 -- 172.21.15.28:0/3237110216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 msgr2=0x564d773cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 --2- 172.21.15.28:0/3237110216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d773cc570 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80052e0 tx=0x7f4ca8011000 comp rx=0 tx=0).stop 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 -- 172.21.15.28:0/3237110216 shutdown_connections 2024-04-23T18:23:27.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 --2- 172.21.15.28:0/3237110216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d774079a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 --2- 172.21.15.28:0/3237110216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773ccab0 0x564d77407080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 --2- 172.21.15.28:0/3237110216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d773cc570 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 -- 172.21.15.28:0/3237110216 >> 172.21.15.28:0/3237110216 conn(0x564d77403e40 msgr2=0x564d77406260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 -- 172.21.15.28:0/3237110216 shutdown_connections 2024-04-23T18:23:27.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 -- 172.21.15.28:0/3237110216 wait complete. 2024-04-23T18:23:27.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 -- start start 2024-04-23T18:23:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 Processor -- start 2024-04-23T18:23:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773cc190 0x564d773c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d773c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d773c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x564d771b5ec0 con 0x564d773ccab0 2024-04-23T18:23:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d77296120 con 0x564d773cc190 2024-04-23T18:23:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x564d77220350 con 0x564d774075c0 2024-04-23T18:23:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cc228c000 10 client.0 _ll_register_callbacks cb 0x564d771f24d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4caf400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d773c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4caf400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d773c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50110/0 (socket says 172.21.15.28:50110) 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4caf400640 1 -- 172.21.15.28:0/3643573291 learned_addr learned my addr 172.21.15.28:0/3643573291 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773cc190 0x564d773c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.715+0000 7f4cbce00640 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d773c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4caf400640 1 -- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 msgr2=0x564d773c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4caf400640 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d773c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4caf400640 1 -- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773cc190 msgr2=0x564d773c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4caf400640 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773cc190 0x564d773c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4caf400640 1 -- 172.21.15.28:0/3643573291 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d7725af80 con 0x564d773ccab0 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4caf400640 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d773c9160 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80c81a0 tx=0x7f4ca00116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df321b352875b3b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4ca5600640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4ca5600640 1 -- 172.21.15.28:0/3643573291 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0019020 con 0x564d773ccab0 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4ca5600640 1 -- 172.21.15.28:0/3643573291 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4ca0004240 con 0x564d773ccab0 2024-04-23T18:23:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4cc228c000 1 -- 172.21.15.28:0/3643573291 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca800e6d0 con 0x564d773ccab0 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4ca5600640 1 -- 172.21.15.28:0/3643573291 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f4ca0023050 con 0x564d773ccab0 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4cc228c000 10 client.5118 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4cc228c000 1 -- 172.21.15.28:0/3643573291 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x564d771eef00 con 0x564d773ccab0 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4ca5600640 1 -- 172.21.15.28:0/3643573291 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca800e6d0 con 0x564d773ccab0 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4ca5600640 1 -- 172.21.15.28:0/3643573291 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f4ca0026020 con 0x564d773ccab0 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4cc228c000 10 client.5118 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4cc228c000 10 client.5118 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4cc228c000 20 client.5118 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4cc228c000 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x564d7741bd90 0x564d7741e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4cc228c000 4 client.5118 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4cc228c000 1 -- 172.21.15.28:0/3643573291 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d771aebc0 con 0x564d7741bd90 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x564d7741bd90 0x564d7741e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x564d7741bd90 0x564d7741e180 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b75ebd50fc45f5b2 server_cookie=7d429c854b5b57d2 in_seq=0 out_seq=0 2024-04-23T18:23:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.719+0000 7f4ca5600640 10 client.5118 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:27.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4ca5600640 1 -- 172.21.15.28:0/3643573291 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564d771aebc0 con 0x564d7741bd90 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4ca5600640 10 client.5118 handle_command_reply: tid=0 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 1 client.5118 shutdown 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 1 -- 172.21.15.28:0/3643573291 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 msgr2=0x564d773c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d773c9160 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80c81a0 tx=0x7f4ca00116f0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 1 -- 172.21.15.28:0/3643573291 shutdown_connections 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x564d7741bd90 0x564d7741e180 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d773c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d773c9160 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4ca5600640 0 client.5118 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 1 --2- 172.21.15.28:0/3643573291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773cc190 0x564d773c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 1 -- 172.21.15.28:0/3643573291 >> 172.21.15.28:0/3643573291 conn(0x564d77403e40 msgr2=0x564d774051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 1 -- 172.21.15.28:0/3643573291 shutdown_connections 2024-04-23T18:23:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 1 -- 172.21.15.28:0/3643573291 wait complete. 2024-04-23T18:23:27.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.723+0000 7f4cc228c000 20 client.5118 trim_cache size 0 max 16384 2024-04-23T18:23:27.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.739+0000 7f4cc228c000 1 Processor -- start 2024-04-23T18:23:27.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.739+0000 7f4cc228c000 1 -- start start 2024-04-23T18:23:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.739+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d77401e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.739+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773ccab0 0x564d774023d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.739+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d7741e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.739+0000 7f4cc228c000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8200a00 con 0x564d773cc190 2024-04-23T18:23:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.739+0000 7f4cc228c000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb81f8060 con 0x564d773ccab0 2024-04-23T18:23:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.739+0000 7f4cc228c000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb82005a0 con 0x564d774075c0 2024-04-23T18:23:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cb7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d77401e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cb7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d77401e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50116/0 (socket says 172.21.15.28:50116) 2024-04-23T18:23:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cb7e00640 1 -- 172.21.15.28:0/2572761238 learned_addr learned my addr 172.21.15.28:0/2572761238 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4caf400640 1 --2- 172.21.15.28:0/2572761238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773ccab0 0x564d774023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cbce00640 1 --2- 172.21.15.28:0/2572761238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d7741e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cb7e00640 1 -- 172.21.15.28:0/2572761238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 msgr2=0x564d7741e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/2572761238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d7741e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cb7e00640 1 -- 172.21.15.28:0/2572761238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773ccab0 msgr2=0x564d774023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/2572761238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773ccab0 0x564d774023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cb7e00640 1 -- 172.21.15.28:0/2572761238 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d773cb940 con 0x564d773cc190 2024-04-23T18:23:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/2572761238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d77401e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800e160 tx=0x7f4ca8017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1362d7af2ef13b1f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4ca7e00640 1 -- 172.21.15.28:0/2572761238 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca800ea40 con 0x564d773cc190 2024-04-23T18:23:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4ca7e00640 1 -- 172.21.15.28:0/2572761238 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca800ebe0 con 0x564d773cc190 2024-04-23T18:23:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4ca7e00640 1 -- 172.21.15.28:0/2572761238 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8030110 con 0x564d773cc190 2024-04-23T18:23:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 -- 172.21.15.28:0/2572761238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 msgr2=0x564d77401e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 --2- 172.21.15.28:0/2572761238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d77401e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800e160 tx=0x7f4ca8017070 comp rx=0 tx=0).stop 2024-04-23T18:23:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 -- 172.21.15.28:0/2572761238 shutdown_connections 2024-04-23T18:23:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 --2- 172.21.15.28:0/2572761238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d774075c0 0x564d7741e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 --2- 172.21.15.28:0/2572761238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d773ccab0 0x564d774023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 --2- 172.21.15.28:0/2572761238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773cc190 0x564d77401e90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 -- 172.21.15.28:0/2572761238 >> 172.21.15.28:0/2572761238 conn(0x564d77403e40 msgr2=0x564d773c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 -- 172.21.15.28:0/2572761238 shutdown_connections 2024-04-23T18:23:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 -- 172.21.15.28:0/2572761238 wait complete. 2024-04-23T18:23:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 -- start start 2024-04-23T18:23:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 Processor -- start 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d773cc190 0x564d774762b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d774767f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d774075c0 0x564d77476f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x564d77214730 con 0x564d773ccab0 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d771e19e0 con 0x564d774075c0 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x564d77219a50 con 0x564d773cc190 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cc228c000 10 client.0 _ll_register_callbacks cb 0x7f4ca000b300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4caf400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d774767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4caf400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d774767f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50124/0 (socket says 172.21.15.28:50124) 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4caf400640 1 -- 172.21.15.28:0/1270039132 learned_addr learned my addr 172.21.15.28:0/1270039132 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d773cc190 0x564d774762b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4cbce00640 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d774075c0 0x564d77476f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4caf400640 1 -- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d773cc190 msgr2=0x564d774762b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4caf400640 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d773cc190 0x564d774762b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4caf400640 1 -- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d774075c0 msgr2=0x564d77476f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4caf400640 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d774075c0 0x564d77476f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.743+0000 7f4caf400640 1 -- 172.21.15.28:0/1270039132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d7719be80 con 0x564d773ccab0 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4caf400640 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d774767f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0003b10 tx=0x7f4ca0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6718aab76c82056 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4ca5600640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4ca5600640 1 -- 172.21.15.28:0/1270039132 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0019040 con 0x564d773ccab0 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 -- 172.21.15.28:0/1270039132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca800ebe0 con 0x564d773ccab0 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4ca5600640 1 -- 172.21.15.28:0/1270039132 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4ca000f040 con 0x564d773ccab0 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4ca5600640 1 -- 172.21.15.28:0/1270039132 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f4ca0035050 con 0x564d773ccab0 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 10 client.5124 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 -- 172.21.15.28:0/1270039132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x564d771ddb30 con 0x564d773ccab0 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4ca5600640 1 -- 172.21.15.28:0/1270039132 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca800ebe0 con 0x564d773ccab0 2024-04-23T18:23:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4ca5600640 1 -- 172.21.15.28:0/1270039132 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f4ca0038020 con 0x564d773ccab0 2024-04-23T18:23:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 10 client.5124 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 10 client.5124 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-23T18:23:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 20 client.5124 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x564d77483430 0x564d77477c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 4 client.5124 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T18:23:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 -- 172.21.15.28:0/1270039132 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "status"}) -- 0x564d77222e40 con 0x564d77483430 2024-04-23T18:23:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x564d77483430 0x564d77477c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cb7e00640 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x564d77483430 0x564d77477c50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4cd30fe2365e040 server_cookie=f27fc308f9bfc67b in_seq=0 out_seq=0 2024-04-23T18:23:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4ca5600640 10 client.5124 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4ca5600640 1 -- 172.21.15.28:0/1270039132 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564d77222e40 con 0x564d77483430 2024-04-23T18:23:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4ca5600640 10 client.5124 handle_command_reply: tid=0 2024-04-23T18:23:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 client.5124 shutdown 2024-04-23T18:23:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 -- 172.21.15.28:0/1270039132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 msgr2=0x564d774767f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d774767f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0003b10 tx=0x7f4ca0014000 comp rx=0 tx=0).stop 2024-04-23T18:23:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 -- 172.21.15.28:0/1270039132 shutdown_connections 2024-04-23T18:23:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x564d77483430 0x564d77477c50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d774075c0 0x564d77476f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564d773ccab0 0x564d774767f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 --2- 172.21.15.28:0/1270039132 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x564d773cc190 0x564d774762b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4ca5600640 0 client.5124 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 -- 172.21.15.28:0/1270039132 >> 172.21.15.28:0/1270039132 conn(0x564d77403e40 msgr2=0x564d77401600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 -- 172.21.15.28:0/1270039132 shutdown_connections 2024-04-23T18:23:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 1 -- 172.21.15.28:0/1270039132 wait complete. 2024-04-23T18:23:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cc228c000 20 client.5124 trim_cache size 0 max 16384 2024-04-23T18:23:27.746 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "d84cc156-ceaf-4cae-a89c-ee7e55af72c5", 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4297, 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 54.379689763999998, 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 15, 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 26, 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 61.813043645999997 2024-04-23T18:23:27.747 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:23:27.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 -- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4c94068380 msgr2=0x7f4c9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4c94068380 0x7f4c9406a840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8001650 tx=0x7f4ca8009040 comp rx=0 tx=0).stop 2024-04-23T18:23:27.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 -- 172.21.15.28:0/3930459804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb815d210 msgr2=0x7f4cb8144f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:27.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb815d210 0x7f4cb8144f80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00af040 tx=0x7f4cb0019740 comp rx=0 tx=0).stop 2024-04-23T18:23:27.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 -- 172.21.15.28:0/3930459804 shutdown_connections 2024-04-23T18:23:27.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4c94068380 0x7f4c9406a840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4cb80cbe90 0x7f4cb81f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb815d210 0x7f4cb8144f80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 --2- 172.21.15.28:0/3930459804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb8073b00 0x7f4cb814a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:27.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 -- 172.21.15.28:0/3930459804 >> 172.21.15.28:0/3930459804 conn(0x7f4cb8072f30 msgr2=0x7f4cb814b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:27.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 -- 172.21.15.28:0/3930459804 shutdown_connections 2024-04-23T18:23:27.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:27.747+0000 7f4cbee00640 1 -- 172.21.15.28:0/3930459804 wait complete. 2024-04-23T18:23:27.763 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-23T18:23:27.890 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:23:27.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:23:42.763 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-23T18:23:42.764 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.5 2024-04-23T18:23:42.764 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:23:42.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.927+0000 7f3ddd600640 1 Processor -- start 2024-04-23T18:23:42.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.927+0000 7f3ddd600640 1 -- start start 2024-04-23T18:23:42.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3ddd600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3dd8072920 0x7f3dd815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:42.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3ddd600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd815e800 con 0x7f3dd8067940 2024-04-23T18:23:42.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3ddd600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd815eaa0 con 0x7f3dd8067d20 2024-04-23T18:23:42.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3ddd600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3dd8071d80 con 0x7f3dd8072920 2024-04-23T18:23:42.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd6a00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3dd8067940 0x7f3dd8144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48814/0 (socket says 172.21.15.28:48814) 2024-04-23T18:23:42.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd6a00640 1 -- 172.21.15.28:0/3433766633 learned_addr learned my addr 172.21.15.28:0/3433766633 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:42.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd7400640 1 --2- 172.21.15.28:0/3433766633 >> v2:172.21.15.137:3300/0 conn(0x7f3dd8072920 0x7f3dd815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:42.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294590783 0 0) 0x7f3dd815e800 con 0x7f3dd8067940 2024-04-23T18:23:42.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dbc003530 con 0x7f3dd8067940 2024-04-23T18:23:42.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4240004194 0 0) 0x7f3dd815eaa0 con 0x7f3dd8067d20 2024-04-23T18:23:42.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dd815e800 con 0x7f3dd8067d20 2024-04-23T18:23:42.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1766080658 0 0) 0x7f3dbc003530 con 0x7f3dd8067940 2024-04-23T18:23:42.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 >> v2:172.21.15.137:3300/0 conn(0x7f3dd8072920 msgr2=0x7f3dd815bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:42.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 --2- 172.21.15.28:0/3433766633 >> v2:172.21.15.137:3300/0 conn(0x7f3dd8072920 0x7f3dd815bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:42.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 >> v1:172.21.15.137:6789/0 conn(0x7f3dd8067d20 legacy=0x7f3dd8072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:42.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd80cab10 con 0x7f3dd8067940 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f3dc8001680 con 0x7f3dd8067940 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 >> v1:172.21.15.28:6789/0 conn(0x7f3dd8067940 legacy=0x7f3dd8144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 0x7f3dbc003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc004810 0x7f3dbc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3dbc0051d0 0x7f3dbc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8071d80 con 0x7f3dbc003b50 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc00c050 con 0x7f3dbc004810 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc00c250 con 0x7f3dbc0051d0 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd6a00640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 0x7f3dbc003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd6000640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc004810 0x7f3dbc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd7400640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3dbc0051d0 0x7f3dbc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd6a00640 1 -- 172.21.15.28:0/3433766633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3dbc0051d0 msgr2=0x7f3dbc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd6a00640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3dbc0051d0 0x7f3dbc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd6a00640 1 -- 172.21.15.28:0/3433766633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc004810 msgr2=0x7f3dbc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:42.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd6a00640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc004810 0x7f3dbc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:42.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd6a00640 1 -- 172.21.15.28:0/3433766633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc003530 con 0x7f3dbc003b50 2024-04-23T18:23:42.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd6000640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dbc004810 0x7f3dbc004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:42.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.931+0000 7f3dd7400640 1 -- 172.21.15.28:0/3433766633 reap_dead start 2024-04-23T18:23:42.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.935+0000 7f3dd6a00640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 0x7f3dbc003f50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c1c0 tx=0x7f3dc801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db068d512a38ff37 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:42.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.935+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8007cf0 con 0x7f3dbc003b50 2024-04-23T18:23:42.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.935+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc80a9020 con 0x7f3dbc003b50 2024-04-23T18:23:42.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.935+0000 7f3dd5600640 1 -- 172.21.15.28:0/3433766633 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8005ae0 con 0x7f3dbc003b50 2024-04-23T18:23:42.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.939+0000 7f3ddd600640 1 -- 172.21.15.28:0/3433766633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 msgr2=0x7f3dbc003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:42.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.939+0000 7f3ddd600640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 0x7f3dbc003f50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c1c0 tx=0x7f3dc801cbf0 comp rx=0 tx=0).stop 2024-04-23T18:23:42.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.939+0000 7f3ddd600640 1 -- 172.21.15.28:0/3433766633 shutdown_connections 2024-04-23T18:23:42.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.939+0000 7f3ddd600640 1 --2- 172.21.15.28:0/3433766633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 0x7f3dbc003f50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:42.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.939+0000 7f3ddd600640 1 -- 172.21.15.28:0/3433766633 >> 172.21.15.28:0/3433766633 conn(0x7f3dd806f970 msgr2=0x7f3dd806fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:42.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.939+0000 7f3ddd600640 1 -- 172.21.15.28:0/3433766633 shutdown_connections 2024-04-23T18:23:42.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.939+0000 7f3ddd600640 1 -- 172.21.15.28:0/3433766633 wait complete. 2024-04-23T18:23:42.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.939+0000 7f3ddd600640 1 Processor -- start 2024-04-23T18:23:42.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.939+0000 7f3ddd600640 1 -- start start 2024-04-23T18:23:42.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3ddd600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 0x7f3dd81412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:42.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3ddd600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3dd8142640 0x7f3dd80c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:42.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3ddd600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dd80c6bb0 0x7f3dd813fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:42.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3ddd600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd815c0a0 con 0x7f3dbc003b50 2024-04-23T18:23:42.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3ddd600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd815f5e0 con 0x7f3dd80c6bb0 2024-04-23T18:23:42.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3ddd600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd8144860 con 0x7f3dd8142640 2024-04-23T18:23:42.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dd6a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 0x7f3dd81412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:42.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dd6a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 0x7f3dd81412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51138/0 (socket says 172.21.15.28:51138) 2024-04-23T18:23:42.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dd6a00640 1 -- 172.21.15.28:0/3777124959 learned_addr learned my addr 172.21.15.28:0/3777124959 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:42.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dd6000640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3dd8142640 0x7f3dd80c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:42.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dd7400640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dd80c6bb0 0x7f3dd813fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:42.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dd6a00640 1 -- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3dd8142640 msgr2=0x7f3dd80c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:42.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dd6a00640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3dd8142640 0x7f3dd80c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:42.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dd6a00640 1 -- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dd80c6bb0 msgr2=0x7f3dd813fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:42.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dd6a00640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dd80c6bb0 0x7f3dd813fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:42.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dd6a00640 1 -- 172.21.15.28:0/3777124959 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd81f3fc0 con 0x7f3dbc003b50 2024-04-23T18:23:42.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dd6a00640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 0x7f3dd81412a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8007040 tx=0x7f3dbc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:42.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dcea00640 1 -- 172.21.15.28:0/3777124959 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80a5b50 con 0x7f3dbc003b50 2024-04-23T18:23:42.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dcea00640 1 -- 172.21.15.28:0/3777124959 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc80a5cf0 con 0x7f3dbc003b50 2024-04-23T18:23:42.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3ddd600640 1 -- 172.21.15.28:0/3777124959 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd81f4240 con 0x7f3dbc003b50 2024-04-23T18:23:42.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3dcea00640 1 -- 172.21.15.28:0/3777124959 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80049f0 con 0x7f3dbc003b50 2024-04-23T18:23:42.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3ddd600640 1 -- 172.21.15.28:0/3777124959 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd81f4800 con 0x7f3dbc003b50 2024-04-23T18:23:42.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.943+0000 7f3ddd600640 1 -- 172.21.15.28:0/3777124959 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd80c6f90 con 0x7f3dbc003b50 2024-04-23T18:23:42.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.947+0000 7f3dcea00640 1 -- 172.21.15.28:0/3777124959 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3dc8004b90 con 0x7f3dbc003b50 2024-04-23T18:23:42.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.947+0000 7f3dcea00640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3db8068380 0x7f3db806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:42.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.947+0000 7f3dcea00640 1 -- 172.21.15.28:0/3777124959 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3dc8120e10 con 0x7f3dbc003b50 2024-04-23T18:23:42.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.947+0000 7f3dd6000640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3db8068380 0x7f3db806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:42.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.947+0000 7f3dd6000640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3db8068380 0x7f3db806a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8140d10 tx=0x7f3dc4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:42.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:42.951+0000 7f3dcea00640 1 -- 172.21.15.28:0/3777124959 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3dc8124030 con 0x7f3dbc003b50 2024-04-23T18:23:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 -- 172.21.15.28:0/3777124959 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dd8068cd0 con 0x7f3dbc003b50 2024-04-23T18:23:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3dcea00640 1 -- 172.21.15.28:0/3777124959 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f3dd81f3fc0 con 0x7f3dbc003b50 2024-04-23T18:23:43.173 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:23:43.173 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:23:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:23:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 -- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3db8068380 msgr2=0x7f3db806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3db8068380 0x7f3db806a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8140d10 tx=0x7f3dc4009040 comp rx=0 tx=0).stop 2024-04-23T18:23:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 -- 172.21.15.28:0/3777124959 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 msgr2=0x7f3dd81412a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 0x7f3dd81412a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8007040 tx=0x7f3dbc005840 comp rx=0 tx=0).stop 2024-04-23T18:23:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 -- 172.21.15.28:0/3777124959 shutdown_connections 2024-04-23T18:23:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3db8068380 0x7f3db806a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3dd8142640 0x7f3dd80c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dd80c6bb0 0x7f3dd813fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 --2- 172.21.15.28:0/3777124959 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3dbc003b50 0x7f3dd81412a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 -- 172.21.15.28:0/3777124959 >> 172.21.15.28:0/3777124959 conn(0x7f3dd806f970 msgr2=0x7f3dd815cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 -- 172.21.15.28:0/3777124959 shutdown_connections 2024-04-23T18:23:43.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.179+0000 7f3ddd600640 1 -- 172.21.15.28:0/3777124959 wait complete. 2024-04-23T18:23:43.194 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4297 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0' 2024-04-23T18:23:43.194 DEBUG:teuthology.orchestra.run.smithi028:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4297 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0 2024-04-23T18:23:43.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d9c00640 1 Processor -- start 2024-04-23T18:23:43.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d9c00640 1 -- start start 2024-04-23T18:23:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d9c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc4d4073b00 0x7fc4d40cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d9c00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d40c6c80 con 0x7fc4d415d210 2024-04-23T18:23:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d9c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d415c580 con 0x7fc4d40cbe90 2024-04-23T18:23:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d9c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40c6100 con 0x7fc4d4073b00 2024-04-23T18:23:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d2a00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc4d415d210 0x7fc4d41596c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48822/0 (socket says 172.21.15.28:48822) 2024-04-23T18:23:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d2a00640 1 -- 172.21.15.28:0/408283638 learned_addr learned my addr 172.21.15.28:0/408283638 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:23:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d2000640 1 --2- 172.21.15.28:0/408283638 >> v2:172.21.15.137:3300/0 conn(0x7fc4d4073b00 0x7fc4d40cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 202282620 0 0) 0x7fc4d40c6c80 con 0x7fc4d415d210 2024-04-23T18:23:43.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4b8003530 con 0x7fc4d415d210 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3916388189 0 0) 0x7fc4b8003530 con 0x7fc4d415d210 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 >> v2:172.21.15.137:3300/0 conn(0x7fc4d4073b00 msgr2=0x7fc4d40cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 --2- 172.21.15.28:0/408283638 >> v2:172.21.15.137:3300/0 conn(0x7fc4d4073b00 0x7fc4d40cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 >> v1:172.21.15.137:6789/0 conn(0x7fc4d40cbe90 legacy=0x7fc4d4163910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40c63e0 con 0x7fc4d415d210 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7fc4c4001680 con 0x7fc4d415d210 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 >> v1:172.21.15.28:6789/0 conn(0x7fc4d415d210 legacy=0x7fc4d41596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 --2- 172.21.15.28:0/408283638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b80039c0 0x7fc4b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 --2- 172.21.15.28:0/408283638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4b8004810 0x7fc4b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 --2- 172.21.15.28:0/408283638 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4b80051d0 0x7fc4b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40c6100 con 0x7fc4b8004810 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b800c0d0 con 0x7fc4b80039c0 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.407+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b800c2d0 con 0x7fc4b80051d0 2024-04-23T18:23:43.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d2000640 1 --2- 172.21.15.28:0/408283638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4b8004810 0x7fc4b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d3400640 1 --2- 172.21.15.28:0/408283638 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4b80051d0 0x7fc4b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/408283638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b80039c0 0x7fc4b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d2000640 1 -- 172.21.15.28:0/408283638 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4b80051d0 msgr2=0x7fc4b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:43.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d2000640 1 --2- 172.21.15.28:0/408283638 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4b80051d0 0x7fc4b800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d2000640 1 -- 172.21.15.28:0/408283638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b80039c0 msgr2=0x7fc4b8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:43.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d2000640 1 --2- 172.21.15.28:0/408283638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b80039c0 0x7fc4b8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d2000640 1 -- 172.21.15.28:0/408283638 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40c63e0 con 0x7fc4b8004810 2024-04-23T18:23:43.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d3400640 1 -- 172.21.15.28:0/408283638 reap_dead start 2024-04-23T18:23:43.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d2000640 1 --2- 172.21.15.28:0/408283638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4b8004810 0x7fc4b8004c90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0009ae0 tx=0x7fc4c001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a53f4b2727d65f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:43.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00b2070 con 0x7fc4b8004810 2024-04-23T18:23:43.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c00a5530 con 0x7fc4b8004810 2024-04-23T18:23:43.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.411+0000 7fc4d1600640 1 -- 172.21.15.28:0/408283638 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00096b0 con 0x7fc4b8004810 2024-04-23T18:23:43.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 -- 172.21.15.28:0/408283638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4b8004810 msgr2=0x7fc4b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 --2- 172.21.15.28:0/408283638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4b8004810 0x7fc4b8004c90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0009ae0 tx=0x7fc4c001ca70 comp rx=0 tx=0).stop 2024-04-23T18:23:43.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 -- 172.21.15.28:0/408283638 shutdown_connections 2024-04-23T18:23:43.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 --2- 172.21.15.28:0/408283638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4b8004810 0x7fc4b8004c90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 -- 172.21.15.28:0/408283638 >> 172.21.15.28:0/408283638 conn(0x7fc4d4072f30 msgr2=0x7fc4d4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:43.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 -- 172.21.15.28:0/408283638 shutdown_connections 2024-04-23T18:23:43.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 -- 172.21.15.28:0/408283638 wait complete. 2024-04-23T18:23:43.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 Processor -- start 2024-04-23T18:23:43.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 -- start start 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b8004810 0x7fc4d40ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4d4151900 0x7fc4d41f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4d41f4570 0x7fc4d41f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40c5d50 con 0x7fc4d41f4570 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40c58e0 con 0x7fc4b8004810 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d9c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d41f3ba0 con 0x7fc4d4151900 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4d41f4570 0x7fc4d41f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4d41f4570 0x7fc4d41f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51156/0 (socket says 172.21.15.28:51156) 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d3400640 1 -- 172.21.15.28:0/80535825 learned_addr learned my addr 172.21.15.28:0/80535825 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d2000640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4d4151900 0x7fc4d41f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.415+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b8004810 0x7fc4d40ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4d3400640 1 -- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4d4151900 msgr2=0x7fc4d41f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4d3400640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4d4151900 0x7fc4d41f4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4d3400640 1 -- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b8004810 msgr2=0x7fc4d40ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4d3400640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b8004810 0x7fc4d40ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4d3400640 1 -- 172.21.15.28:0/80535825 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40cf2e0 con 0x7fc4d41f4570 2024-04-23T18:23:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b8004810 0x7fc4d40ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4d3400640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4d41f4570 0x7fc4d41f6ee0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40c7b70 tx=0x7fc4cc00e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4caa00640 1 -- 172.21.15.28:0/80535825 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc003b90 con 0x7fc4d41f4570 2024-04-23T18:23:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4caa00640 1 -- 172.21.15.28:0/80535825 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4cc018070 con 0x7fc4d41f4570 2024-04-23T18:23:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4caa00640 1 -- 172.21.15.28:0/80535825 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0050d0 con 0x7fc4d41f4570 2024-04-23T18:23:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4d9c00640 1 -- 172.21.15.28:0/80535825 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d40c3cd0 con 0x7fc4d41f4570 2024-04-23T18:23:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4d9c00640 1 -- 172.21.15.28:0/80535825 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d40cf550 con 0x7fc4d41f4570 2024-04-23T18:23:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.419+0000 7fc4caa00640 1 -- 172.21.15.28:0/80535825 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4cc005270 con 0x7fc4d41f4570 2024-04-23T18:23:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 Processor -- start 2024-04-23T18:23:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4caa00640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc4b4068380 0x7fc4b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 -- start start 2024-04-23T18:23:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4caa00640 1 -- 172.21.15.28:0/80535825 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc4cc086850 con 0x7fc4d41f4570 2024-04-23T18:23:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d2000640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc4b4068380 0x7fc4b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6cdf600 0x5582a6cdf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce46c0 0x5582a6ce4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ce53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5582a6b8b2a0 con 0x5582a6ce4fe0 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5582a6af15f0 con 0x5582a6ce46c0 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5582a6a8c820 con 0x5582a6cdf600 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ce53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ce53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51166/0 (socket says 172.21.15.28:51166) 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6cdf600 0x5582a6cdf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d3400640 1 -- 172.21.15.28:0/3363408721 learned_addr learned my addr 172.21.15.28:0/3363408721 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d3400640 1 -- 172.21.15.28:0/3363408721 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6cdf600 msgr2=0x5582a6cdf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d3400640 1 --2- 172.21.15.28:0/3363408721 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6cdf600 0x5582a6cdf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d3400640 1 -- 172.21.15.28:0/3363408721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce46c0 msgr2=0x5582a6ce4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d3400640 1 --2- 172.21.15.28:0/3363408721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce46c0 0x5582a6ce4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d3400640 1 -- 172.21.15.28:0/3363408721 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582a6b37c00 con 0x5582a6ce4fe0 2024-04-23T18:23:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d2000640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc4b4068380 0x7fc4b406a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00af000 tx=0x7fc4c00046d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4d3400640 1 --2- 172.21.15.28:0/3363408721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ce53c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc001230 tx=0x7fc4cc056aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc79e6cf7c5f1ae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4bf400640 1 -- 172.21.15.28:0/3363408721 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc05ef80 con 0x5582a6ce4fe0 2024-04-23T18:23:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4bf400640 1 -- 172.21.15.28:0/3363408721 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4cc0546a0 con 0x5582a6ce4fe0 2024-04-23T18:23:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4bf400640 1 -- 172.21.15.28:0/3363408721 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc005560 con 0x5582a6ce4fe0 2024-04-23T18:23:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 -- 172.21.15.28:0/3363408721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 msgr2=0x5582a6ce53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/3363408721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ce53c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc001230 tx=0x7fc4cc056aa0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 -- 172.21.15.28:0/3363408721 shutdown_connections 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/3363408721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ce53c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/3363408721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce46c0 0x5582a6ce4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/3363408721 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6cdf600 0x5582a6cdf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.423+0000 7fc4dd0db000 1 -- 172.21.15.28:0/3363408721 >> 172.21.15.28:0/3363408721 conn(0x5582a6ce0470 msgr2=0x5582a6ce2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 -- 172.21.15.28:0/3363408721 shutdown_connections 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 -- 172.21.15.28:0/3363408721 wait complete. 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 -- start start 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 Processor -- start 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6cdf600 0x5582a6cde9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce46c0 0x5582a6cdef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6ce4fe0 0x5582a6cea620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5582a6a9cc60 con 0x5582a6ce46c0 2024-04-23T18:23:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5582a6b73bf0 con 0x5582a6cdf600 2024-04-23T18:23:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5582a6bae560 con 0x5582a6ce4fe0 2024-04-23T18:23:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 10 client.0 _ll_register_callbacks cb 0x5582a6ac8570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d2000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce46c0 0x5582a6cdef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d2000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce46c0 0x5582a6cdef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51182/0 (socket says 172.21.15.28:51182) 2024-04-23T18:23:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d2000640 1 -- 172.21.15.28:0/2132732758 learned_addr learned my addr 172.21.15.28:0/2132732758 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6cdf600 0x5582a6cde9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d3400640 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6ce4fe0 0x5582a6cea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d2000640 1 -- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6ce4fe0 msgr2=0x5582a6cea620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d2000640 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6ce4fe0 0x5582a6cea620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d2000640 1 -- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6cdf600 msgr2=0x5582a6cde9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d2000640 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6cdf600 0x5582a6cde9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d2000640 1 -- 172.21.15.28:0/2132732758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582a6b2c630 con 0x5582a6ce46c0 2024-04-23T18:23:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d3400640 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6ce4fe0 0x5582a6cea620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6cdf600 0x5582a6cde9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4d2000640 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce46c0 0x5582a6cdef20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0098350 tx=0x7fc4b8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab94df3cc7837d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4b3e00640 1 -- 172.21.15.28:0/2132732758 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00c7060 con 0x5582a6ce46c0 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 -- 172.21.15.28:0/2132732758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4cc0546a0 con 0x5582a6ce46c0 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4b3e00640 1 -- 172.21.15.28:0/2132732758 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc4c00b9460 con 0x5582a6ce46c0 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4b3e00640 1 -- 172.21.15.28:0/2132732758 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fc4c00cd050 con 0x5582a6ce46c0 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 10 client.5142 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4dd0db000 1 -- 172.21.15.28:0/2132732758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5582a6a91490 con 0x5582a6ce46c0 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.427+0000 7fc4b3e00640 1 -- 172.21.15.28:0/2132732758 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4cc0546a0 con 0x5582a6ce46c0 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4b3e00640 1 -- 172.21.15.28:0/2132732758 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fc4c00c3700 con 0x5582a6ce46c0 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 10 client.5142 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 10 client.5142 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 20 client.5142 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5582a6ceb3c0 0x5582a6ceb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 4 client.5142 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:23:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 -- 172.21.15.28:0/2132732758 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582a6a8b7f0 con 0x5582a6ceb3c0 2024-04-23T18:23:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5582a6ceb3c0 0x5582a6ceb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5582a6ceb3c0 0x5582a6ceb7d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42db5c0d13848def server_cookie=7bf361b2df5a9e21 in_seq=0 out_seq=0 2024-04-23T18:23:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4b3e00640 10 client.5142 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4b3e00640 1 -- 172.21.15.28:0/2132732758 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5582a6a8b7f0 con 0x5582a6ceb3c0 2024-04-23T18:23:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4b3e00640 10 client.5142 handle_command_reply: tid=0 2024-04-23T18:23:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 client.5142 shutdown 2024-04-23T18:23:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 -- 172.21.15.28:0/2132732758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce46c0 msgr2=0x5582a6cdef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce46c0 0x5582a6cdef20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0098350 tx=0x7fc4b8005840 comp rx=0 tx=0).stop 2024-04-23T18:23:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 -- 172.21.15.28:0/2132732758 shutdown_connections 2024-04-23T18:23:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5582a6ceb3c0 0x5582a6ceb7d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6ce4fe0 0x5582a6cea620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce46c0 0x5582a6cdef20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/2132732758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6cdf600 0x5582a6cde9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 -- 172.21.15.28:0/2132732758 >> 172.21.15.28:0/2132732758 conn(0x5582a6ce0470 msgr2=0x5582a6ce36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:43.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4b3e00640 0 client.5142 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:43.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 -- 172.21.15.28:0/2132732758 shutdown_connections 2024-04-23T18:23:43.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 1 -- 172.21.15.28:0/2132732758 wait complete. 2024-04-23T18:23:43.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.431+0000 7fc4dd0db000 20 client.5142 trim_cache size 0 max 16384 2024-04-23T18:23:43.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.451+0000 7fc4dd0db000 1 Processor -- start 2024-04-23T18:23:43.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.451+0000 7fc4dd0db000 1 -- start start 2024-04-23T18:23:43.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6cdf600 0x5582a6d54a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6ce46c0 0x5582a6d54f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce4fe0 0x5582a6d55490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d4201400 con 0x5582a6cdf600 2024-04-23T18:23:43.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d4200850 con 0x5582a6ce4fe0 2024-04-23T18:23:43.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d4200d30 con 0x5582a6ce46c0 2024-04-23T18:23:43.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d2a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6cdf600 0x5582a6d54a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d2a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6cdf600 0x5582a6d54a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51184/0 (socket says 172.21.15.28:51184) 2024-04-23T18:23:43.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d2a00640 1 -- 172.21.15.28:0/924302723 learned_addr learned my addr 172.21.15.28:0/924302723 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:43.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d3400640 1 --2- 172.21.15.28:0/924302723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce4fe0 0x5582a6d55490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d2000640 1 --2- 172.21.15.28:0/924302723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6ce46c0 0x5582a6d54f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d2a00640 1 -- 172.21.15.28:0/924302723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6ce46c0 msgr2=0x5582a6d54f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:43.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/924302723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6ce46c0 0x5582a6d54f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d2a00640 1 -- 172.21.15.28:0/924302723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce4fe0 msgr2=0x5582a6d55490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:43.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/924302723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce4fe0 0x5582a6d55490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d2a00640 1 -- 172.21.15.28:0/924302723 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582a6a8ca70 con 0x5582a6cdf600 2024-04-23T18:23:43.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d3400640 1 --2- 172.21.15.28:0/924302723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce4fe0 0x5582a6d55490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:23:43.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/924302723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6cdf600 0x5582a6d54a10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4001060 tx=0x7fc4c4017800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c24268f42352a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:43.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4bea00640 1 -- 172.21.15.28:0/924302723 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4005b40 con 0x5582a6cdf600 2024-04-23T18:23:43.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4bea00640 1 -- 172.21.15.28:0/924302723 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c40263f0 con 0x5582a6cdf600 2024-04-23T18:23:43.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4bea00640 1 -- 172.21.15.28:0/924302723 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c40267a0 con 0x5582a6cdf600 2024-04-23T18:23:43.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 -- 172.21.15.28:0/924302723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6cdf600 msgr2=0x5582a6d54a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/924302723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6cdf600 0x5582a6d54a10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4001060 tx=0x7fc4c4017800 comp rx=0 tx=0).stop 2024-04-23T18:23:43.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 -- 172.21.15.28:0/924302723 shutdown_connections 2024-04-23T18:23:43.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/924302723 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6ce46c0 0x5582a6d54f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/924302723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce4fe0 0x5582a6d55490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/924302723 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6cdf600 0x5582a6d54a10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 -- 172.21.15.28:0/924302723 >> 172.21.15.28:0/924302723 conn(0x5582a6ce0470 msgr2=0x5582a6cf5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:43.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 -- 172.21.15.28:0/924302723 shutdown_connections 2024-04-23T18:23:43.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 -- 172.21.15.28:0/924302723 wait complete. 2024-04-23T18:23:43.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 -- start start 2024-04-23T18:23:43.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.455+0000 7fc4dd0db000 1 Processor -- start 2024-04-23T18:23:43.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6cdf600 0x5582a6ca7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce46c0 0x5582a6ca7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ca7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5582a6af0900 con 0x5582a6ce4fe0 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5582a6abbe60 con 0x5582a6ce46c0 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5582a6af5c20 con 0x5582a6cdf600 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 10 client.0 _ll_register_callbacks cb 0x7fc4b8003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4d3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ca7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4d3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ca7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51196/0 (socket says 172.21.15.28:51196) 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4d2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce46c0 0x5582a6ca7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4d3400640 1 -- 172.21.15.28:0/1573006538 learned_addr learned my addr 172.21.15.28:0/1573006538 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6cdf600 0x5582a6ca7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4d3400640 1 -- 172.21.15.28:0/1573006538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6cdf600 msgr2=0x5582a6ca7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4d3400640 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6cdf600 0x5582a6ca7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4d3400640 1 -- 172.21.15.28:0/1573006538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce46c0 msgr2=0x5582a6ca7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4d3400640 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce46c0 0x5582a6ca7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4d3400640 1 -- 172.21.15.28:0/1573006538 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582a6b74080 con 0x5582a6ce4fe0 2024-04-23T18:23:43.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4d3400640 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ca7fc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc084a60 tx=0x7fc4cc01f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbb39bf1aac2278 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:23:43.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:23:43.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4b3e00640 1 -- 172.21.15.28:0/1573006538 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc05ef80 con 0x5582a6ce4fe0 2024-04-23T18:23:43.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4b3e00640 1 -- 172.21.15.28:0/1573006538 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc4cc06eb80 con 0x5582a6ce4fe0 2024-04-23T18:23:43.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 1 -- 172.21.15.28:0/1573006538 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4c40263f0 con 0x5582a6ce4fe0 2024-04-23T18:23:43.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4b3e00640 1 -- 172.21.15.28:0/1573006538 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fc4cc06ed80 con 0x5582a6ce4fe0 2024-04-23T18:23:43.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 10 client.5148 fetch_fsmap learned FSMap version 15 2024-04-23T18:23:43.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 1 -- 172.21.15.28:0/1573006538 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5582a6a973e0 con 0x5582a6ce4fe0 2024-04-23T18:23:43.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4b3e00640 1 -- 172.21.15.28:0/1573006538 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c40263f0 con 0x5582a6ce4fe0 2024-04-23T18:23:43.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4b3e00640 1 -- 172.21.15.28:0/1573006538 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fc4cc005560 con 0x5582a6ce4fe0 2024-04-23T18:23:43.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 10 client.5148 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:23:43.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 10 client.5148 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:23:43.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 20 client.5148 populate_metadata read hostname 'smithi028' 2024-04-23T18:23:43.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5582a6d5ea80 0x5582a6d60e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:23:43.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 4 client.5148 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}] 2024-04-23T18:23:43.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.459+0000 7fc4dd0db000 1 -- 172.21.15.28:0/1573006538 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}) -- 0x5582a6a9a940 con 0x5582a6d5ea80 2024-04-23T18:23:43.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.463+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5582a6d5ea80 0x5582a6d60e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:23:43.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.463+0000 7fc4d2a00640 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5582a6d5ea80 0x5582a6d60e70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74671473e545052d server_cookie=dd5aab7261f49a24 in_seq=0 out_seq=0 2024-04-23T18:23:43.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.463+0000 7fc4b3e00640 10 client.5148 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:43.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4b3e00640 1 -- 172.21.15.28:0/1573006538 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x5582a6a9a940 con 0x5582a6d5ea80 2024-04-23T18:23:43.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4b3e00640 10 client.5148 handle_command_reply: tid=0 2024-04-23T18:23:43.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 1 client.5148 shutdown 2024-04-23T18:23:43.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 1 -- 172.21.15.28:0/1573006538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 msgr2=0x5582a6ca7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ca7fc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc084a60 tx=0x7fc4cc01f040 comp rx=0 tx=0).stop 2024-04-23T18:23:43.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 1 -- 172.21.15.28:0/1573006538 shutdown_connections 2024-04-23T18:23:43.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5582a6d5ea80 0x5582a6d60e70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5582a6ce4fe0 0x5582a6ca7fc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582a6ce46c0 0x5582a6ca7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4b3e00640 0 client.5148 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:23:43.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 1 --2- 172.21.15.28:0/1573006538 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5582a6cdf600 0x5582a6ca7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 1 -- 172.21.15.28:0/1573006538 >> 172.21.15.28:0/1573006538 conn(0x5582a6ce0470 msgr2=0x5582a6cff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:43.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 1 -- 172.21.15.28:0/1573006538 shutdown_connections 2024-04-23T18:23:43.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 1 -- 172.21.15.28:0/1573006538 wait complete. 2024-04-23T18:23:43.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4dd0db000 20 client.5148 trim_cache size 0 max 16384 2024-04-23T18:23:43.466 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 15, 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "leader": 4297, 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "set_version": 2, 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "sets": { 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "eb1a5668": { 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "version": 2, 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "age_ref": 0.0, 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "QUIESCED", 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "timeout": 60.0, 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "expiration": 79.5, 2024-04-23T18:23:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "members": { 2024-04-23T18:23:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "file:/": { 2024-04-23T18:23:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "excluded": false, 2024-04-23T18:23:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:23:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "QUIESCED", 2024-04-23T18:23:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:23:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:23:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:23:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:23:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:23:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:23:43.468 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:23:43.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 -- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc4b4068380 msgr2=0x7fc4b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc4b4068380 0x7fc4b406a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00af000 tx=0x7fc4c00046d0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 -- 172.21.15.28:0/80535825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4d41f4570 msgr2=0x7fc4d41f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:23:43.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4d41f4570 0x7fc4d41f6ee0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40c7b70 tx=0x7fc4cc00e9e0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 -- 172.21.15.28:0/80535825 shutdown_connections 2024-04-23T18:23:43.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc4b4068380 0x7fc4b406a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4d4151900 0x7fc4d41f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc4d41f4570 0x7fc4d41f6ee0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 --2- 172.21.15.28:0/80535825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b8004810 0x7fc4d40ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:23:43.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 -- 172.21.15.28:0/80535825 >> 172.21.15.28:0/80535825 conn(0x7fc4d4072f30 msgr2=0x7fc4d40c9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:23:43.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 -- 172.21.15.28:0/80535825 shutdown_connections 2024-04-23T18:23:43.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:23:43.471+0000 7fc4d9c00640 1 -- 172.21.15.28:0/80535825 wait complete. 2024-04-23T18:23:43.485 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'eb1a5668', quiesce took 0.7 seconds. Will release after: 19.5 2024-04-23T18:23:57.951 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:23:57.956 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:24:02.986 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:24:03.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.222+0000 7f1aa5400640 1 Processor -- start 2024-04-23T18:24:03.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.222+0000 7f1aa5400640 1 -- start start 2024-04-23T18:24:03.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1aa5400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1aa00ca640 0x7f1aa00ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1aa5400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa0071210 con 0x7f1aa0158df0 2024-04-23T18:24:03.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1aa5400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa015c510 con 0x7f1aa0152f30 2024-04-23T18:24:03.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1aa5400640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa015c840 con 0x7f1aa00ca640 2024-04-23T18:24:03.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1a9f400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1aa00ca640 0x7f1aa00ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1a9fe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1aa0152f30 0x7f1aa015ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:46938/0 (socket says 172.21.15.28:46938) 2024-04-23T18:24:03.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1a9fe00640 1 -- 172.21.15.28:0/2163989131 learned_addr learned my addr 172.21.15.28:0/2163989131 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:24:03.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1aa4a00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1aa0158df0 0x7f1aa0163770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48610/0 (socket says 172.21.15.28:48610) 2024-04-23T18:24:03.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1a9ea00640 1 -- 172.21.15.28:0/2163989131 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3442652537 0 0) 0x7f1aa015c510 con 0x7f1aa0152f30 2024-04-23T18:24:03.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1a9f400640 1 -- 172.21.15.28:0/2163989131 >> v1:172.21.15.137:6789/0 conn(0x7f1aa0152f30 legacy=0x7f1aa015ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1a9f400640 1 -- 172.21.15.28:0/2163989131 >> v1:172.21.15.28:6789/0 conn(0x7f1aa0158df0 legacy=0x7f1aa0163770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.226+0000 7f1a9f400640 1 -- 172.21.15.28:0/2163989131 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa00ca340 con 0x7f1aa00ca640 2024-04-23T18:24:03.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.230+0000 7f1a9f400640 1 --2- 172.21.15.28:0/2163989131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa00ca640 0x7f1aa00ce5a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0097c0 tx=0x7f1a8c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42170436e206818 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:03.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.230+0000 7f1a9ea00640 1 -- 172.21.15.28:0/2163989131 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0b1070 con 0x7f1aa00ca640 2024-04-23T18:24:03.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.230+0000 7f1a9ea00640 1 -- 172.21.15.28:0/2163989131 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c0ac410 con 0x7f1aa00ca640 2024-04-23T18:24:03.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.230+0000 7f1a9ea00640 1 -- 172.21.15.28:0/2163989131 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0ac7e0 con 0x7f1aa00ca640 2024-04-23T18:24:03.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.230+0000 7f1aa5400640 1 -- 172.21.15.28:0/2163989131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa00ca640 msgr2=0x7f1aa00ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.230+0000 7f1aa5400640 1 --2- 172.21.15.28:0/2163989131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa00ca640 0x7f1aa00ce5a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0097c0 tx=0x7f1a8c01c4c0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.230+0000 7f1aa5400640 1 -- 172.21.15.28:0/2163989131 shutdown_connections 2024-04-23T18:24:03.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.230+0000 7f1aa5400640 1 --2- 172.21.15.28:0/2163989131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa00ca640 0x7f1aa00ce5a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.230+0000 7f1aa5400640 1 -- 172.21.15.28:0/2163989131 >> 172.21.15.28:0/2163989131 conn(0x7f1aa0075e30 msgr2=0x7f1aa00676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:03.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.230+0000 7f1aa5400640 1 -- 172.21.15.28:0/2163989131 shutdown_connections 2024-04-23T18:24:03.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.230+0000 7f1aa5400640 1 -- 172.21.15.28:0/2163989131 wait complete. 2024-04-23T18:24:03.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.234+0000 7f1aa5400640 1 Processor -- start 2024-04-23T18:24:03.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.234+0000 7f1aa5400640 1 -- start start 2024-04-23T18:24:03.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.234+0000 7f1aa5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa00ca640 0x7f1aa006d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.234+0000 7f1aa5400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa0152f30 0x7f1aa01610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.234+0000 7f1aa5400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1aa0158df0 0x7f1aa006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1aa5400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa00ceae0 con 0x7f1aa0152f30 2024-04-23T18:24:03.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1aa5400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa00ca0f0 con 0x7f1aa00ca640 2024-04-23T18:24:03.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1aa5400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa00cec60 con 0x7f1aa0158df0 2024-04-23T18:24:03.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a9f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa0152f30 0x7f1aa01610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a9f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa0152f30 0x7f1aa01610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57884/0 (socket says 172.21.15.28:57884) 2024-04-23T18:24:03.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a9f400640 1 -- 172.21.15.28:0/4246284820 learned_addr learned my addr 172.21.15.28:0/4246284820 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:03.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a9fe00640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa00ca640 0x7f1aa006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1aa4a00640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1aa0158df0 0x7f1aa006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a9f400640 1 -- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1aa0158df0 msgr2=0x7f1aa006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a9f400640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1aa0158df0 0x7f1aa006c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a9f400640 1 -- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa00ca640 msgr2=0x7f1aa006d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a9f400640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa00ca640 0x7f1aa006d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a9f400640 1 -- 172.21.15.28:0/4246284820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa006ca90 con 0x7f1aa0152f30 2024-04-23T18:24:03.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a9f400640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa0152f30 0x7f1aa01610e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0190d0 tx=0x7f1a8c019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:03.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a97e00640 1 -- 172.21.15.28:0/4246284820 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0b1040 con 0x7f1aa0152f30 2024-04-23T18:24:03.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a97e00640 1 -- 172.21.15.28:0/4246284820 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c0bb070 con 0x7f1aa0152f30 2024-04-23T18:24:03.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1a97e00640 1 -- 172.21.15.28:0/4246284820 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0b5630 con 0x7f1aa0152f30 2024-04-23T18:24:03.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1aa5400640 1 -- 172.21.15.28:0/4246284820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa015ab60 con 0x7f1aa0152f30 2024-04-23T18:24:03.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1aa5400640 1 -- 172.21.15.28:0/4246284820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa015b120 con 0x7f1aa0152f30 2024-04-23T18:24:03.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.238+0000 7f1aa5400640 1 -- 172.21.15.28:0/4246284820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa0068cd0 con 0x7f1aa0152f30 2024-04-23T18:24:03.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.242+0000 7f1a97e00640 1 -- 172.21.15.28:0/4246284820 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a8c0b57d0 con 0x7f1aa0152f30 2024-04-23T18:24:03.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.242+0000 7f1a97e00640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a800683d0 0x7f1a8006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.242+0000 7f1a97e00640 1 -- 172.21.15.28:0/4246284820 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1a8c120700 con 0x7f1aa0152f30 2024-04-23T18:24:03.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.242+0000 7f1a9fe00640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a800683d0 0x7f1a8006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.246+0000 7f1a9fe00640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a800683d0 0x7f1a8006a890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a90000f70 tx=0x7f1a90007240 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:03.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.254+0000 7f1a97e00640 1 -- 172.21.15.28:0/4246284820 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a8c0160b0 con 0x7f1aa0152f30 2024-04-23T18:24:03.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.658+0000 7f1aa5400640 1 -- 172.21.15.28:0/4246284820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1aa01583d0 con 0x7f1aa0152f30 2024-04-23T18:24:03.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.658+0000 7f1a97e00640 1 -- 172.21.15.28:0/4246284820 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f1a8c0f01c0 con 0x7f1aa0152f30 2024-04-23T18:24:03.654 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:24:03.654 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:24:03.654 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 -- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a800683d0 msgr2=0x7f1a8006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a800683d0 0x7f1a8006a890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a90000f70 tx=0x7f1a90007240 comp rx=0 tx=0).stop 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 -- 172.21.15.28:0/4246284820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa0152f30 msgr2=0x7f1aa01610e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa0152f30 0x7f1aa01610e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0190d0 tx=0x7f1a8c019260 comp rx=0 tx=0).stop 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 -- 172.21.15.28:0/4246284820 shutdown_connections 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1a800683d0 0x7f1a8006a890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1aa0158df0 0x7f1aa006c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa0152f30 0x7f1aa01610e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 --2- 172.21.15.28:0/4246284820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa00ca640 0x7f1aa006d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 -- 172.21.15.28:0/4246284820 >> 172.21.15.28:0/4246284820 conn(0x7f1aa0075e30 msgr2=0x7f1aa00cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 -- 172.21.15.28:0/4246284820 shutdown_connections 2024-04-23T18:24:03.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.662+0000 7f1aa5400640 1 -- 172.21.15.28:0/4246284820 wait complete. 2024-04-23T18:24:03.687 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4297 quiesce db --set-id eb1a5668 --release --await' 2024-04-23T18:24:03.687 DEBUG:teuthology.orchestra.run.smithi028:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4297 quiesce db --set-id eb1a5668 --release --await 2024-04-23T18:24:03.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.938+0000 7f626ee00640 1 Processor -- start 2024-04-23T18:24:03.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.938+0000 7f626ee00640 1 -- start start 2024-04-23T18:24:03.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.938+0000 7f626ee00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f62681551d0 0x7f6268070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.938+0000 7f626ee00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62680711f0 0x7f626815b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.938+0000 7f626ee00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626815af90 con 0x7f626815e580 2024-04-23T18:24:03.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.938+0000 7f626ee00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f62680c9a00 con 0x7f62680711f0 2024-04-23T18:24:03.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.938+0000 7f626ee00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f626815eac0 con 0x7f62681551d0 2024-04-23T18:24:03.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.938+0000 7f626d000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62680711f0 0x7f626815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.938+0000 7f626d000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62680711f0 0x7f626815b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57892/0 (socket says 172.21.15.28:57892) 2024-04-23T18:24:03.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.938+0000 7f626d000640 1 -- 172.21.15.28:0/2442491727 learned_addr learned my addr 172.21.15.28:0/2442491727 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:03.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.938+0000 7f626da00640 1 --2- 172.21.15.28:0/2442491727 >> v2:172.21.15.137:3300/0 conn(0x7f62681551d0 0x7f6268070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.942+0000 7f626d000640 1 -- 172.21.15.28:0/2442491727 >> v2:172.21.15.137:3300/0 conn(0x7f62681551d0 msgr2=0x7f6268070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:03.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.942+0000 7f626d000640 1 --2- 172.21.15.28:0/2442491727 >> v2:172.21.15.137:3300/0 conn(0x7f62681551d0 0x7f6268070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.942+0000 7f626d000640 1 -- 172.21.15.28:0/2442491727 >> v1:172.21.15.137:6789/0 conn(0x7f626815e580 legacy=0x7f62680cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.942+0000 7f626d000640 1 -- 172.21.15.28:0/2442491727 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626815ed80 con 0x7f62680711f0 2024-04-23T18:24:03.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f626d000640 1 --2- 172.21.15.28:0/2442491727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62680711f0 0x7f626815b730 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6268070ab0 tx=0x7f625401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758deda69ba4a674 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:03.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f6267e00640 1 -- 172.21.15.28:0/2442491727 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540b5070 con 0x7f62680711f0 2024-04-23T18:24:03.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f6267e00640 1 -- 172.21.15.28:0/2442491727 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62540a8a10 con 0x7f62680711f0 2024-04-23T18:24:03.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f6267e00640 1 -- 172.21.15.28:0/2442491727 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540a8de0 con 0x7f62680711f0 2024-04-23T18:24:03.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f626ee00640 1 -- 172.21.15.28:0/2442491727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62680711f0 msgr2=0x7f626815b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f626ee00640 1 --2- 172.21.15.28:0/2442491727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62680711f0 0x7f626815b730 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6268070ab0 tx=0x7f625401ed30 comp rx=0 tx=0).stop 2024-04-23T18:24:03.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f626ee00640 1 -- 172.21.15.28:0/2442491727 shutdown_connections 2024-04-23T18:24:03.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f626ee00640 1 --2- 172.21.15.28:0/2442491727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62680711f0 0x7f626815b730 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f626ee00640 1 --2- 172.21.15.28:0/2442491727 >> v2:172.21.15.137:3300/0 conn(0x7f62681551d0 0x7f6268070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f626ee00640 1 -- 172.21.15.28:0/2442491727 >> 172.21.15.28:0/2442491727 conn(0x7f62680678b0 msgr2=0x7f6268067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:03.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f626ee00640 1 -- 172.21.15.28:0/2442491727 shutdown_connections 2024-04-23T18:24:03.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.946+0000 7f626ee00640 1 -- 172.21.15.28:0/2442491727 wait complete. 2024-04-23T18:24:03.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626ee00640 1 Processor -- start 2024-04-23T18:24:03.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626ee00640 1 -- start start 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62681551d0 0x7f62681f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f626815e580 0x7f62681528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626ee00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f626815c590 0x7f6268152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626ee00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f626815b210 con 0x7f626815c590 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f626815f340 con 0x7f626815e580 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f626806c480 con 0x7f62681551d0 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626e400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f626815c590 0x7f6268152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f626815e580 0x7f62681528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f626815e580 0x7f62681528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42372/0 (socket says 172.21.15.28:42372) 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626e400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f626815c590 0x7f6268152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57896/0 (socket says 172.21.15.28:57896) 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626d000640 1 -- 172.21.15.28:0/1632224225 learned_addr learned my addr 172.21.15.28:0/1632224225 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:03.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.950+0000 7f626da00640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62681551d0 0x7f62681f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f626d000640 1 -- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62681551d0 msgr2=0x7f62681f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f626d000640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62681551d0 0x7f62681f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f626d000640 1 -- 172.21.15.28:0/1632224225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f626815c590 msgr2=0x7f6268152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f626d000640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f626815c590 0x7f6268152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f626d000640 1 -- 172.21.15.28:0/1632224225 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626815c360 con 0x7f626815e580 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f626da00640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62681551d0 0x7f62681f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f626e400640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f626815c590 0x7f6268152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f626d000640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f626815e580 0x7f62681528d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f625409b530 tx=0x7f625401bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f6265600640 1 -- 172.21.15.28:0/1632224225 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540c0070 con 0x7f626815e580 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f6265600640 1 -- 172.21.15.28:0/1632224225 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6254004250 con 0x7f626815e580 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f626ee00640 1 -- 172.21.15.28:0/1632224225 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62681f11f0 con 0x7f626815e580 2024-04-23T18:24:03.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f6265600640 1 -- 172.21.15.28:0/1632224225 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540b5070 con 0x7f626815e580 2024-04-23T18:24:03.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.954+0000 7f626ee00640 1 -- 172.21.15.28:0/1632224225 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62681f1770 con 0x7f626815e580 2024-04-23T18:24:03.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.958+0000 7f6265600640 1 -- 172.21.15.28:0/1632224225 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f62540c3070 con 0x7f626815e580 2024-04-23T18:24:03.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.958+0000 7f62737ea000 1 Processor -- start 2024-04-23T18:24:03.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.958+0000 7f62737ea000 1 -- start start 2024-04-23T18:24:03.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.958+0000 7f6265600640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62480683b0 0x7f624806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.958+0000 7f6265600640 1 -- 172.21.15.28:0/1632224225 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6254123f80 con 0x7f626815e580 2024-04-23T18:24:03.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.958+0000 7f626e400640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62480683b0 0x7f624806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 0x55b649e8a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649e8af00 0x55b649e8b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649ec6120 0x55b649ec6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55b649cd2660 con 0x55b649ec18a0 2024-04-23T18:24:03.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b649c775d0 con 0x55b649ec6120 2024-04-23T18:24:03.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55b649cce620 con 0x55b649e8af00 2024-04-23T18:24:03.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626da00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 0x55b649e8a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626da00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 0x55b649e8a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57900/0 (socket says 172.21.15.28:57900) 2024-04-23T18:24:03.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626da00640 1 -- 172.21.15.28:0/2823762233 learned_addr learned my addr 172.21.15.28:0/2823762233 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:03.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626e400640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62480683b0 0x7f624806a870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6260002170 tx=0x7f6260009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:03.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626e400640 1 --2- 172.21.15.28:0/2823762233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649ec6120 0x55b649ec6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626d000640 1 --2- 172.21.15.28:0/2823762233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649e8af00 0x55b649e8b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626da00640 1 -- 172.21.15.28:0/2823762233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649e8af00 msgr2=0x55b649e8b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:03.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626da00640 1 --2- 172.21.15.28:0/2823762233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649e8af00 0x55b649e8b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626da00640 1 -- 172.21.15.28:0/2823762233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649ec6120 msgr2=0x55b649ec6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:03.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626da00640 1 --2- 172.21.15.28:0/2823762233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649ec6120 0x55b649ec6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626da00640 1 -- 172.21.15.28:0/2823762233 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b649cabbd0 con 0x55b649ec18a0 2024-04-23T18:24:03.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f626da00640 1 --2- 172.21.15.28:0/2823762233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 0x55b649e8a9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f625c011340 tx=0x7f625c011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3ff7c1504967ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:03.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f625a000640 1 -- 172.21.15.28:0/2823762233 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c004020 con 0x55b649ec18a0 2024-04-23T18:24:03.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f625a000640 1 -- 172.21.15.28:0/2823762233 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625c0041c0 con 0x55b649ec18a0 2024-04-23T18:24:03.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f625a000640 1 -- 172.21.15.28:0/2823762233 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c013670 con 0x55b649ec18a0 2024-04-23T18:24:03.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 -- 172.21.15.28:0/2823762233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 msgr2=0x55b649e8a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 --2- 172.21.15.28:0/2823762233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 0x55b649e8a9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f625c011340 tx=0x7f625c011800 comp rx=0 tx=0).stop 2024-04-23T18:24:03.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 -- 172.21.15.28:0/2823762233 shutdown_connections 2024-04-23T18:24:03.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 --2- 172.21.15.28:0/2823762233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649e8af00 0x55b649e8b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 --2- 172.21.15.28:0/2823762233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649ec6120 0x55b649ec6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 --2- 172.21.15.28:0/2823762233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 0x55b649e8a9c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 -- 172.21.15.28:0/2823762233 >> 172.21.15.28:0/2823762233 conn(0x55b649d6cb00 msgr2=0x55b649ec3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:03.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 -- 172.21.15.28:0/2823762233 shutdown_connections 2024-04-23T18:24:03.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.962+0000 7f62737ea000 1 -- 172.21.15.28:0/2823762233 wait complete. 2024-04-23T18:24:03.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f62737ea000 1 -- start start 2024-04-23T18:24:03.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f62737ea000 1 Processor -- start 2024-04-23T18:24:03.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f62737ea000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649ec0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f62737ea000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 0x55b649ec0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f62737ea000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec6120 0x55b649e85900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f62737ea000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55b649d8fd40 con 0x55b649ec18a0 2024-04-23T18:24:03.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f62737ea000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b649c8ceb0 con 0x55b649e8af00 2024-04-23T18:24:03.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f62737ea000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55b649ccd2a0 con 0x55b649ec6120 2024-04-23T18:24:03.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f62737ea000 10 client.0 _ll_register_callbacks cb 0x55b649e70a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:24:03.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f626e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec6120 0x55b649e85900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f626d000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 0x55b649ec0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f626e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec6120 0x55b649e85900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:43622/0 (socket says 172.21.15.28:43622) 2024-04-23T18:24:03.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f626e400640 1 -- 172.21.15.28:0/1671700771 learned_addr learned my addr 172.21.15.28:0/1671700771 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:03.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f626da00640 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649ec0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f626d000640 1 -- 172.21.15.28:0/1671700771 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec6120 msgr2=0x55b649e85900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:03.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f626d000640 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec6120 0x55b649e85900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f626d000640 1 -- 172.21.15.28:0/1671700771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 msgr2=0x55b649ec0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:03.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f626d000640 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649ec0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f626d000640 1 -- 172.21.15.28:0/1671700771 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b649d18b30 con 0x55b649ec18a0 2024-04-23T18:24:03.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f626d000640 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 0x55b649ec0b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6254122010 tx=0x7f6254009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38becc8e09d4888d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:03.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f624ea00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:24:03.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.966+0000 7f624ea00640 1 -- 172.21.15.28:0/1671700771 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540f8e60 con 0x55b649ec18a0 2024-04-23T18:24:03.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f624ea00640 1 -- 172.21.15.28:0/1671700771 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f62540fc070 con 0x55b649ec18a0 2024-04-23T18:24:03.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f62737ea000 1 -- 172.21.15.28:0/1671700771 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b649c6c060 con 0x55b649ec18a0 2024-04-23T18:24:03.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f624ea00640 1 -- 172.21.15.28:0/1671700771 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f62540fc500 con 0x55b649ec18a0 2024-04-23T18:24:03.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f62737ea000 10 client.5169 fetch_fsmap learned FSMap version 15 2024-04-23T18:24:03.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f62737ea000 1 -- 172.21.15.28:0/1671700771 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55b649c71b70 con 0x55b649ec18a0 2024-04-23T18:24:03.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f624ea00640 1 -- 172.21.15.28:0/1671700771 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b649c6c060 con 0x55b649ec18a0 2024-04-23T18:24:03.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f624ea00640 1 -- 172.21.15.28:0/1671700771 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f62540f2e20 con 0x55b649ec18a0 2024-04-23T18:24:03.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f62737ea000 10 client.5169 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:24:03.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f62737ea000 10 client.5169 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:24:03.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f62737ea000 20 client.5169 populate_metadata read hostname 'smithi028' 2024-04-23T18:24:03.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f62737ea000 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55b649e86670 0x55b649e86a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:03.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f62737ea000 4 client.5169 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:24:03.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f62737ea000 1 -- 172.21.15.28:0/1671700771 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b649caae30 con 0x55b649e86670 2024-04-23T18:24:03.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f626da00640 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55b649e86670 0x55b649e86a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:03.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f626da00640 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55b649e86670 0x55b649e86a50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=365a1d2452f6d51a server_cookie=56bdc56daee3bb5f in_seq=0 out_seq=0 2024-04-23T18:24:03.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f624ea00640 10 client.5169 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:03.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f624ea00640 1 -- 172.21.15.28:0/1671700771 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b649caae30 con 0x55b649e86670 2024-04-23T18:24:03.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.970+0000 7f624ea00640 10 client.5169 handle_command_reply: tid=0 2024-04-23T18:24:03.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 1 client.5169 shutdown 2024-04-23T18:24:03.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 1 -- 172.21.15.28:0/1671700771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 msgr2=0x55b649ec0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:03.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 0x55b649ec0b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6254122010 tx=0x7f6254009490 comp rx=0 tx=0).stop 2024-04-23T18:24:03.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 1 -- 172.21.15.28:0/1671700771 shutdown_connections 2024-04-23T18:24:03.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55b649e86670 0x55b649e86a50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec6120 0x55b649e85900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec18a0 0x55b649ec0b90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 1 --2- 172.21.15.28:0/1671700771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649ec0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:03.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 1 -- 172.21.15.28:0/1671700771 >> 172.21.15.28:0/1671700771 conn(0x55b649d6cb00 msgr2=0x55b649ec59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:03.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f624ea00640 0 client.5169 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:03.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 1 -- 172.21.15.28:0/1671700771 shutdown_connections 2024-04-23T18:24:03.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 1 -- 172.21.15.28:0/1671700771 wait complete. 2024-04-23T18:24:03.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:03.974+0000 7f62737ea000 20 client.5169 trim_cache size 0 max 16384 2024-04-23T18:24:04.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.006+0000 7f62737ea000 1 Processor -- start 2024-04-23T18:24:04.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.006+0000 7f62737ea000 1 -- start start 2024-04-23T18:24:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f62737ea000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649e85480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f62737ea000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec18a0 0x55b649e859c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f62737ea000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649edcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f62737ea000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f62681fe0b0 con 0x55b649ec6120 2024-04-23T18:24:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f62737ea000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f62681fd3f0 con 0x55b649e8af00 2024-04-23T18:24:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f62737ea000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f62681fda40 con 0x55b649ec18a0 2024-04-23T18:24:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f626e400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649edcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f626e400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649edcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57926/0 (socket says 172.21.15.28:57926) 2024-04-23T18:24:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f626e400640 1 -- 172.21.15.28:0/898345015 learned_addr learned my addr 172.21.15.28:0/898345015 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:04.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f626da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649e85480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f626d000640 1 --2- 172.21.15.28:0/898345015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec18a0 0x55b649e859c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f626e400640 1 -- 172.21.15.28:0/898345015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec18a0 msgr2=0x55b649e859c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f626e400640 1 --2- 172.21.15.28:0/898345015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec18a0 0x55b649e859c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f626e400640 1 -- 172.21.15.28:0/898345015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 msgr2=0x55b649e85480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f626e400640 1 --2- 172.21.15.28:0/898345015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649e85480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f626e400640 1 -- 172.21.15.28:0/898345015 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b649d545e0 con 0x55b649ec6120 2024-04-23T18:24:04.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f626e400640 1 --2- 172.21.15.28:0/898345015 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649edcb10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f62600146c0 tx=0x7f6260012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af552c034427448d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f6259600640 1 -- 172.21.15.28:0/898345015 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260013780 con 0x55b649ec6120 2024-04-23T18:24:04.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f6259600640 1 -- 172.21.15.28:0/898345015 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626001b040 con 0x55b649ec6120 2024-04-23T18:24:04.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f6259600640 1 -- 172.21.15.28:0/898345015 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260013b20 con 0x55b649ec6120 2024-04-23T18:24:04.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f62737ea000 1 -- 172.21.15.28:0/898345015 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 msgr2=0x55b649edcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.010+0000 7f62737ea000 1 --2- 172.21.15.28:0/898345015 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649edcb10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f62600146c0 tx=0x7f6260012000 comp rx=0 tx=0).stop 2024-04-23T18:24:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 -- 172.21.15.28:0/898345015 shutdown_connections 2024-04-23T18:24:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 --2- 172.21.15.28:0/898345015 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec18a0 0x55b649e859c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 --2- 172.21.15.28:0/898345015 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649edcb10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 --2- 172.21.15.28:0/898345015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649e85480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 -- 172.21.15.28:0/898345015 >> 172.21.15.28:0/898345015 conn(0x55b649d6cb00 msgr2=0x55b649e88680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 -- 172.21.15.28:0/898345015 shutdown_connections 2024-04-23T18:24:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 -- 172.21.15.28:0/898345015 wait complete. 2024-04-23T18:24:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 -- start start 2024-04-23T18:24:04.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 Processor -- start 2024-04-23T18:24:04.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649edf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec18a0 0x55b649edfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649ee0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55b649cd1970 con 0x55b649ec6120 2024-04-23T18:24:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b649c878f0 con 0x55b649e8af00 2024-04-23T18:24:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55b649cd6c90 con 0x55b649ec18a0 2024-04-23T18:24:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f62737ea000 10 client.0 _ll_register_callbacks cb 0x7f62540f37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:24:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f626e400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649ee0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f626e400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649ee0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57940/0 (socket says 172.21.15.28:57940) 2024-04-23T18:24:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f626e400640 1 -- 172.21.15.28:0/1195872115 learned_addr learned my addr 172.21.15.28:0/1195872115 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f626da00640 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649edf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.014+0000 7f626d000640 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec18a0 0x55b649edfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f626e400640 1 -- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec18a0 msgr2=0x55b649edfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f626e400640 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec18a0 0x55b649edfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f626e400640 1 -- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 msgr2=0x55b649edf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f626e400640 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649edf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f626e400640 1 -- 172.21.15.28:0/1195872115 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b649c64ae0 con 0x55b649ec6120 2024-04-23T18:24:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f626da00640 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649edf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:24:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f626e400640 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649ee0220 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f626000fa30 tx=0x7f6260001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667e36333639751e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f624ea00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:24:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f624ea00640 1 -- 172.21.15.28:0/1195872115 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260023860 con 0x55b649ec6120 2024-04-23T18:24:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f624ea00640 1 -- 172.21.15.28:0/1195872115 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6260023a00 con 0x55b649ec6120 2024-04-23T18:24:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f62737ea000 1 -- 172.21.15.28:0/1195872115 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f626001b040 con 0x55b649ec6120 2024-04-23T18:24:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f624ea00640 1 -- 172.21.15.28:0/1195872115 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f6260042050 con 0x55b649ec6120 2024-04-23T18:24:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f62737ea000 10 client.5175 fetch_fsmap learned FSMap version 15 2024-04-23T18:24:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f62737ea000 1 -- 172.21.15.28:0/1195872115 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55b649c67d80 con 0x55b649ec6120 2024-04-23T18:24:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f624ea00640 1 -- 172.21.15.28:0/1195872115 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626001b040 con 0x55b649ec6120 2024-04-23T18:24:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f624ea00640 1 -- 172.21.15.28:0/1195872115 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f6260045020 con 0x55b649ec6120 2024-04-23T18:24:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f62737ea000 10 client.5175 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:24:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f62737ea000 10 client.5175 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:24:04.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f62737ea000 20 client.5175 populate_metadata read hostname 'smithi028' 2024-04-23T18:24:04.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f62737ea000 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55b649ee0760 0x55b649ee0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f62737ea000 4 client.5175 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "eb1a5668", "release": true, "await": true}] 2024-04-23T18:24:04.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f62737ea000 1 -- 172.21.15.28:0/1195872115 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "quiesce db", "set_id": "eb1a5668", "release": true, "await": true}) -- 0x55b649c700d0 con 0x55b649ee0760 2024-04-23T18:24:04.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f626da00640 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55b649ee0760 0x55b649ee0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f626da00640 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55b649ee0760 0x55b649ee0b70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed73d20367f64537 server_cookie=2d27d4c36f643ca1 in_seq=0 out_seq=0 2024-04-23T18:24:04.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.018+0000 7f624ea00640 10 client.5175 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:04.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f624ea00640 1 -- 172.21.15.28:0/1195872115 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55b649c700d0 con 0x55b649ee0760 2024-04-23T18:24:04.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f624ea00640 10 client.5175 handle_command_reply: tid=0 2024-04-23T18:24:04.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 1 client.5175 shutdown 2024-04-23T18:24:04.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 1 -- 172.21.15.28:0/1195872115 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 msgr2=0x55b649ee0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649ee0220 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f626000fa30 tx=0x7f6260001260 comp rx=0 tx=0).stop 2024-04-23T18:24:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 1 -- 172.21.15.28:0/1195872115 shutdown_connections 2024-04-23T18:24:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55b649ee0760 0x55b649ee0b70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b649ec18a0 0x55b649edfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b649ec6120 0x55b649ee0220 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 1 --2- 172.21.15.28:0/1195872115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b649e8af00 0x55b649edf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f624ea00640 0 client.5175 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 1 -- 172.21.15.28:0/1195872115 >> 172.21.15.28:0/1195872115 conn(0x55b649d6cb00 msgr2=0x55b649e85690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 1 -- 172.21.15.28:0/1195872115 shutdown_connections 2024-04-23T18:24:04.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 1 -- 172.21.15.28:0/1195872115 wait complete. 2024-04-23T18:24:04.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f62737ea000 20 client.5175 trim_cache size 0 max 16384 2024-04-23T18:24:04.019 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:24:04.019 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 15, 2024-04-23T18:24:04.019 INFO:teuthology.orchestra.run.smithi028.stdout: "leader": 4297, 2024-04-23T18:24:04.019 INFO:teuthology.orchestra.run.smithi028.stdout: "set_version": 4, 2024-04-23T18:24:04.019 INFO:teuthology.orchestra.run.smithi028.stdout: "sets": { 2024-04-23T18:24:04.019 INFO:teuthology.orchestra.run.smithi028.stdout: "eb1a5668": { 2024-04-23T18:24:04.019 INFO:teuthology.orchestra.run.smithi028.stdout: "version": 4, 2024-04-23T18:24:04.019 INFO:teuthology.orchestra.run.smithi028.stdout: "age_ref": 0.0, 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RELEASED", 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: "timeout": 60.0, 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: "expiration": 79.5, 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: "members": { 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: "file:/": { 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: "excluded": false, 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RELEASED", 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:04.020 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:04.021 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:04.021 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:04.021 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:24:04.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 -- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62480683b0 msgr2=0x7f624806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62480683b0 0x7f624806a870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6260002170 tx=0x7f6260009040 comp rx=0 tx=0).stop 2024-04-23T18:24:04.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 -- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f626815e580 msgr2=0x7f62681528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f626815e580 0x7f62681528d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f625409b530 tx=0x7f625401bad0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 -- 172.21.15.28:0/1632224225 shutdown_connections 2024-04-23T18:24:04.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62480683b0 0x7f624806a870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f626815c590 0x7f6268152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f626815e580 0x7f62681528d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 --2- 172.21.15.28:0/1632224225 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62681551d0 0x7f62681f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 -- 172.21.15.28:0/1632224225 >> 172.21.15.28:0/1632224225 conn(0x7f62680678b0 msgr2=0x7f6268143f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:04.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 -- 172.21.15.28:0/1632224225 shutdown_connections 2024-04-23T18:24:04.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.022+0000 7f626ee00640 1 -- 172.21.15.28:0/1632224225 wait complete. 2024-04-23T18:24:04.043 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'eb1a5668', seconds elapsed: 21.3 2024-04-23T18:24:04.044 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.5 2024-04-23T18:24:04.044 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:24:04.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd5a0c00640 1 Processor -- start 2024-04-23T18:24:04.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd5a0c00640 1 -- start start 2024-04-23T18:24:04.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd5a0c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd59c0c8710 0x7fd59c067bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd5a0c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd59c0c78c0 0x7fd59c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd5a0c00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59c0c6e20 con 0x7fd59c0c8330 2024-04-23T18:24:04.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd5a0c00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fd59c0c69a0 con 0x7fd59c0c8710 2024-04-23T18:24:04.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd5a0c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd59c0c5160 con 0x7fd59c0c78c0 2024-04-23T18:24:04.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd59b400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd59c0c8330 0x7fd59c158e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48612/0 (socket says 172.21.15.28:48612) 2024-04-23T18:24:04.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd59b400640 1 -- 172.21.15.28:0/1914278560 learned_addr learned my addr 172.21.15.28:0/1914278560 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:24:04.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd59aa00640 1 --2- 172.21.15.28:0/1914278560 >> v2:172.21.15.28:3300/0 conn(0x7fd59c0c8710 0x7fd59c067bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd59be00640 1 --2- 172.21.15.28:0/1914278560 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd59c0c78c0 0x7fd59c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd59aa00640 1 -- 172.21.15.28:0/1914278560 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd59c0c78c0 msgr2=0x7fd59c152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd59aa00640 1 --2- 172.21.15.28:0/1914278560 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd59c0c78c0 0x7fd59c152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd59aa00640 1 -- 172.21.15.28:0/1914278560 >> v1:172.21.15.28:6789/0 conn(0x7fd59c0c8330 legacy=0x7fd59c158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.194+0000 7fd59aa00640 1 -- 172.21.15.28:0/1914278560 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c0c5440 con 0x7fd59c0c8710 2024-04-23T18:24:04.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd59aa00640 1 --2- 172.21.15.28:0/1914278560 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd59c0c8710 0x7fd59c067bc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd5880097c0 tx=0x7fd58801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9ff61fad330668 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd59a000640 1 -- 172.21.15.28:0/1914278560 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5880b5070 con 0x7fd59c0c8710 2024-04-23T18:24:04.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd59a000640 1 -- 172.21.15.28:0/1914278560 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5880a8990 con 0x7fd59c0c8710 2024-04-23T18:24:04.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd59a000640 1 -- 172.21.15.28:0/1914278560 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5880a8d60 con 0x7fd59c0c8710 2024-04-23T18:24:04.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd5a0c00640 1 -- 172.21.15.28:0/1914278560 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd59c0c8710 msgr2=0x7fd59c067bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd5a0c00640 1 --2- 172.21.15.28:0/1914278560 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd59c0c8710 0x7fd59c067bc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd5880097c0 tx=0x7fd58801ec90 comp rx=0 tx=0).stop 2024-04-23T18:24:04.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd5a0c00640 1 -- 172.21.15.28:0/1914278560 shutdown_connections 2024-04-23T18:24:04.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd5a0c00640 1 --2- 172.21.15.28:0/1914278560 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd59c0c78c0 0x7fd59c152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd5a0c00640 1 --2- 172.21.15.28:0/1914278560 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd59c0c8710 0x7fd59c067bc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd5a0c00640 1 -- 172.21.15.28:0/1914278560 >> 172.21.15.28:0/1914278560 conn(0x7fd59c06e310 msgr2=0x7fd59c06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:04.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd5a0c00640 1 -- 172.21.15.28:0/1914278560 shutdown_connections 2024-04-23T18:24:04.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd5a0c00640 1 -- 172.21.15.28:0/1914278560 wait complete. 2024-04-23T18:24:04.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd5a0c00640 1 Processor -- start 2024-04-23T18:24:04.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.202+0000 7fd5a0c00640 1 -- start start 2024-04-23T18:24:04.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd5a0c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd59c0c78c0 0x7fd59c14ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd5a0c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd59c0c8330 0x7fd59c14e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd5a0c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd59c0c8710 0x7fd59c14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd5a0c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c068100 con 0x7fd59c0c78c0 2024-04-23T18:24:04.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd5a0c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c0c73a0 con 0x7fd59c0c8710 2024-04-23T18:24:04.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd5a0c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd59c0683d0 con 0x7fd59c0c8330 2024-04-23T18:24:04.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd59b400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd59c0c78c0 0x7fd59c14ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd59b400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd59c0c78c0 0x7fd59c14ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57958/0 (socket says 172.21.15.28:57958) 2024-04-23T18:24:04.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd59b400640 1 -- 172.21.15.28:0/3315265992 learned_addr learned my addr 172.21.15.28:0/3315265992 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:04.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd59be00640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd59c0c8710 0x7fd59c14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd59aa00640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd59c0c8330 0x7fd59c14e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd59b400640 1 -- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd59c0c8330 msgr2=0x7fd59c14e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd59b400640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd59c0c8330 0x7fd59c14e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd59b400640 1 -- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd59c0c8710 msgr2=0x7fd59c14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd59b400640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd59c0c8710 0x7fd59c14e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd59b400640 1 -- 172.21.15.28:0/3315265992 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c1f0c80 con 0x7fd59c0c78c0 2024-04-23T18:24:04.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd59b400640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd59c0c78c0 0x7fd59c14ef60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00c420 tx=0x7fd58c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd593400640 1 -- 172.21.15.28:0/3315265992 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c017070 con 0x7fd59c0c78c0 2024-04-23T18:24:04.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd593400640 1 -- 172.21.15.28:0/3315265992 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58c005cf0 con 0x7fd59c0c78c0 2024-04-23T18:24:04.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd593400640 1 -- 172.21.15.28:0/3315265992 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0072f0 con 0x7fd59c0c78c0 2024-04-23T18:24:04.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd5a0c00640 1 -- 172.21.15.28:0/3315265992 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59c1f40e0 con 0x7fd59c0c78c0 2024-04-23T18:24:04.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd5a0c00640 1 -- 172.21.15.28:0/3315265992 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59c1f4680 con 0x7fd59c0c78c0 2024-04-23T18:24:04.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.206+0000 7fd5a0c00640 1 -- 172.21.15.28:0/3315265992 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59c074290 con 0x7fd59c0c78c0 2024-04-23T18:24:04.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.210+0000 7fd593400640 1 -- 172.21.15.28:0/3315265992 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd58c01a070 con 0x7fd59c0c78c0 2024-04-23T18:24:04.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.210+0000 7fd593400640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd57c068380 0x7fd57c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.210+0000 7fd593400640 1 -- 172.21.15.28:0/3315265992 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd58c086290 con 0x7fd59c0c78c0 2024-04-23T18:24:04.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.210+0000 7fd59aa00640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd57c068380 0x7fd57c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.210+0000 7fd59aa00640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd57c068380 0x7fd57c06a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd5880b2000 tx=0x7fd588008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.218+0000 7fd593400640 1 -- 172.21.15.28:0/3315265992 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd58c056320 con 0x7fd59c0c78c0 2024-04-23T18:24:04.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd5a0c00640 1 -- 172.21.15.28:0/3315265992 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd59c0cd4f0 con 0x7fd59c0c78c0 2024-04-23T18:24:04.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd593400640 1 -- 172.21.15.28:0/3315265992 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7fd58c055c20 con 0x7fd59c0c78c0 2024-04-23T18:24:04.429 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:24:04.429 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:24:04.430 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:24:04.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd5a0c00640 1 -- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd57c068380 msgr2=0x7fd57c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd5a0c00640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd57c068380 0x7fd57c06a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd5880b2000 tx=0x7fd588008040 comp rx=0 tx=0).stop 2024-04-23T18:24:04.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd5a0c00640 1 -- 172.21.15.28:0/3315265992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd59c0c78c0 msgr2=0x7fd59c14ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd5a0c00640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd59c0c78c0 0x7fd59c14ef60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00c420 tx=0x7fd58c00c8e0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd5a0c00640 1 -- 172.21.15.28:0/3315265992 shutdown_connections 2024-04-23T18:24:04.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd5a0c00640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd57c068380 0x7fd57c06a840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd5a0c00640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd59c0c8330 0x7fd59c14e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd5a0c00640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd59c0c8710 0x7fd59c14e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd5a0c00640 1 --2- 172.21.15.28:0/3315265992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd59c0c78c0 0x7fd59c14ef60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.434+0000 7fd5a0c00640 1 -- 172.21.15.28:0/3315265992 >> 172.21.15.28:0/3315265992 conn(0x7fd59c06e310 msgr2=0x7fd59c0c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.438+0000 7fd5a0c00640 1 -- 172.21.15.28:0/3315265992 shutdown_connections 2024-04-23T18:24:04.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.438+0000 7fd5a0c00640 1 -- 172.21.15.28:0/3315265992 wait complete. 2024-04-23T18:24:04.452 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4297 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0' 2024-04-23T18:24:04.452 DEBUG:teuthology.orchestra.run.smithi028:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4297 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0 2024-04-23T18:24:04.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2223200640 1 Processor -- start 2024-04-23T18:24:04.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2223200640 1 -- start start 2024-04-23T18:24:04.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2223200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22240c93b0 0x7f22240c9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2223200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22240c9cd0 con 0x7f2224072dc0 2024-04-23T18:24:04.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2223200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f222406b9e0 con 0x7f22240cf390 2024-04-23T18:24:04.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2223200640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f22240c59c0 con 0x7f22240c93b0 2024-04-23T18:24:04.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2221e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22240c93b0 0x7f22240c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2222800640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2224072dc0 0x7f2224155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48618/0 (socket says 172.21.15.28:48618) 2024-04-23T18:24:04.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2222800640 1 -- 172.21.15.28:0/3436587381 learned_addr learned my addr 172.21.15.28:0/3436587381 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:24:04.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2220a00640 1 -- 172.21.15.28:0/3436587381 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4278791748 0 0) 0x7f222406b9e0 con 0x7f22240cf390 2024-04-23T18:24:04.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2220a00640 1 -- 172.21.15.28:0/3436587381 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2208003530 con 0x7f22240cf390 2024-04-23T18:24:04.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2220a00640 1 -- 172.21.15.28:0/3436587381 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739407456 0 0) 0x7f22240c9cd0 con 0x7f2224072dc0 2024-04-23T18:24:04.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2220a00640 1 -- 172.21.15.28:0/3436587381 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f222406b9e0 con 0x7f2224072dc0 2024-04-23T18:24:04.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2221e00640 1 -- 172.21.15.28:0/3436587381 >> v1:172.21.15.137:6789/0 conn(0x7f22240cf390 legacy=0x7f222415fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2221e00640 1 -- 172.21.15.28:0/3436587381 >> v1:172.21.15.28:6789/0 conn(0x7f2224072dc0 legacy=0x7f2224155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.614+0000 7f2221e00640 1 -- 172.21.15.28:0/3436587381 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222406bcb0 con 0x7f22240c93b0 2024-04-23T18:24:04.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.618+0000 7f2221e00640 1 --2- 172.21.15.28:0/3436587381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22240c93b0 0x7f22240c9790 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f22140097c0 tx=0x7f221401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8107f8f460b5642 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.622+0000 7f2220a00640 1 -- 172.21.15.28:0/3436587381 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22140b5070 con 0x7f22240c93b0 2024-04-23T18:24:04.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.622+0000 7f2220a00640 1 -- 172.21.15.28:0/3436587381 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22140a8950 con 0x7f22240c93b0 2024-04-23T18:24:04.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.622+0000 7f2220a00640 1 -- 172.21.15.28:0/3436587381 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22140a8d20 con 0x7f22240c93b0 2024-04-23T18:24:04.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.622+0000 7f2223200640 1 -- 172.21.15.28:0/3436587381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22240c93b0 msgr2=0x7f22240c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.622+0000 7f2223200640 1 --2- 172.21.15.28:0/3436587381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22240c93b0 0x7f22240c9790 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f22140097c0 tx=0x7f221401ec50 comp rx=0 tx=0).stop 2024-04-23T18:24:04.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.622+0000 7f2223200640 1 -- 172.21.15.28:0/3436587381 shutdown_connections 2024-04-23T18:24:04.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.622+0000 7f2223200640 1 --2- 172.21.15.28:0/3436587381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22240c93b0 0x7f22240c9790 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.622+0000 7f2223200640 1 -- 172.21.15.28:0/3436587381 >> 172.21.15.28:0/3436587381 conn(0x7f22240ce750 msgr2=0x7f22240ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:04.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.622+0000 7f2223200640 1 -- 172.21.15.28:0/3436587381 shutdown_connections 2024-04-23T18:24:04.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.622+0000 7f2223200640 1 -- 172.21.15.28:0/3436587381 wait complete. 2024-04-23T18:24:04.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2223200640 1 Processor -- start 2024-04-23T18:24:04.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2223200640 1 -- start start 2024-04-23T18:24:04.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2223200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2224072dc0 0x7f2224162d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2223200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22240c93b0 0x7f2224148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2223200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22240cf390 0x7f2224148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2223200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f222406c830 con 0x7f2224072dc0 2024-04-23T18:24:04.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2223200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f222406c270 con 0x7f22240c93b0 2024-04-23T18:24:04.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2223200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f222406c550 con 0x7f22240cf390 2024-04-23T18:24:04.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2221e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2224072dc0 0x7f2224162d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2221e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2224072dc0 0x7f2224162d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57986/0 (socket says 172.21.15.28:57986) 2024-04-23T18:24:04.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2221e00640 1 -- 172.21.15.28:0/2062082238 learned_addr learned my addr 172.21.15.28:0/2062082238 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:04.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2221400640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22240c93b0 0x7f2224148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2222800640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22240cf390 0x7f2224148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2221e00640 1 -- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22240cf390 msgr2=0x7f2224148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2221e00640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22240cf390 0x7f2224148540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2221e00640 1 -- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22240c93b0 msgr2=0x7f2224148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2221e00640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22240c93b0 0x7f2224148000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2221e00640 1 -- 172.21.15.28:0/2062082238 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22240cd590 con 0x7f2224072dc0 2024-04-23T18:24:04.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2221e00640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2224072dc0 0x7f2224162d20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f22140097c0 tx=0x7f221401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f221a000640 1 -- 172.21.15.28:0/2062082238 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22140bf070 con 0x7f2224072dc0 2024-04-23T18:24:04.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f221a000640 1 -- 172.21.15.28:0/2062082238 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22140b0660 con 0x7f2224072dc0 2024-04-23T18:24:04.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f221a000640 1 -- 172.21.15.28:0/2062082238 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22140b5040 con 0x7f2224072dc0 2024-04-23T18:24:04.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2223200640 1 -- 172.21.15.28:0/2062082238 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22240c7b60 con 0x7f2224072dc0 2024-04-23T18:24:04.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.626+0000 7f2223200640 1 -- 172.21.15.28:0/2062082238 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22240c8120 con 0x7f2224072dc0 2024-04-23T18:24:04.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.630+0000 7f221a000640 1 -- 172.21.15.28:0/2062082238 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f22140b0a50 con 0x7f2224072dc0 2024-04-23T18:24:04.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.630+0000 7f222c17b000 1 Processor -- start 2024-04-23T18:24:04.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.630+0000 7f222c17b000 1 -- start start 2024-04-23T18:24:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.630+0000 7f222c17b000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 0x55c5fb8309e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.630+0000 7f222c17b000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 0x55c5fb835aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.630+0000 7f222c17b000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb835fe0 0x55c5fb8363c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.630+0000 7f222c17b000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55c5fb6dc2a0 con 0x55c5fb835fe0 2024-04-23T18:24:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.630+0000 7f222c17b000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c5fb6425f0 con 0x55c5fb830600 2024-04-23T18:24:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.630+0000 7f222c17b000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55c5fb5dd820 con 0x55c5fb8356c0 2024-04-23T18:24:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f221a000640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f22040683b0 0x7f220406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2221e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 0x55c5fb835aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f221a000640 1 -- 172.21.15.28:0/2062082238 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2214123300 con 0x7f2224072dc0 2024-04-23T18:24:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2221e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 0x55c5fb835aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:43682/0 (socket says 172.21.15.28:43682) 2024-04-23T18:24:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2222800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 0x55c5fb8309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2221e00640 1 -- 172.21.15.28:0/101596749 learned_addr learned my addr 172.21.15.28:0/101596749 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:04.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2222800640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f22040683b0 0x7f220406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2221400640 1 --2- 172.21.15.28:0/101596749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb835fe0 0x55c5fb8363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2221e00640 1 -- 172.21.15.28:0/101596749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 msgr2=0x55c5fb8309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2221e00640 1 --2- 172.21.15.28:0/101596749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 0x55c5fb8309e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2221e00640 1 -- 172.21.15.28:0/101596749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb835fe0 msgr2=0x55c5fb8363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2221e00640 1 --2- 172.21.15.28:0/101596749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb835fe0 0x55c5fb8363c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2221e00640 1 -- 172.21.15.28:0/101596749 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5fb688c00 con 0x55c5fb8356c0 2024-04-23T18:24:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2222800640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f22040683b0 0x7f220406a870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f221c001570 tx=0x7f221c007e50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f2221e00640 1 --2- 172.21.15.28:0/101596749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 0x55c5fb835aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22140fb500 tx=0x7f22140b7000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f36da307f8220425 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f220ea00640 1 -- 172.21.15.28:0/101596749 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22140f27b0 con 0x55c5fb8356c0 2024-04-23T18:24:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f220ea00640 1 -- 172.21.15.28:0/101596749 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22140f5040 con 0x55c5fb8356c0 2024-04-23T18:24:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f220ea00640 1 -- 172.21.15.28:0/101596749 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22140f3550 con 0x55c5fb8356c0 2024-04-23T18:24:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f222c17b000 1 -- 172.21.15.28:0/101596749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 msgr2=0x55c5fb835aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f222c17b000 1 --2- 172.21.15.28:0/101596749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 0x55c5fb835aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22140fb500 tx=0x7f22140b7000 comp rx=0 tx=0).stop 2024-04-23T18:24:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f222c17b000 1 -- 172.21.15.28:0/101596749 shutdown_connections 2024-04-23T18:24:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f222c17b000 1 --2- 172.21.15.28:0/101596749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 0x55c5fb835aa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f222c17b000 1 --2- 172.21.15.28:0/101596749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb835fe0 0x55c5fb8363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f222c17b000 1 --2- 172.21.15.28:0/101596749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 0x55c5fb8309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f222c17b000 1 -- 172.21.15.28:0/101596749 >> 172.21.15.28:0/101596749 conn(0x55c5fb831470 msgr2=0x55c5fb833890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f222c17b000 1 -- 172.21.15.28:0/101596749 shutdown_connections 2024-04-23T18:24:04.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.634+0000 7f222c17b000 1 -- 172.21.15.28:0/101596749 wait complete. 2024-04-23T18:24:04.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 1 -- start start 2024-04-23T18:24:04.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 1 Processor -- start 2024-04-23T18:24:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb830600 0x55c5fb82f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 0x55c5fb82ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb835fe0 0x55c5fb83b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55c5fb5edc60 con 0x55c5fb8356c0 2024-04-23T18:24:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c5fb6c4bf0 con 0x55c5fb835fe0 2024-04-23T18:24:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55c5fb6ff560 con 0x55c5fb830600 2024-04-23T18:24:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 10 client.0 _ll_register_callbacks cb 0x55c5fb619570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:24:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2221400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 0x55c5fb82ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2221400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 0x55c5fb82ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58006/0 (socket says 172.21.15.28:58006) 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2221400640 1 -- 172.21.15.28:0/1468102305 learned_addr learned my addr 172.21.15.28:0/1468102305 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2222800640 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb835fe0 0x55c5fb83b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2221e00640 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb830600 0x55c5fb82f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2221400640 1 -- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb830600 msgr2=0x55c5fb82f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2221400640 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb830600 0x55c5fb82f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2221400640 1 -- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb835fe0 msgr2=0x55c5fb83b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2221400640 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb835fe0 0x55c5fb83b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2221400640 1 -- 172.21.15.28:0/1468102305 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5fb67d630 con 0x55c5fb8356c0 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2221400640 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 0x55c5fb82ff20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2210005630 tx=0x7f2210003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bbc0f81e0763cd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2203400640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2203400640 1 -- 172.21.15.28:0/1468102305 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221001b060 con 0x55c5fb8356c0 2024-04-23T18:24:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2203400640 1 -- 172.21.15.28:0/1468102305 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2210001b90 con 0x55c5fb8356c0 2024-04-23T18:24:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 1 -- 172.21.15.28:0/1468102305 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22140f5040 con 0x55c5fb8356c0 2024-04-23T18:24:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2203400640 1 -- 172.21.15.28:0/1468102305 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f22100203b0 con 0x55c5fb8356c0 2024-04-23T18:24:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 10 client.5199 fetch_fsmap learned FSMap version 15 2024-04-23T18:24:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f222c17b000 1 -- 172.21.15.28:0/1468102305 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55c5fb5e2490 con 0x55c5fb8356c0 2024-04-23T18:24:04.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.638+0000 7f2203400640 1 -- 172.21.15.28:0/1468102305 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22140f5040 con 0x55c5fb8356c0 2024-04-23T18:24:04.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f2203400640 1 -- 172.21.15.28:0/1468102305 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f2210016750 con 0x55c5fb8356c0 2024-04-23T18:24:04.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 10 client.5199 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:24:04.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 10 client.5199 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:24:04.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 20 client.5199 populate_metadata read hostname 'smithi028' 2024-04-23T18:24:04.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55c5fb83c390 0x55c5fb83c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 4 client.5199 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:24:04.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 -- 172.21.15.28:0/1468102305 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5fb5dc7f0 con 0x55c5fb83c390 2024-04-23T18:24:04.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f2221e00640 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55c5fb83c390 0x55c5fb83c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f2221e00640 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55c5fb83c390 0x55c5fb83c770 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1ee66d50d8f23d server_cookie=f44d8c08cd16e255 in_seq=0 out_seq=0 2024-04-23T18:24:04.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f2203400640 10 client.5199 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:04.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f2203400640 1 -- 172.21.15.28:0/1468102305 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c5fb5dc7f0 con 0x55c5fb83c390 2024-04-23T18:24:04.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f2203400640 10 client.5199 handle_command_reply: tid=0 2024-04-23T18:24:04.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 client.5199 shutdown 2024-04-23T18:24:04.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 -- 172.21.15.28:0/1468102305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 msgr2=0x55c5fb82ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 0x55c5fb82ff20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2210005630 tx=0x7f2210003f00 comp rx=0 tx=0).stop 2024-04-23T18:24:04.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 -- 172.21.15.28:0/1468102305 shutdown_connections 2024-04-23T18:24:04.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55c5fb83c390 0x55c5fb83c770 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb835fe0 0x55c5fb83b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 0x55c5fb82ff20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 --2- 172.21.15.28:0/1468102305 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb830600 0x55c5fb82f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 -- 172.21.15.28:0/1468102305 >> 172.21.15.28:0/1468102305 conn(0x55c5fb831470 msgr2=0x55c5fb8346b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:04.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f2203400640 0 client.5199 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:04.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 -- 172.21.15.28:0/1468102305 shutdown_connections 2024-04-23T18:24:04.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 1 -- 172.21.15.28:0/1468102305 wait complete. 2024-04-23T18:24:04.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.642+0000 7f222c17b000 20 client.5199 trim_cache size 0 max 16384 2024-04-23T18:24:04.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f222c17b000 1 Processor -- start 2024-04-23T18:24:04.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f222c17b000 1 -- start start 2024-04-23T18:24:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f222c17b000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f222c17b000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 0x55c5fb7f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f222c17b000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb835fe0 0x55c5fb83a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f222c17b000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2224201ff0 con 0x55c5fb830600 2024-04-23T18:24:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f222c17b000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2224071170 con 0x55c5fb835fe0 2024-04-23T18:24:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f222c17b000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2224201a10 con 0x55c5fb8356c0 2024-04-23T18:24:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f2221e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f2221e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58022/0 (socket says 172.21.15.28:58022) 2024-04-23T18:24:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f2221e00640 1 -- 172.21.15.28:0/3069163496 learned_addr learned my addr 172.21.15.28:0/3069163496 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f2221400640 1 --2- 172.21.15.28:0/3069163496 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 0x55c5fb7f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f2222800640 1 --2- 172.21.15.28:0/3069163496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb835fe0 0x55c5fb83a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f2221e00640 1 -- 172.21.15.28:0/3069163496 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 msgr2=0x55c5fb7f93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f2221e00640 1 --2- 172.21.15.28:0/3069163496 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 0x55c5fb7f93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f2221e00640 1 -- 172.21.15.28:0/3069163496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb835fe0 msgr2=0x55c5fb83a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f2221e00640 1 --2- 172.21.15.28:0/3069163496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb835fe0 0x55c5fb83a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.662+0000 7f2221e00640 1 -- 172.21.15.28:0/3069163496 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5fb5dda70 con 0x55c5fb830600 2024-04-23T18:24:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f2221e00640 1 --2- 172.21.15.28:0/3069163496 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2214020260 tx=0x7f2214121390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79991a7efed26aaf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f220e000640 1 -- 172.21.15.28:0/3069163496 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22140f2e50 con 0x55c5fb830600 2024-04-23T18:24:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f220e000640 1 -- 172.21.15.28:0/3069163496 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22140f5040 con 0x55c5fb830600 2024-04-23T18:24:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f220e000640 1 -- 172.21.15.28:0/3069163496 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22140f7200 con 0x55c5fb830600 2024-04-23T18:24:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 -- 172.21.15.28:0/3069163496 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb830600 msgr2=0x55c5fb7f8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 --2- 172.21.15.28:0/3069163496 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2214020260 tx=0x7f2214121390 comp rx=0 tx=0).stop 2024-04-23T18:24:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 -- 172.21.15.28:0/3069163496 shutdown_connections 2024-04-23T18:24:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 --2- 172.21.15.28:0/3069163496 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb8356c0 0x55c5fb7f93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 --2- 172.21.15.28:0/3069163496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb835fe0 0x55c5fb83a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 --2- 172.21.15.28:0/3069163496 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 -- 172.21.15.28:0/3069163496 >> 172.21.15.28:0/3069163496 conn(0x55c5fb831470 msgr2=0x55c5fb850010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 -- 172.21.15.28:0/3069163496 shutdown_connections 2024-04-23T18:24:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 -- 172.21.15.28:0/3069163496 wait complete. 2024-04-23T18:24:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 -- start start 2024-04-23T18:24:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 Processor -- start 2024-04-23T18:24:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 0x55c5fb7f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb835fe0 0x55c5fb8a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55c5fb641900 con 0x55c5fb8356c0 2024-04-23T18:24:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c5fb60ce60 con 0x55c5fb830600 2024-04-23T18:24:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55c5fb646c20 con 0x55c5fb835fe0 2024-04-23T18:24:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f222c17b000 10 client.0 _ll_register_callbacks cb 0x7f2210007e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:24:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f2221e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f2221e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:42454/0 (socket says 172.21.15.28:42454) 2024-04-23T18:24:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f2221e00640 1 -- 172.21.15.28:0/1997663904 learned_addr learned my addr 172.21.15.28:0/1997663904 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f2222800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb835fe0 0x55c5fb8a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.666+0000 7f2221400640 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 0x55c5fb7f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2221e00640 1 -- 172.21.15.28:0/1997663904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb835fe0 msgr2=0x55c5fb8a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2221e00640 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb835fe0 0x55c5fb8a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2221e00640 1 -- 172.21.15.28:0/1997663904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 msgr2=0x55c5fb7f93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2221e00640 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 0x55c5fb7f93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2221e00640 1 -- 172.21.15.28:0/1997663904 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5fb6c5080 con 0x55c5fb830600 2024-04-23T18:24:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2221e00640 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f22140098b0 tx=0x7f2214007000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=513acd319200feba server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2203400640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T18:24:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2203400640 1 -- 172.21.15.28:0/1997663904 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2214111050 con 0x55c5fb830600 2024-04-23T18:24:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2203400640 1 -- 172.21.15.28:0/1997663904 <== mon.1 v2:172.21.15.137:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f22140f1150 con 0x55c5fb830600 2024-04-23T18:24:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f222c17b000 1 -- 172.21.15.28:0/1997663904 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22140f5040 con 0x55c5fb830600 2024-04-23T18:24:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2203400640 1 -- 172.21.15.28:0/1997663904 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f22140fba30 con 0x55c5fb830600 2024-04-23T18:24:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f222c17b000 10 client.5173 fetch_fsmap learned FSMap version 15 2024-04-23T18:24:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f222c17b000 1 -- 172.21.15.28:0/1997663904 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55c5fb5e83e0 con 0x55c5fb830600 2024-04-23T18:24:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2203400640 1 -- 172.21.15.28:0/1997663904 <== mon.1 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22140f5040 con 0x55c5fb830600 2024-04-23T18:24:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2203400640 1 -- 172.21.15.28:0/1997663904 <== mon.1 v2:172.21.15.137:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f2214111ce0 con 0x55c5fb830600 2024-04-23T18:24:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f222c17b000 10 client.5173 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:24:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f222c17b000 10 client.5173 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:24:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f222c17b000 20 client.5173 populate_metadata read hostname 'smithi028' 2024-04-23T18:24:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f222c17b000 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55c5fb8a85f0 0x55c5fb8a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f222c17b000 4 client.5173 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}] 2024-04-23T18:24:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f222c17b000 1 -- 172.21.15.28:0/1997663904 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}) -- 0x55c5fb5eb940 con 0x55c5fb8a85f0 2024-04-23T18:24:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2221400640 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55c5fb8a85f0 0x55c5fb8a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2203400640 10 client.5173 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.670+0000 7f2221400640 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55c5fb8a85f0 0x55c5fb8a8a00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1551182428cbbdec server_cookie=f6cbb01411fef111 in_seq=0 out_seq=0 2024-04-23T18:24:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2203400640 1 -- 172.21.15.28:0/1997663904 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55c5fb5eb940 con 0x55c5fb8a85f0 2024-04-23T18:24:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2203400640 10 client.5173 handle_command_reply: tid=0 2024-04-23T18:24:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 1 client.5173 shutdown 2024-04-23T18:24:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 1 -- 172.21.15.28:0/1997663904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 msgr2=0x55c5fb7f8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f22140098b0 tx=0x7f2214007000 comp rx=0 tx=0).stop 2024-04-23T18:24:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 1 -- 172.21.15.28:0/1997663904 shutdown_connections 2024-04-23T18:24:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55c5fb8a85f0 0x55c5fb8a8a00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55c5fb835fe0 0x55c5fb8a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c5fb8356c0 0x55c5fb7f93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 1 --2- 172.21.15.28:0/1997663904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5fb830600 0x55c5fb7f8ea0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 1 -- 172.21.15.28:0/1997663904 >> 172.21.15.28:0/1997663904 conn(0x55c5fb831470 msgr2=0x55c5fb850ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2203400640 0 client.5173 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 1 -- 172.21.15.28:0/1997663904 shutdown_connections 2024-04-23T18:24:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 1 -- 172.21.15.28:0/1997663904 wait complete. 2024-04-23T18:24:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f222c17b000 20 client.5173 trim_cache size 0 max 16384 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 15, 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout: "leader": 4297, 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout: "set_version": 6, 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout: "sets": { 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout: "eb68884": { 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout: "version": 6, 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout: "age_ref": 0.0, 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "QUIESCED", 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:24:04.674 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: "timeout": 60.0, 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: "expiration": 79.5, 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: "members": { 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: "file:/": { 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: "excluded": false, 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "QUIESCED", 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:04.675 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:04.676 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:24:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 -- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f22040683b0 msgr2=0x7f220406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f22040683b0 0x7f220406a870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f221c001570 tx=0x7f221c007e50 comp rx=0 tx=0).stop 2024-04-23T18:24:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 -- 172.21.15.28:0/2062082238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2224072dc0 msgr2=0x7f2224162d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2224072dc0 0x7f2224162d20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f22140097c0 tx=0x7f221401b9f0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 -- 172.21.15.28:0/2062082238 shutdown_connections 2024-04-23T18:24:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f22040683b0 0x7f220406a870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f22240cf390 0x7f2224148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22240c93b0 0x7f2224148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 --2- 172.21.15.28:0/2062082238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2224072dc0 0x7f2224162d20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 -- 172.21.15.28:0/2062082238 >> 172.21.15.28:0/2062082238 conn(0x7f22240ce750 msgr2=0x7f22241540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 -- 172.21.15.28:0/2062082238 shutdown_connections 2024-04-23T18:24:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:04.678+0000 7f2223200640 1 -- 172.21.15.28:0/2062082238 wait complete. 2024-04-23T18:24:04.701 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'eb68884', quiesce took 0.7 seconds. Will release after: 19.5 2024-04-23T18:24:15.130 INFO:tasks.workunit.client.0.smithi028.stderr:Updating files: 70% (8750/12484) Updating files: 71% (8864/12484) Updating files: 72% (8989/12484) Updating files: 73% (9114/12484) Updating files: 74% (9239/12484) Updating files: 75% (9363/12484) Updating files: 76% (9488/12484) Updating files: 77% (9613/12484) Updating files: 78% (9738/12484) Updating files: 79% (9863/12484) Updating files: 80% (9988/12484) Updating files: 81% (10113/12484) Updating files: 82% (10237/12484) Updating files: 83% (10362/12484) Updating files: 84% (10487/12484) Updating files: 85% (10612/12484) Updating files: 86% (10737/12484) Updating files: 87% (10862/12484) Updating files: 88% (10986/12484) Updating files: 89% (11111/12484) Updating files: 90% (11236/12484) Updating files: 91% (11361/12484) Updating files: 92% (11486/12484) Updating files: 93% (11611/12484) Updating files: 94% (11735/12484) Updating files: 95% (11860/12484) Updating files: 96% (11985/12484) Updating files: 97% (12110/12484) Updating files: 98% (12235/12484) Updating files: 99% (12360/12484) Updating files: 100% (12484/12484) Updating files: 100% (12484/12484), done. 2024-04-23T18:24:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:Note: switching to '57e0caf76fdb7ab8b1358588f292d08519163844'. 2024-04-23T18:24:15.275 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-04-23T18:24:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-23T18:24:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-23T18:24:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:state without impacting any branches by switching back to a branch. 2024-04-23T18:24:15.275 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-04-23T18:24:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-23T18:24:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-23T18:24:15.275 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-04-23T18:24:15.275 INFO:tasks.workunit.client.0.smithi028.stderr: git switch -c 2024-04-23T18:24:15.275 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-04-23T18:24:15.276 INFO:tasks.workunit.client.0.smithi028.stderr:Or undo this operation with: 2024-04-23T18:24:15.276 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-04-23T18:24:15.276 INFO:tasks.workunit.client.0.smithi028.stderr: git switch - 2024-04-23T18:24:15.276 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-04-23T18:24:15.276 INFO:tasks.workunit.client.0.smithi028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-23T18:24:15.276 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-04-23T18:24:15.276 INFO:tasks.workunit.client.0.smithi028.stderr:HEAD is now at 57e0caf76fd qa/suites/fs: add quiescer to the fs suite 2024-04-23T18:24:15.278 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-23T18:24:15.287 INFO:tasks.workunit.client.0.smithi028.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-23T18:24:15.289 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T18:24:15.290 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-23T18:24:16.084 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-23T18:24:16.169 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-23T18:24:16.225 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T18:24:16.228 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T18:24:16.228 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-23T18:24:16.282 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T18:24:16.288 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:24:16.288 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-23T18:24:16.339 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-04-23T18:24:16.340 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-04-23T18:24:16.341 DEBUG:teuthology.orchestra.run.smithi028:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=57e0caf76fdb7ab8b1358588f292d08519163844 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-04-23T18:24:24.203 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:24:24.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7f3200640 1 Processor -- start 2024-04-23T18:24:24.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7f3200640 1 -- start start 2024-04-23T18:24:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7f3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7ec0c9a00 0x7fe7ec158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7f3200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7ec0c9e40 0x7fe7ec159430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7f3200640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ec0c3bc0 con 0x7fe7ec1531a0 2024-04-23T18:24:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7f3200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ec0c4940 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7f3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ec0c6790 con 0x7fe7ec0c9a00 2024-04-23T18:24:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7ebe00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe7ec1531a0 0x7fe7ec0c5ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:50944/0 (socket says 172.21.15.28:50944) 2024-04-23T18:24:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7ebe00640 1 -- 172.21.15.28:0/1776798258 learned_addr learned my addr 172.21.15.28:0/1776798258 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:24:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7e3400640 1 --2- 172.21.15.28:0/1776798258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7ec0c9a00 0x7fe7ec158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7f1200640 1 --2- 172.21.15.28:0/1776798258 >> v2:172.21.15.137:3300/0 conn(0x7fe7ec0c9e40 0x7fe7ec159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7eb400640 1 -- 172.21.15.28:0/1776798258 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2025390573 0 0) 0x7fe7ec0c3bc0 con 0x7fe7ec1531a0 2024-04-23T18:24:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7eb400640 1 -- 172.21.15.28:0/1776798258 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7d0003530 con 0x7fe7ec1531a0 2024-04-23T18:24:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7e3400640 1 -- 172.21.15.28:0/1776798258 >> v2:172.21.15.137:3300/0 conn(0x7fe7ec0c9e40 msgr2=0x7fe7ec159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7e3400640 1 --2- 172.21.15.28:0/1776798258 >> v2:172.21.15.137:3300/0 conn(0x7fe7ec0c9e40 0x7fe7ec159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7e3400640 1 -- 172.21.15.28:0/1776798258 >> v1:172.21.15.28:6789/0 conn(0x7fe7ec1531a0 legacy=0x7fe7ec0c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.361+0000 7fe7e3400640 1 -- 172.21.15.28:0/1776798258 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec0c6a70 con 0x7fe7ec0c9a00 2024-04-23T18:24:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7e3400640 1 --2- 172.21.15.28:0/1776798258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7ec0c9a00 0x7fe7ec158ef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40097c0 tx=0x7fe7d401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a89b281ba2626496 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7eb400640 1 -- 172.21.15.28:0/1776798258 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40b5070 con 0x7fe7ec0c9a00 2024-04-23T18:24:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7eb400640 1 -- 172.21.15.28:0/1776798258 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7d40a8990 con 0x7fe7ec0c9a00 2024-04-23T18:24:24.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7eb400640 1 -- 172.21.15.28:0/1776798258 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40a8d40 con 0x7fe7ec0c9a00 2024-04-23T18:24:24.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7f3200640 1 -- 172.21.15.28:0/1776798258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7ec0c9a00 msgr2=0x7fe7ec158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7f3200640 1 --2- 172.21.15.28:0/1776798258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7ec0c9a00 0x7fe7ec158ef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40097c0 tx=0x7fe7d401ec90 comp rx=0 tx=0).stop 2024-04-23T18:24:24.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7f3200640 1 -- 172.21.15.28:0/1776798258 shutdown_connections 2024-04-23T18:24:24.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7f3200640 1 --2- 172.21.15.28:0/1776798258 >> v2:172.21.15.137:3300/0 conn(0x7fe7ec0c9e40 0x7fe7ec159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7f3200640 1 --2- 172.21.15.28:0/1776798258 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7ec0c9a00 0x7fe7ec158ef0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7f3200640 1 -- 172.21.15.28:0/1776798258 >> 172.21.15.28:0/1776798258 conn(0x7fe7ec06d0a0 msgr2=0x7fe7ec0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:24.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7f3200640 1 -- 172.21.15.28:0/1776798258 shutdown_connections 2024-04-23T18:24:24.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.365+0000 7fe7f3200640 1 -- 172.21.15.28:0/1776798258 wait complete. 2024-04-23T18:24:24.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7f3200640 1 Processor -- start 2024-04-23T18:24:24.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7f3200640 1 -- start start 2024-04-23T18:24:24.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7f3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0c9a00 0x7fe7ec071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7f3200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7ec0c9e40 0x7fe7ec0721d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7f3200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7ec1531a0 0x7fe7ec1f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7f3200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec0c4420 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7f3200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec0c4140 con 0x7fe7ec0c9a00 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7f3200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ec153580 con 0x7fe7ec1531a0 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7ec0c9e40 0x7fe7ec0721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7ec0c9e40 0x7fe7ec0721d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50812/0 (socket says 172.21.15.28:50812) 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e3400640 1 -- 172.21.15.28:0/3555396603 learned_addr learned my addr 172.21.15.28:0/3555396603 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7ebe00640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0c9a00 0x7fe7ec071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7f1200640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7ec1531a0 0x7fe7ec1f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e3400640 1 -- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7ec1531a0 msgr2=0x7fe7ec1f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e3400640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7ec1531a0 0x7fe7ec1f4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e3400640 1 -- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0c9a00 msgr2=0x7fe7ec071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e3400640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0c9a00 0x7fe7ec071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e3400640 1 -- 172.21.15.28:0/3555396603 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec1593e0 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e3400640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7ec0c9e40 0x7fe7ec0721d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40b3040 tx=0x7fe7d401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e8c00640 1 -- 172.21.15.28:0/3555396603 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40bf070 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e8c00640 1 -- 172.21.15.28:0/3555396603 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7d40b0700 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7f3200640 1 -- 172.21.15.28:0/3555396603 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ec159100 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7e8c00640 1 -- 172.21.15.28:0/3555396603 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40b5040 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.369+0000 7fe7f3200640 1 -- 172.21.15.28:0/3555396603 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ec0711b0 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.373+0000 7fe7f3200640 1 -- 172.21.15.28:0/3555396603 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ec068cd0 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.373+0000 7fe7e8c00640 1 -- 172.21.15.28:0/3555396603 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe7d40c2070 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.373+0000 7fe7e8c00640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe7c8068380 0x7fe7c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.373+0000 7fe7e8c00640 1 -- 172.21.15.28:0/3555396603 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe7d41234f0 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.373+0000 7fe7ebe00640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe7c8068380 0x7fe7c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.373+0000 7fe7ebe00640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe7c8068380 0x7fe7c806a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc001210 tx=0x7fe7dc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:24.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.377+0000 7fe7e8c00640 1 -- 172.21.15.28:0/3555396603 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe7d40187f0 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.577+0000 7fe7f3200640 1 -- 172.21.15.28:0/3555396603 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7ec0c7ea0 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7e8c00640 1 -- 172.21.15.28:0/3555396603 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7fe7d40f36a0 con 0x7fe7ec0c9e40 2024-04-23T18:24:24.578 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:24:24.578 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:24:24.579 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:24:24.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 -- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe7c8068380 msgr2=0x7fe7c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe7c8068380 0x7fe7c806a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc001210 tx=0x7fe7dc009040 comp rx=0 tx=0).stop 2024-04-23T18:24:24.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 -- 172.21.15.28:0/3555396603 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7ec0c9e40 msgr2=0x7fe7ec0721d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7ec0c9e40 0x7fe7ec0721d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40b3040 tx=0x7fe7d401ba30 comp rx=0 tx=0).stop 2024-04-23T18:24:24.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 -- 172.21.15.28:0/3555396603 shutdown_connections 2024-04-23T18:24:24.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe7c8068380 0x7fe7c806a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe7ec1531a0 0x7fe7ec1f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7ec0c9e40 0x7fe7ec0721d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 --2- 172.21.15.28:0/3555396603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7ec0c9a00 0x7fe7ec071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 -- 172.21.15.28:0/3555396603 >> 172.21.15.28:0/3555396603 conn(0x7fe7ec06d0a0 msgr2=0x7fe7ec0c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:24.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 -- 172.21.15.28:0/3555396603 shutdown_connections 2024-04-23T18:24:24.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.581+0000 7fe7f3200640 1 -- 172.21.15.28:0/3555396603 wait complete. 2024-04-23T18:24:24.598 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4297 quiesce db --set-id eb68884 --release --await' 2024-04-23T18:24:24.598 DEBUG:teuthology.orchestra.run.smithi028:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4297 quiesce db --set-id eb68884 --release --await 2024-04-23T18:24:24.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.749+0000 7fac1e000640 1 Processor -- start 2024-04-23T18:24:24.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.749+0000 7fac1e000640 1 -- start start 2024-04-23T18:24:24.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac1e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac18071940 0x7fac18073c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac1e000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fac180c9850 0x7fac180c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac1e000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac180c71f0 con 0x7fac18158f80 2024-04-23T18:24:24.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac1e000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fac18070d40 con 0x7fac180c9850 2024-04-23T18:24:24.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac1e000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fac18071d20 con 0x7fac18071940 2024-04-23T18:24:24.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac17e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fac180c9850 0x7fac180c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac0ea00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fac18158f80 0x7fac180ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:55636/0 (socket says 172.21.15.28:55636) 2024-04-23T18:24:24.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac17400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac18071940 0x7fac18073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac0ea00640 1 -- 172.21.15.28:0/4214875087 learned_addr learned my addr 172.21.15.28:0/4214875087 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:24:24.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac17400640 1 -- 172.21.15.28:0/4214875087 >> v2:172.21.15.137:3300/0 conn(0x7fac180c9850 msgr2=0x7fac180c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:24.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac17400640 1 --2- 172.21.15.28:0/4214875087 >> v2:172.21.15.137:3300/0 conn(0x7fac180c9850 0x7fac180c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac17400640 1 -- 172.21.15.28:0/4214875087 >> v1:172.21.15.137:6789/0 conn(0x7fac18158f80 legacy=0x7fac180ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.753+0000 7fac17400640 1 -- 172.21.15.28:0/4214875087 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac18159410 con 0x7fac18071940 2024-04-23T18:24:24.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac17400640 1 --2- 172.21.15.28:0/4214875087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac18071940 0x7fac18073c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac080097c0 tx=0x7fac0801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af37d32cb7359148 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:24.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac16a00640 1 -- 172.21.15.28:0/4214875087 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac080b5070 con 0x7fac18071940 2024-04-23T18:24:24.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac16a00640 1 -- 172.21.15.28:0/4214875087 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac080a8990 con 0x7fac18071940 2024-04-23T18:24:24.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac16a00640 1 -- 172.21.15.28:0/4214875087 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac080a8d60 con 0x7fac18071940 2024-04-23T18:24:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac1e000640 1 -- 172.21.15.28:0/4214875087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac18071940 msgr2=0x7fac18073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac1e000640 1 --2- 172.21.15.28:0/4214875087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac18071940 0x7fac18073c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac080097c0 tx=0x7fac0801ec90 comp rx=0 tx=0).stop 2024-04-23T18:24:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac1e000640 1 -- 172.21.15.28:0/4214875087 shutdown_connections 2024-04-23T18:24:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac1e000640 1 --2- 172.21.15.28:0/4214875087 >> v2:172.21.15.137:3300/0 conn(0x7fac180c9850 0x7fac180c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac1e000640 1 --2- 172.21.15.28:0/4214875087 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac18071940 0x7fac18073c70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac1e000640 1 -- 172.21.15.28:0/4214875087 >> 172.21.15.28:0/4214875087 conn(0x7fac18075e30 msgr2=0x7fac180676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac1e000640 1 -- 172.21.15.28:0/4214875087 shutdown_connections 2024-04-23T18:24:24.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac1e000640 1 -- 172.21.15.28:0/4214875087 wait complete. 2024-04-23T18:24:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac1e000640 1 Processor -- start 2024-04-23T18:24:24.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.757+0000 7fac1e000640 1 -- start start 2024-04-23T18:24:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac1e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac18071940 0x7fac181f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac1e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac180c9850 0x7fac1814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac1e000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac18155f60 0x7fac181541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac1e000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fac18159cb0 con 0x7fac18155f60 2024-04-23T18:24:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac1e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac181599d0 con 0x7fac180c9850 2024-04-23T18:24:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac1e000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fac180cc680 con 0x7fac18071940 2024-04-23T18:24:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac17e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac18155f60 0x7fac181541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac17e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac18155f60 0x7fac181541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50814/0 (socket says 172.21.15.28:50814) 2024-04-23T18:24:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac17e00640 1 -- 172.21.15.28:0/2270297895 learned_addr learned my addr 172.21.15.28:0/2270297895 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac17400640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac18071940 0x7fac181f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac0ea00640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac180c9850 0x7fac1814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac17e00640 1 -- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac18071940 msgr2=0x7fac181f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac17e00640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac18071940 0x7fac181f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac17e00640 1 -- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac180c9850 msgr2=0x7fac1814ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac17e00640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac180c9850 0x7fac1814ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac17e00640 1 -- 172.21.15.28:0/2270297895 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac18155170 con 0x7fac18155f60 2024-04-23T18:24:24.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac17e00640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac18155f60 0x7fac181541f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fac10009dd0 tx=0x7fac1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:24.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac0fe00640 1 -- 172.21.15.28:0/2270297895 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10018020 con 0x7fac18155f60 2024-04-23T18:24:24.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac0fe00640 1 -- 172.21.15.28:0/2270297895 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac10014480 con 0x7fac18155f60 2024-04-23T18:24:24.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac1e000640 1 -- 172.21.15.28:0/2270297895 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac181553e0 con 0x7fac18155f60 2024-04-23T18:24:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac0fe00640 1 -- 172.21.15.28:0/2270297895 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10014870 con 0x7fac18155f60 2024-04-23T18:24:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.761+0000 7fac1e000640 1 -- 172.21.15.28:0/2270297895 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac181539f0 con 0x7fac18155f60 2024-04-23T18:24:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0fe00640 1 -- 172.21.15.28:0/2270297895 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac1001b020 con 0x7fac18155f60 2024-04-23T18:24:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0fe00640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fabf4068380 0x7fabf406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0fe00640 1 -- 172.21.15.28:0/2270297895 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fac10087960 con 0x7fac18155f60 2024-04-23T18:24:24.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac17400640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fabf4068380 0x7fabf406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac2148a000 1 Processor -- start 2024-04-23T18:24:24.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac2148a000 1 -- start start 2024-04-23T18:24:24.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac17400640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fabf4068380 0x7fabf406a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fac080b2000 tx=0x7fac08008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:24.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac2148a000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b23a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac2148a000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b23a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac2148a000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23e1120 0x5633b23e1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac2148a000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5633b21ed660 con 0x5633b23a5f00 2024-04-23T18:24:24.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac2148a000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5633b21925d0 con 0x5633b23e1120 2024-04-23T18:24:24.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac2148a000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5633b21e9620 con 0x5633b23dc8a0 2024-04-23T18:24:24.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b23a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b23a62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50822/0 (socket says 172.21.15.28:50822) 2024-04-23T18:24:24.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0ea00640 1 -- 172.21.15.28:0/234141928 learned_addr learned my addr 172.21.15.28:0/234141928 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:24.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac17400640 1 --2- 172.21.15.28:0/234141928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b23a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac17e00640 1 --2- 172.21.15.28:0/234141928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23e1120 0x5633b23e1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0ea00640 1 -- 172.21.15.28:0/234141928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 msgr2=0x5633b23a59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:24.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0ea00640 1 --2- 172.21.15.28:0/234141928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b23a59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0ea00640 1 -- 172.21.15.28:0/234141928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23e1120 msgr2=0x5633b23e1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:24.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0ea00640 1 --2- 172.21.15.28:0/234141928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23e1120 0x5633b23e1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0ea00640 1 -- 172.21.15.28:0/234141928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b21c6bd0 con 0x5633b23a5f00 2024-04-23T18:24:24.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac17e00640 1 --2- 172.21.15.28:0/234141928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23e1120 0x5633b23e1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:24:24.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac0ea00640 1 --2- 172.21.15.28:0/234141928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b23a62e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fac00001490 tx=0x7fac00001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3adf403545fa7c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:24.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac07e00640 1 -- 172.21.15.28:0/234141928 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00019070 con 0x5633b23a5f00 2024-04-23T18:24:24.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac07e00640 1 -- 172.21.15.28:0/234141928 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac00005ad0 con 0x5633b23a5f00 2024-04-23T18:24:24.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.765+0000 7fac07e00640 1 -- 172.21.15.28:0/234141928 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac000070d0 con 0x5633b23a5f00 2024-04-23T18:24:24.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 -- 172.21.15.28:0/234141928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 msgr2=0x5633b23a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 --2- 172.21.15.28:0/234141928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b23a62e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fac00001490 tx=0x7fac00001950 comp rx=0 tx=0).stop 2024-04-23T18:24:24.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 -- 172.21.15.28:0/234141928 shutdown_connections 2024-04-23T18:24:24.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 --2- 172.21.15.28:0/234141928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23e1120 0x5633b23e1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 --2- 172.21.15.28:0/234141928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b23a62e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 --2- 172.21.15.28:0/234141928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b23a59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 -- 172.21.15.28:0/234141928 >> 172.21.15.28:0/234141928 conn(0x5633b2287b00 msgr2=0x5633b23deee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:24.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 -- 172.21.15.28:0/234141928 shutdown_connections 2024-04-23T18:24:24.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 -- 172.21.15.28:0/234141928 wait complete. 2024-04-23T18:24:24.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 -- start start 2024-04-23T18:24:24.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 Processor -- start 2024-04-23T18:24:24.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23a5f00 0x5633b23db650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b23dbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23e1120 0x5633b23a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5633b22aad40 con 0x5633b23e1120 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5633b21a7eb0 con 0x5633b23a5f00 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5633b21e82a0 con 0x5633b23dc8a0 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 10 client.0 _ll_register_callbacks cb 0x5633b238ba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac17e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23e1120 0x5633b23a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac17e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23e1120 0x5633b23a08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50830/0 (socket says 172.21.15.28:50830) 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac17e00640 1 -- 172.21.15.28:0/2984471950 learned_addr learned my addr 172.21.15.28:0/2984471950 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac17400640 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23a5f00 0x5633b23db650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac0ea00640 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b23dbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac17e00640 1 -- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 msgr2=0x5633b23dbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:24.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac17e00640 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b23dbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac17e00640 1 -- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23a5f00 msgr2=0x5633b23db650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac17e00640 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23a5f00 0x5633b23db650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac17e00640 1 -- 172.21.15.28:0/2984471950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b2233b30 con 0x5633b23e1120 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac17e00640 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23e1120 0x5633b23a08d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fac10056ff0 tx=0x7fac10057430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05b4d1452d8d994 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac04c00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac04c00640 1 -- 172.21.15.28:0/2984471950 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1006f070 con 0x5633b23e1120 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac04c00640 1 -- 172.21.15.28:0/2984471950 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fac1005fcd0 con 0x5633b23e1120 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 -- 172.21.15.28:0/2984471950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5633b2187060 con 0x5633b23e1120 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac04c00640 1 -- 172.21.15.28:0/2984471950 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fac1006fb60 con 0x5633b23e1120 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 10 client.5220 fetch_fsmap learned FSMap version 15 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac2148a000 1 -- 172.21.15.28:0/2984471950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5633b218cb70 con 0x5633b23e1120 2024-04-23T18:24:24.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.769+0000 7fac04c00640 1 -- 172.21.15.28:0/2984471950 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5633b2187060 con 0x5633b23e1120 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac04c00640 1 -- 172.21.15.28:0/2984471950 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fac10056740 con 0x5633b23e1120 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 10 client.5220 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 10 client.5220 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 20 client.5220 populate_metadata read hostname 'smithi028' 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5633b23a1670 0x5633b23a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 4 client.5220 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 -- 172.21.15.28:0/2984471950 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633b21c5e30 con 0x5633b23a1670 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac17400640 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5633b23a1670 0x5633b23a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac17400640 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5633b23a1670 0x5633b23a1a50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9177b0fecc2e0778 server_cookie=c0362d9fc9052441 in_seq=0 out_seq=0 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac04c00640 10 client.5220 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac04c00640 1 -- 172.21.15.28:0/2984471950 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5633b21c5e30 con 0x5633b23a1670 2024-04-23T18:24:24.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac04c00640 10 client.5220 handle_command_reply: tid=0 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 client.5220 shutdown 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 -- 172.21.15.28:0/2984471950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23e1120 msgr2=0x5633b23a08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23e1120 0x5633b23a08d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fac10056ff0 tx=0x7fac10057430 comp rx=0 tx=0).stop 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 -- 172.21.15.28:0/2984471950 shutdown_connections 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5633b23a1670 0x5633b23a1a50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b23dbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23e1120 0x5633b23a08d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 --2- 172.21.15.28:0/2984471950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23a5f00 0x5633b23db650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac04c00640 0 client.5220 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 -- 172.21.15.28:0/2984471950 >> 172.21.15.28:0/2984471950 conn(0x5633b2287b00 msgr2=0x5633b23e09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 -- 172.21.15.28:0/2984471950 shutdown_connections 2024-04-23T18:24:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 1 -- 172.21.15.28:0/2984471950 wait complete. 2024-04-23T18:24:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.773+0000 7fac2148a000 20 client.5220 trim_cache size 0 max 16384 2024-04-23T18:24:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 Processor -- start 2024-04-23T18:24:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 -- start start 2024-04-23T18:24:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23a5f00 0x5633b244aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23dc8a0 0x5633b244b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23e1120 0x5633b244b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fac181fdf80 con 0x5633b23dc8a0 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac181f54a0 con 0x5633b23a5f00 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fac181fd8d0 con 0x5633b23e1120 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac0ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23dc8a0 0x5633b244b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac0ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23dc8a0 0x5633b244b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50846/0 (socket says 172.21.15.28:50846) 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac0ea00640 1 -- 172.21.15.28:0/1826603326 learned_addr learned my addr 172.21.15.28:0/1826603326 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac17e00640 1 --2- 172.21.15.28:0/1826603326 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23e1120 0x5633b244b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac17400640 1 --2- 172.21.15.28:0/1826603326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23a5f00 0x5633b244aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac0ea00640 1 -- 172.21.15.28:0/1826603326 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23e1120 msgr2=0x5633b244b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac0ea00640 1 --2- 172.21.15.28:0/1826603326 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23e1120 0x5633b244b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac0ea00640 1 -- 172.21.15.28:0/1826603326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23a5f00 msgr2=0x5633b244aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac0ea00640 1 --2- 172.21.15.28:0/1826603326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23a5f00 0x5633b244aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac0ea00640 1 -- 172.21.15.28:0/1826603326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633b226f5e0 con 0x5633b23dc8a0 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac17400640 1 --2- 172.21.15.28:0/1826603326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23a5f00 0x5633b244aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:24:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac0ea00640 1 --2- 172.21.15.28:0/1826603326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23dc8a0 0x5633b244b030 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fac00013000 tx=0x7fac00001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8afe4fda5099a2e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac07400640 1 -- 172.21.15.28:0/1826603326 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00019040 con 0x5633b23dc8a0 2024-04-23T18:24:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac07400640 1 -- 172.21.15.28:0/1826603326 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac00024070 con 0x5633b23dc8a0 2024-04-23T18:24:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac07400640 1 -- 172.21.15.28:0/1826603326 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac000047f0 con 0x5633b23dc8a0 2024-04-23T18:24:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 -- 172.21.15.28:0/1826603326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23dc8a0 msgr2=0x5633b244b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 --2- 172.21.15.28:0/1826603326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23dc8a0 0x5633b244b030 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fac00013000 tx=0x7fac00001e80 comp rx=0 tx=0).stop 2024-04-23T18:24:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 -- 172.21.15.28:0/1826603326 shutdown_connections 2024-04-23T18:24:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 --2- 172.21.15.28:0/1826603326 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23e1120 0x5633b244b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 --2- 172.21.15.28:0/1826603326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23dc8a0 0x5633b244b030 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 --2- 172.21.15.28:0/1826603326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23a5f00 0x5633b244aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 -- 172.21.15.28:0/1826603326 >> 172.21.15.28:0/1826603326 conn(0x5633b2287b00 msgr2=0x5633b23a3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 -- 172.21.15.28:0/1826603326 shutdown_connections 2024-04-23T18:24:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.793+0000 7fac2148a000 1 -- 172.21.15.28:0/1826603326 wait complete. 2024-04-23T18:24:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 -- start start 2024-04-23T18:24:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 Processor -- start 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b244ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b244f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23e1120 0x5633b244fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x5633b21ec970 con 0x5633b23a5f00 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5633b21a28f0 con 0x5633b23e1120 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5633b21f1c90 con 0x5633b23dc8a0 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 10 client.0 _ll_register_callbacks cb 0x7fac10053610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac17400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b244ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac17400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b244ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50860/0 (socket says 172.21.15.28:50860) 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac17400640 1 -- 172.21.15.28:0/2905740314 learned_addr learned my addr 172.21.15.28:0/2905740314 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac0ea00640 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b244f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac17e00640 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23e1120 0x5633b244fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac17400640 1 -- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 msgr2=0x5633b244f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac17400640 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b244f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac17400640 1 -- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23e1120 msgr2=0x5633b244fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:24:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac17400640 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23e1120 0x5633b244fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac17400640 1 -- 172.21.15.28:0/2905740314 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633b217fae0 con 0x5633b23a5f00 2024-04-23T18:24:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac0ea00640 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b244f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:24:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac17400640 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b244ed10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fac0801c8c0 tx=0x7fac0801d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2763eb5f84c528 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:24:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac04c00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:24:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac04c00640 1 -- 172.21.15.28:0/2905740314 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac080b5040 con 0x5633b23a5f00 2024-04-23T18:24:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 -- 172.21.15.28:0/2905740314 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac00024070 con 0x5633b23a5f00 2024-04-23T18:24:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac04c00640 1 -- 172.21.15.28:0/2905740314 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fac080b0890 con 0x5633b23a5f00 2024-04-23T18:24:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac04c00640 1 -- 172.21.15.28:0/2905740314 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fac080dc050 con 0x5633b23a5f00 2024-04-23T18:24:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 10 client.5226 fetch_fsmap learned FSMap version 15 2024-04-23T18:24:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 -- 172.21.15.28:0/2905740314 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5633b2182d80 con 0x5633b23a5f00 2024-04-23T18:24:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac04c00640 1 -- 172.21.15.28:0/2905740314 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac00024070 con 0x5633b23a5f00 2024-04-23T18:24:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac04c00640 1 -- 172.21.15.28:0/2905740314 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fac080df020 con 0x5633b23a5f00 2024-04-23T18:24:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 10 client.5226 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:24:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 10 client.5226 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:24:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 20 client.5226 populate_metadata read hostname 'smithi028' 2024-04-23T18:24:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5633b24509f0 0x5633b2450e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:24:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 4 client.5226 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "eb68884", "release": true, "await": true}] 2024-04-23T18:24:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac2148a000 1 -- 172.21.15.28:0/2905740314 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "quiesce db", "set_id": "eb68884", "release": true, "await": true}) -- 0x5633b218b0d0 con 0x5633b24509f0 2024-04-23T18:24:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.797+0000 7fac0ea00640 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5633b24509f0 0x5633b2450e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:24:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.801+0000 7fac0ea00640 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5633b24509f0 0x5633b2450e00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d6ff60c0d5d1a3 server_cookie=366b29af914f9659 in_seq=0 out_seq=0 2024-04-23T18:24:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.801+0000 7fac04c00640 10 client.5226 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac04c00640 1 -- 172.21.15.28:0/2905740314 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x5633b218b0d0 con 0x5633b24509f0 2024-04-23T18:24:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac04c00640 10 client.5226 handle_command_reply: tid=0 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 1 client.5226 shutdown 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 1 -- 172.21.15.28:0/2905740314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 msgr2=0x5633b244ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b244ed10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fac0801c8c0 tx=0x7fac0801d4d0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 1 -- 172.21.15.28:0/2905740314 shutdown_connections 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5633b24509f0 0x5633b2450e00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5633b23dc8a0 0x5633b244f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5633b23e1120 0x5633b244fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 1 --2- 172.21.15.28:0/2905740314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5633b23a5f00 0x5633b244ed10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac04c00640 0 client.5226 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 1 -- 172.21.15.28:0/2905740314 >> 172.21.15.28:0/2905740314 conn(0x5633b2287b00 msgr2=0x5633b239fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 1 -- 172.21.15.28:0/2905740314 shutdown_connections 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 1 -- 172.21.15.28:0/2905740314 wait complete. 2024-04-23T18:24:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac2148a000 20 client.5226 trim_cache size 0 max 16384 2024-04-23T18:24:24.803 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:24:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 15, 2024-04-23T18:24:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: "leader": 4297, 2024-04-23T18:24:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: "set_version": 8, 2024-04-23T18:24:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: "sets": { 2024-04-23T18:24:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: "eb68884": { 2024-04-23T18:24:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: "version": 8, 2024-04-23T18:24:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: "age_ref": 0.0, 2024-04-23T18:24:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:24:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RELEASED", 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: "timeout": 60.0, 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: "expiration": 79.5, 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: "members": { 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: "file:/": { 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: "excluded": false, 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RELEASED", 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:24:24.805 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:24:24.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 -- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fabf4068380 msgr2=0x7fabf406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fabf4068380 0x7fabf406a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fac080b2000 tx=0x7fac08008040 comp rx=0 tx=0).stop 2024-04-23T18:24:24.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 -- 172.21.15.28:0/2270297895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac18155f60 msgr2=0x7fac181541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:24:24.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac18155f60 0x7fac181541f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fac10009dd0 tx=0x7fac1000c490 comp rx=0 tx=0).stop 2024-04-23T18:24:24.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 -- 172.21.15.28:0/2270297895 shutdown_connections 2024-04-23T18:24:24.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fabf4068380 0x7fabf406a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fac18155f60 0x7fac181541f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac180c9850 0x7fac1814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 --2- 172.21.15.28:0/2270297895 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac18071940 0x7fac181f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:24:24.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 -- 172.21.15.28:0/2270297895 >> 172.21.15.28:0/2270297895 conn(0x7fac18075e30 msgr2=0x7fac18158500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:24:24.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 -- 172.21.15.28:0/2270297895 shutdown_connections 2024-04-23T18:24:24.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:24:24.805+0000 7fac1e000640 1 -- 172.21.15.28:0/2270297895 wait complete. 2024-04-23T18:24:24.809 INFO:tasks.workunit.client.0.smithi028.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-23T18:24:24.822 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'eb68884', seconds elapsed: 20.8 2024-04-23T18:24:24.896 INFO:tasks.workunit.client.0.smithi028.stdout: Iozone: Performance Test of File I/O 2024-04-23T18:24:24.896 INFO:tasks.workunit.client.0.smithi028.stdout: Version $Revision: 3.489 $ 2024-04-23T18:24:24.896 INFO:tasks.workunit.client.0.smithi028.stdout: Compiled for 64 bit mode. 2024-04-23T18:24:24.896 INFO:tasks.workunit.client.0.smithi028.stdout: Build: linux-AMD64 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Run began: Tue Apr 23 18:24:24 2024 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Include close in write timing 2024-04-23T18:24:24.897 INFO:tasks.workunit.client.0.smithi028.stdout: Include fsync in write timing 2024-04-23T18:24:24.898 INFO:tasks.workunit.client.0.smithi028.stdout: File size set to 1048576 kB 2024-04-23T18:24:24.898 INFO:tasks.workunit.client.0.smithi028.stdout: Record Size 16 kB 2024-04-23T18:24:24.898 INFO:tasks.workunit.client.0.smithi028.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-23T18:24:24.898 INFO:tasks.workunit.client.0.smithi028.stdout: Output is in kBytes/sec 2024-04-23T18:24:24.898 INFO:tasks.workunit.client.0.smithi028.stdout: Time Resolution = 0.000001 seconds. 2024-04-23T18:24:24.898 INFO:tasks.workunit.client.0.smithi028.stdout: Processor cache size set to 1024 kBytes. 2024-04-23T18:24:24.898 INFO:tasks.workunit.client.0.smithi028.stdout: Processor cache line size set to 32 bytes. 2024-04-23T18:24:24.898 INFO:tasks.workunit.client.0.smithi028.stdout: File stride size set to 17 * record size. 2024-04-23T18:24:24.898 INFO:tasks.workunit.client.0.smithi028.stdout: Throughput test with 1 process 2024-04-23T18:24:24.898 INFO:tasks.workunit.client.0.smithi028.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-04-23T18:24:28.016 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:24:28.021 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:24:29.686 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:29.686 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 initial writers = 219115.53 kB/sec 2024-04-23T18:24:29.686 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 initial writers = 219092.22 kB/sec 2024-04-23T18:24:29.686 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 219115.53 kB/sec 2024-04-23T18:24:29.686 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 219115.53 kB/sec 2024-04-23T18:24:29.686 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 219115.53 kB/sec 2024-04-23T18:24:29.686 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 1048576.00 kB 2024-04-23T18:24:38.092 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:38.092 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 rewriters = 237052.25 kB/sec 2024-04-23T18:24:38.092 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 rewriters = 237026.85 kB/sec 2024-04-23T18:24:38.092 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 237052.25 kB/sec 2024-04-23T18:24:38.093 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 237052.25 kB/sec 2024-04-23T18:24:38.093 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 237052.25 kB/sec 2024-04-23T18:24:38.093 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 1048576.00 kB 2024-04-23T18:24:41.553 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:41.553 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 readers = 3561838.25 kB/sec 2024-04-23T18:24:41.553 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 readers = 3556336.93 kB/sec 2024-04-23T18:24:41.553 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 3561838.25 kB/sec 2024-04-23T18:24:41.553 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 3561838.25 kB/sec 2024-04-23T18:24:41.553 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 3561838.25 kB/sec 2024-04-23T18:24:41.553 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 1048576.00 kB 2024-04-23T18:24:44.098 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:44.098 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 re-readers = 2772155.75 kB/sec 2024-04-23T18:24:44.098 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 re-readers = 2768789.10 kB/sec 2024-04-23T18:24:44.098 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 2772155.75 kB/sec 2024-04-23T18:24:44.098 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 2772155.75 kB/sec 2024-04-23T18:24:44.099 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 2772155.75 kB/sec 2024-04-23T18:24:44.099 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 1048576.00 kB 2024-04-23T18:24:50.617 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:50.617 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:50.617 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:50.617 INFO:tasks.workunit.client.0.smithi028.stdout:iozone test complete. 2024-04-23T18:24:50.618 INFO:tasks.workunit.client.0.smithi028.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-23T18:24:50.684 INFO:tasks.workunit.client.0.smithi028.stdout: Iozone: Performance Test of File I/O 2024-04-23T18:24:50.684 INFO:tasks.workunit.client.0.smithi028.stdout: Version $Revision: 3.489 $ 2024-04-23T18:24:50.684 INFO:tasks.workunit.client.0.smithi028.stdout: Compiled for 64 bit mode. 2024-04-23T18:24:50.684 INFO:tasks.workunit.client.0.smithi028.stdout: Build: linux-AMD64 2024-04-23T18:24:50.684 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:50.684 INFO:tasks.workunit.client.0.smithi028.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: Run began: Tue Apr 23 18:24:50 2024 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: Include close in write timing 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: Include fsync in write timing 2024-04-23T18:24:50.685 INFO:tasks.workunit.client.0.smithi028.stdout: File size set to 1048576 kB 2024-04-23T18:24:50.686 INFO:tasks.workunit.client.0.smithi028.stdout: Record Size 1024 kB 2024-04-23T18:24:50.686 INFO:tasks.workunit.client.0.smithi028.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-23T18:24:50.686 INFO:tasks.workunit.client.0.smithi028.stdout: Output is in kBytes/sec 2024-04-23T18:24:50.686 INFO:tasks.workunit.client.0.smithi028.stdout: Time Resolution = 0.000001 seconds. 2024-04-23T18:24:50.686 INFO:tasks.workunit.client.0.smithi028.stdout: Processor cache size set to 1024 kBytes. 2024-04-23T18:24:50.686 INFO:tasks.workunit.client.0.smithi028.stdout: Processor cache line size set to 32 bytes. 2024-04-23T18:24:50.686 INFO:tasks.workunit.client.0.smithi028.stdout: File stride size set to 17 * record size. 2024-04-23T18:24:50.686 INFO:tasks.workunit.client.0.smithi028.stdout: Throughput test with 1 process 2024-04-23T18:24:50.686 INFO:tasks.workunit.client.0.smithi028.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-04-23T18:24:55.599 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:24:55.599 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 initial writers = 215296.91 kB/sec 2024-04-23T18:24:55.599 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 initial writers = 215273.39 kB/sec 2024-04-23T18:24:55.599 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 215296.91 kB/sec 2024-04-23T18:24:55.599 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 215296.91 kB/sec 2024-04-23T18:24:55.599 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 215296.91 kB/sec 2024-04-23T18:24:55.600 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 1048576.00 kB 2024-04-23T18:24:58.080 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:24:58.084 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:25:03.271 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:25:03.271 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 rewriters = 217140.05 kB/sec 2024-04-23T18:25:03.272 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 rewriters = 217115.67 kB/sec 2024-04-23T18:25:03.272 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 217140.05 kB/sec 2024-04-23T18:25:03.272 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 217140.05 kB/sec 2024-04-23T18:25:03.272 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 217140.05 kB/sec 2024-04-23T18:25:03.272 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 1048576.00 kB 2024-04-23T18:25:06.753 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:25:06.753 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 readers = 5396854.00 kB/sec 2024-04-23T18:25:06.753 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 readers = 5380625.01 kB/sec 2024-04-23T18:25:06.754 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 5396854.00 kB/sec 2024-04-23T18:25:06.754 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 5396854.00 kB/sec 2024-04-23T18:25:06.754 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 5396854.00 kB/sec 2024-04-23T18:25:06.754 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 1048576.00 kB 2024-04-23T18:25:09.126 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:25:09.126 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 re-readers = 3694056.25 kB/sec 2024-04-23T18:25:09.126 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 re-readers = 3686964.51 kB/sec 2024-04-23T18:25:09.126 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 3694056.25 kB/sec 2024-04-23T18:25:09.126 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 3694056.25 kB/sec 2024-04-23T18:25:09.127 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 3694056.25 kB/sec 2024-04-23T18:25:09.127 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 1048576.00 kB 2024-04-23T18:25:15.573 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:25:15.573 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:25:15.573 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:25:15.573 INFO:tasks.workunit.client.0.smithi028.stdout:iozone test complete. 2024-04-23T18:25:15.574 INFO:tasks.workunit.client.0.smithi028.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-23T18:25:15.641 INFO:tasks.workunit.client.0.smithi028.stdout: Iozone: Performance Test of File I/O 2024-04-23T18:25:15.641 INFO:tasks.workunit.client.0.smithi028.stdout: Version $Revision: 3.489 $ 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: Compiled for 64 bit mode. 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: Build: linux-AMD64 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-23T18:25:15.642 INFO:tasks.workunit.client.0.smithi028.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: Run began: Tue Apr 23 18:25:15 2024 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: Include close in write timing 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: Include fsync in write timing 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: File size set to 10485760 kB 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: Record Size 1024 kB 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: Output is in kBytes/sec 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: Time Resolution = 0.000001 seconds. 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: Processor cache size set to 1024 kBytes. 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: Processor cache line size set to 32 bytes. 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: File stride size set to 17 * record size. 2024-04-23T18:25:15.643 INFO:tasks.workunit.client.0.smithi028.stdout: Throughput test with 1 process 2024-04-23T18:25:15.644 INFO:tasks.workunit.client.0.smithi028.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-04-23T18:25:28.443 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:25:28.448 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:25:37.251 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-23T18:25:37.252 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.55 2024-04-23T18:25:37.252 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:25:37.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.603+0000 7f5c01600640 1 Processor -- start 2024-04-23T18:25:37.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.603+0000 7f5c01600640 1 -- start start 2024-04-23T18:25:37.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.607+0000 7f5c01600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5bfc1597d0 0x7f5bfc15ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.607+0000 7f5bfb400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5bfc0c7550 0x7f5bfc0cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:54666/0 (socket says 172.21.15.28:54666) 2024-04-23T18:25:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.607+0000 7f5bfbe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5bfc1597d0 0x7f5bfc15ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.607+0000 7f5bfbe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5bfc1597d0 0x7f5bfc15ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59264/0 (socket says 172.21.15.28:59264) 2024-04-23T18:25:37.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.615+0000 7f5c01600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc162e10 con 0x7f5bfc160f70 2024-04-23T18:25:37.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.615+0000 7f5c01600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc1630f0 con 0x7f5bfc0c7550 2024-04-23T18:25:37.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.619+0000 7f5bfb400640 1 -- 172.21.15.28:0/3921149048 learned_addr learned my addr 172.21.15.28:0/3921149048 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:25:37.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.619+0000 7f5c01600640 1 -- 172.21.15.28:0/3921149048 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f5bfc0c7f40 con 0x7f5bfc1597d0 2024-04-23T18:25:37.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.619+0000 7f5bfaa00640 1 -- 172.21.15.28:0/3921149048 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931989581 0 0) 0x7f5bfc1630f0 con 0x7f5bfc0c7550 2024-04-23T18:25:37.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.619+0000 7f5bfaa00640 1 -- 172.21.15.28:0/3921149048 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5be0003530 con 0x7f5bfc0c7550 2024-04-23T18:25:37.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.619+0000 7f5bfbe00640 1 -- 172.21.15.28:0/3921149048 >> v1:172.21.15.137:6789/0 conn(0x7f5bfc0c7550 legacy=0x7f5bfc0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:37.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.619+0000 7f5bfbe00640 1 -- 172.21.15.28:0/3921149048 >> v1:172.21.15.28:6789/0 conn(0x7f5bfc160f70 legacy=0x7f5bfc1613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:25:37.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.619+0000 7f5bfbe00640 1 -- 172.21.15.28:0/3921149048 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc1633d0 con 0x7f5bfc1597d0 2024-04-23T18:25:37.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.623+0000 7f5bfbe00640 1 --2- 172.21.15.28:0/3921149048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc1597d0 0x7f5bfc15ffa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0097c0 tx=0x7f5bec01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5ad002f6b509ec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:25:37.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.631+0000 7f5bfaa00640 1 -- 172.21.15.28:0/3921149048 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0b5070 con 0x7f5bfc1597d0 2024-04-23T18:25:37.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.631+0000 7f5bfaa00640 1 -- 172.21.15.28:0/3921149048 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bec0a8950 con 0x7f5bfc1597d0 2024-04-23T18:25:37.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.631+0000 7f5bfaa00640 1 -- 172.21.15.28:0/3921149048 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0a8d20 con 0x7f5bfc1597d0 2024-04-23T18:25:37.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.635+0000 7f5c01600640 1 -- 172.21.15.28:0/3921149048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc1597d0 msgr2=0x7f5bfc15ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:37.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.635+0000 7f5c01600640 1 --2- 172.21.15.28:0/3921149048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc1597d0 0x7f5bfc15ffa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0097c0 tx=0x7f5bec01ec50 comp rx=0 tx=0).stop 2024-04-23T18:25:37.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.635+0000 7f5c01600640 1 -- 172.21.15.28:0/3921149048 shutdown_connections 2024-04-23T18:25:37.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.635+0000 7f5c01600640 1 --2- 172.21.15.28:0/3921149048 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc1597d0 0x7f5bfc15ffa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:37.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.635+0000 7f5c01600640 1 -- 172.21.15.28:0/3921149048 >> 172.21.15.28:0/3921149048 conn(0x7f5bfc0676e0 msgr2=0x7f5bfc067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:25:37.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.635+0000 7f5c01600640 1 -- 172.21.15.28:0/3921149048 shutdown_connections 2024-04-23T18:25:37.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.635+0000 7f5c01600640 1 -- 172.21.15.28:0/3921149048 wait complete. 2024-04-23T18:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.635+0000 7f5c01600640 1 Processor -- start 2024-04-23T18:25:37.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c01600640 1 -- start start 2024-04-23T18:25:37.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c01600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bfc0c7550 0x7f5bfc0c1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:37.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c01600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc1597d0 0x7f5bfc0717f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:37.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c01600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc160f70 0x7f5bfc1f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:37.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c01600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc160ae0 con 0x7f5bfc160f70 2024-04-23T18:25:37.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c01600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc1604e0 con 0x7f5bfc1597d0 2024-04-23T18:25:37.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c01600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5bfc163990 con 0x7f5bfc0c7550 2024-04-23T18:25:37.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5bfbe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bfc0c7550 0x7f5bfc0c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:37.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c00c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc160f70 0x7f5bfc1f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:37.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c00c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc160f70 0x7f5bfc1f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59276/0 (socket says 172.21.15.28:59276) 2024-04-23T18:25:37.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c00c00640 1 -- 172.21.15.28:0/3850027514 learned_addr learned my addr 172.21.15.28:0/3850027514 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:25:37.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c00c00640 1 -- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bfc0c7550 msgr2=0x7f5bfc0c1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:37.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c00c00640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bfc0c7550 0x7f5bfc0c1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:37.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c00c00640 1 -- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc1597d0 msgr2=0x7f5bfc0717f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T18:25:37.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c00c00640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc1597d0 0x7f5bfc0717f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:37.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c00c00640 1 -- 172.21.15.28:0/3850027514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc1f9190 con 0x7f5bfc160f70 2024-04-23T18:25:37.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c00c00640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc160f70 0x7f5bfc1f55e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400b9c0 tx=0x7f5bf400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:25:37.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5bf3e00640 1 -- 172.21.15.28:0/3850027514 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4019070 con 0x7f5bfc160f70 2024-04-23T18:25:37.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5bf3e00640 1 -- 172.21.15.28:0/3850027514 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf400cba0 con 0x7f5bfc160f70 2024-04-23T18:25:37.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5c01600640 1 -- 172.21.15.28:0/3850027514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bfc0c2b70 con 0x7f5bfc160f70 2024-04-23T18:25:37.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.639+0000 7f5bf3e00640 1 -- 172.21.15.28:0/3850027514 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4014440 con 0x7f5bfc160f70 2024-04-23T18:25:37.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.643+0000 7f5c01600640 1 -- 172.21.15.28:0/3850027514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bfc1ea970 con 0x7f5bfc160f70 2024-04-23T18:25:37.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.643+0000 7f5c01600640 1 -- 172.21.15.28:0/3850027514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bfc068cd0 con 0x7f5bfc160f70 2024-04-23T18:25:37.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.647+0000 7f5bf3e00640 1 -- 172.21.15.28:0/3850027514 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5bf401c070 con 0x7f5bfc160f70 2024-04-23T18:25:37.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.647+0000 7f5bf3e00640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5bdc0683b0 0x7f5bdc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:37.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.647+0000 7f5bf3e00640 1 -- 172.21.15.28:0/3850027514 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5bf4086e70 con 0x7f5bfc160f70 2024-04-23T18:25:37.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.647+0000 7f5bfbe00640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5bdc0683b0 0x7f5bdc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:37.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.647+0000 7f5bfbe00640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5bdc0683b0 0x7f5bdc06a870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0b2000 tx=0x7f5bec0aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:25:37.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:37.659+0000 7f5bf3e00640 1 -- 172.21.15.28:0/3850027514 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5bf4023020 con 0x7f5bfc160f70 2024-04-23T18:25:38.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.023+0000 7f5c01600640 1 -- 172.21.15.28:0/3850027514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bfc0c8100 con 0x7f5bfc160f70 2024-04-23T18:25:38.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.023+0000 7f5bf3e00640 1 -- 172.21.15.28:0/3850027514 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f5bf4056ac0 con 0x7f5bfc160f70 2024-04-23T18:25:38.019 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:25:38.019 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:25:38.020 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:25:38.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 -- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5bdc0683b0 msgr2=0x7f5bdc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:38.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5bdc0683b0 0x7f5bdc06a870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0b2000 tx=0x7f5bec0aa070 comp rx=0 tx=0).stop 2024-04-23T18:25:38.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 -- 172.21.15.28:0/3850027514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc160f70 msgr2=0x7f5bfc1f55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:38.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc160f70 0x7f5bfc1f55e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400b9c0 tx=0x7f5bf400be80 comp rx=0 tx=0).stop 2024-04-23T18:25:38.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 -- 172.21.15.28:0/3850027514 shutdown_connections 2024-04-23T18:25:38.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5bdc0683b0 0x7f5bdc06a870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5bfc160f70 0x7f5bfc1f55e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc1597d0 0x7f5bfc0717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 --2- 172.21.15.28:0/3850027514 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5bfc0c7550 0x7f5bfc0c1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 -- 172.21.15.28:0/3850027514 >> 172.21.15.28:0/3850027514 conn(0x7f5bfc0676e0 msgr2=0x7f5bfc067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:25:38.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 -- 172.21.15.28:0/3850027514 shutdown_connections 2024-04-23T18:25:38.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.027+0000 7f5c01600640 1 -- 172.21.15.28:0/3850027514 wait complete. 2024-04-23T18:25:38.052 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4297 quiesce db / --timeout 60 --expiration 87.55 --await-for 42.0' 2024-04-23T18:25:38.052 DEBUG:teuthology.orchestra.run.smithi028:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4297 quiesce db / --timeout 60 --expiration 87.55 --await-for 42.0 2024-04-23T18:25:38.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd919600640 1 Processor -- start 2024-04-23T18:25:38.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd919600640 1 -- start start 2024-04-23T18:25:38.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd919600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd90c0d9060 0x7fd90c0458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd919600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd90c0ded20 0x7fd90c0468c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd919600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd90c04b0f0 0x7fd90c04b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd919600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fd90c045df0 con 0x7fd90c04b0f0 2024-04-23T18:25:38.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd919600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd90c0dfd30 con 0x7fd90c0ded20 2024-04-23T18:25:38.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd919600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c0d9440 con 0x7fd90c0d9060 2024-04-23T18:25:38.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd918c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd90c04b0f0 0x7fd90c04b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd918c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd90c04b0f0 0x7fd90c04b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59284/0 (socket says 172.21.15.28:59284) 2024-04-23T18:25:38.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd918c00640 1 -- 172.21.15.28:0/928188520 learned_addr learned my addr 172.21.15.28:0/928188520 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:25:38.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd913400640 1 --2- 172.21.15.28:0/928188520 >> v2:172.21.15.137:3300/0 conn(0x7fd90c0ded20 0x7fd90c0468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd913e00640 1 --2- 172.21.15.28:0/928188520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd90c0d9060 0x7fd90c0458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd918c00640 1 -- 172.21.15.28:0/928188520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd90c0d9060 msgr2=0x7fd90c0458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:25:38.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd918c00640 1 --2- 172.21.15.28:0/928188520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd90c0d9060 0x7fd90c0458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd918c00640 1 -- 172.21.15.28:0/928188520 >> v2:172.21.15.137:3300/0 conn(0x7fd90c0ded20 msgr2=0x7fd90c0468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:25:38.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd918c00640 1 --2- 172.21.15.28:0/928188520 >> v2:172.21.15.137:3300/0 conn(0x7fd90c0ded20 0x7fd90c0468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.263+0000 7fd918c00640 1 -- 172.21.15.28:0/928188520 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c0df4d0 con 0x7fd90c04b0f0 2024-04-23T18:25:38.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.271+0000 7fd918c00640 1 --2- 172.21.15.28:0/928188520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd90c04b0f0 0x7fd90c04b500 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd914065520 tx=0x7fd914098d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c03412103457765 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:25:38.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.271+0000 7fd912a00640 1 -- 172.21.15.28:0/928188520 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914121ac0 con 0x7fd90c04b0f0 2024-04-23T18:25:38.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.271+0000 7fd912a00640 1 -- 172.21.15.28:0/928188520 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd914121ca0 con 0x7fd90c04b0f0 2024-04-23T18:25:38.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.271+0000 7fd912a00640 1 -- 172.21.15.28:0/928188520 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914129640 con 0x7fd90c04b0f0 2024-04-23T18:25:38.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.271+0000 7fd919600640 1 -- 172.21.15.28:0/928188520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd90c04b0f0 msgr2=0x7fd90c04b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:38.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.271+0000 7fd919600640 1 --2- 172.21.15.28:0/928188520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd90c04b0f0 0x7fd90c04b500 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd914065520 tx=0x7fd914098d40 comp rx=0 tx=0).stop 2024-04-23T18:25:38.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.275+0000 7fd919600640 1 -- 172.21.15.28:0/928188520 shutdown_connections 2024-04-23T18:25:38.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.275+0000 7fd919600640 1 --2- 172.21.15.28:0/928188520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd90c04b0f0 0x7fd90c04b500 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.275+0000 7fd919600640 1 --2- 172.21.15.28:0/928188520 >> v2:172.21.15.137:3300/0 conn(0x7fd90c0ded20 0x7fd90c0468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.275+0000 7fd919600640 1 --2- 172.21.15.28:0/928188520 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd90c0d9060 0x7fd90c0458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.275+0000 7fd919600640 1 -- 172.21.15.28:0/928188520 >> 172.21.15.28:0/928188520 conn(0x7fd90c0505e0 msgr2=0x7fd90c0509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:25:38.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.275+0000 7fd919600640 1 -- 172.21.15.28:0/928188520 shutdown_connections 2024-04-23T18:25:38.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.275+0000 7fd919600640 1 -- 172.21.15.28:0/928188520 wait complete. 2024-04-23T18:25:38.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.275+0000 7fd919600640 1 Processor -- start 2024-04-23T18:25:38.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.275+0000 7fd919600640 1 -- start start 2024-04-23T18:25:38.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd919600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd90c04b0f0 0x7fd90c0d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd919600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd90c0d9060 0x7fd90c034e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd919600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd90c0ded20 0x7fd90c0d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd919600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c04cc30 con 0x7fd90c04b0f0 2024-04-23T18:25:38.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd919600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c0463a0 con 0x7fd90c0ded20 2024-04-23T18:25:38.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd919600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c0062f0 con 0x7fd90c0d9060 2024-04-23T18:25:38.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd913e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd90c04b0f0 0x7fd90c0d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd913e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd90c04b0f0 0x7fd90c0d2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59290/0 (socket says 172.21.15.28:59290) 2024-04-23T18:25:38.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd913e00640 1 -- 172.21.15.28:0/4013044189 learned_addr learned my addr 172.21.15.28:0/4013044189 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:25:38.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd913400640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd90c0d9060 0x7fd90c034e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd918c00640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd90c0ded20 0x7fd90c0d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd913e00640 1 -- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd90c0d9060 msgr2=0x7fd90c034e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:38.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd913e00640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd90c0d9060 0x7fd90c034e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd913e00640 1 -- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd90c0ded20 msgr2=0x7fd90c0d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:38.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd913e00640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd90c0ded20 0x7fd90c0d0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd913e00640 1 -- 172.21.15.28:0/4013044189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c04e570 con 0x7fd90c04b0f0 2024-04-23T18:25:38.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd913e00640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd90c04b0f0 0x7fd90c0d2f10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd90800d800 tx=0x7fd90800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:25:38.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd907e00640 1 -- 172.21.15.28:0/4013044189 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908018020 con 0x7fd90c04b0f0 2024-04-23T18:25:38.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd907e00640 1 -- 172.21.15.28:0/4013044189 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9080096c0 con 0x7fd90c04b0f0 2024-04-23T18:25:38.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd907e00640 1 -- 172.21.15.28:0/4013044189 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908009ab0 con 0x7fd90c04b0f0 2024-04-23T18:25:38.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd919600640 1 -- 172.21.15.28:0/4013044189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90c04edd0 con 0x7fd90c04b0f0 2024-04-23T18:25:38.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.279+0000 7fd919600640 1 -- 172.21.15.28:0/4013044189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd90c04eaf0 con 0x7fd90c04b0f0 2024-04-23T18:25:38.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.283+0000 7fd907e00640 1 -- 172.21.15.28:0/4013044189 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd90801b020 con 0x7fd90c04b0f0 2024-04-23T18:25:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.283+0000 7fd907e00640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8f4068380 0x7fd8f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.283+0000 7fd91e06a000 1 Processor -- start 2024-04-23T18:25:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.283+0000 7fd907e00640 1 -- 172.21.15.28:0/4013044189 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd908087290 con 0x7fd90c04b0f0 2024-04-23T18:25:38.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.283+0000 7fd91e06a000 1 -- start start 2024-04-23T18:25:38.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.283+0000 7fd913400640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8f4068380 0x7fd8f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.283+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec3600 0x55a8cbec39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.283+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbec8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec8fe0 0x55a8cbec93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55a8cbd6f2a0 con 0x55a8cbec86c0 2024-04-23T18:25:38.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a8cbcd55f0 con 0x55a8cbec8fe0 2024-04-23T18:25:38.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55a8cbc70820 con 0x55a8cbec3600 2024-04-23T18:25:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd913400640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8f4068380 0x7fd8f406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0cfa60 tx=0x7fd900009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:25:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd913400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbec8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd913e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec3600 0x55a8cbec39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd913400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbec8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59300/0 (socket says 172.21.15.28:59300) 2024-04-23T18:25:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd913400640 1 -- 172.21.15.28:0/1124861587 learned_addr learned my addr 172.21.15.28:0/1124861587 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:25:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd918c00640 1 --2- 172.21.15.28:0/1124861587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec8fe0 0x55a8cbec93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd913400640 1 -- 172.21.15.28:0/1124861587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec3600 msgr2=0x55a8cbec39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:25:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd913400640 1 --2- 172.21.15.28:0/1124861587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec3600 0x55a8cbec39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd913400640 1 -- 172.21.15.28:0/1124861587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec8fe0 msgr2=0x55a8cbec93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:25:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd913400640 1 --2- 172.21.15.28:0/1124861587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec8fe0 0x55a8cbec93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd913400640 1 -- 172.21.15.28:0/1124861587 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8cbd1bc00 con 0x55a8cbec86c0 2024-04-23T18:25:38.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd913400640 1 --2- 172.21.15.28:0/1124861587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbec8aa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd900011de0 tx=0x7fd900014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c795938b3be0f77 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:25:38.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd904c00640 1 -- 172.21.15.28:0/1124861587 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900014bd0 con 0x55a8cbec86c0 2024-04-23T18:25:38.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd904c00640 1 -- 172.21.15.28:0/1124861587 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd900026070 con 0x55a8cbec86c0 2024-04-23T18:25:38.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd904c00640 1 -- 172.21.15.28:0/1124861587 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900004030 con 0x55a8cbec86c0 2024-04-23T18:25:38.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 -- 172.21.15.28:0/1124861587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 msgr2=0x55a8cbec8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:38.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1124861587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbec8aa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd900011de0 tx=0x7fd900014000 comp rx=0 tx=0).stop 2024-04-23T18:25:38.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 -- 172.21.15.28:0/1124861587 shutdown_connections 2024-04-23T18:25:38.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1124861587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec8fe0 0x55a8cbec93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1124861587 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbec8aa0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1124861587 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec3600 0x55a8cbec39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 -- 172.21.15.28:0/1124861587 >> 172.21.15.28:0/1124861587 conn(0x55a8cbec4470 msgr2=0x55a8cbec6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:25:38.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 -- 172.21.15.28:0/1124861587 shutdown_connections 2024-04-23T18:25:38.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 -- 172.21.15.28:0/1124861587 wait complete. 2024-04-23T18:25:38.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.287+0000 7fd91e06a000 1 -- start start 2024-04-23T18:25:38.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd91e06a000 1 Processor -- start 2024-04-23T18:25:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 0x55a8cbec29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec86c0 0x55a8cbec2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec8fe0 0x55a8cbece830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd91e06a000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55a8cbc80c60 con 0x55a8cbec8fe0 2024-04-23T18:25:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd91e06a000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a8cbd57bf0 con 0x55a8cbec3600 2024-04-23T18:25:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd91e06a000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55a8cbd92560 con 0x55a8cbec86c0 2024-04-23T18:25:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd91e06a000 10 client.0 _ll_register_callbacks cb 0x55a8cbcac570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:25:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd913e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 0x55a8cbec29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd913e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 0x55a8cbec29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:51522/0 (socket says 172.21.15.28:51522) 2024-04-23T18:25:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd913e00640 1 -- 172.21.15.28:0/1417997016 learned_addr learned my addr 172.21.15.28:0/1417997016 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:25:38.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd918c00640 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec8fe0 0x55a8cbece830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd913e00640 1 -- 172.21.15.28:0/1417997016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec86c0 msgr2=0x55a8cbec2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd913e00640 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec86c0 0x55a8cbec2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd913e00640 1 -- 172.21.15.28:0/1417997016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec8fe0 msgr2=0x55a8cbece830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd913e00640 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec8fe0 0x55a8cbece830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd913e00640 1 -- 172.21.15.28:0/1417997016 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8cbd10630 con 0x55a8cbec3600 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd918c00640 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec8fe0 0x55a8cbece830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd913e00640 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 0x55a8cbec29e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd9080094b0 tx=0x7fd90805f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a90a3fa31b8f2d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd8f9600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd8f9600640 1 -- 172.21.15.28:0/1417997016 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908083060 con 0x55a8cbec3600 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd8f9600640 1 -- 172.21.15.28:0/1417997016 <== mon.1 v2:172.21.15.137:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd908009c50 con 0x55a8cbec3600 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd91e06a000 1 -- 172.21.15.28:0/1417997016 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd900026070 con 0x55a8cbec3600 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd8f9600640 1 -- 172.21.15.28:0/1417997016 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fd908074050 con 0x55a8cbec3600 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd91e06a000 10 client.5212 fetch_fsmap learned FSMap version 15 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd91e06a000 1 -- 172.21.15.28:0/1417997016 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a8cbc75490 con 0x55a8cbec3600 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.291+0000 7fd8f9600640 1 -- 172.21.15.28:0/1417997016 <== mon.1 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd900026070 con 0x55a8cbec3600 2024-04-23T18:25:38.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.295+0000 7fd8f9600640 1 -- 172.21.15.28:0/1417997016 <== mon.1 v2:172.21.15.137:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fd908013050 con 0x55a8cbec3600 2024-04-23T18:25:38.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.295+0000 7fd91e06a000 10 client.5212 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:25:38.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.295+0000 7fd91e06a000 10 client.5212 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:25:38.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.295+0000 7fd91e06a000 20 client.5212 populate_metadata read hostname 'smithi028' 2024-04-23T18:25:38.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.295+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a8cbecf5a0 0x55a8cbecf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.295+0000 7fd91e06a000 4 client.5212 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:25:38.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.295+0000 7fd91e06a000 1 -- 172.21.15.28:0/1417997016 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8cbc6f7f0 con 0x55a8cbecf5a0 2024-04-23T18:25:38.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.295+0000 7fd913400640 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a8cbecf5a0 0x55a8cbecf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.295+0000 7fd913400640 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a8cbecf5a0 0x55a8cbecf980 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced989f21c7c1a9e server_cookie=c722e28c6a06bede in_seq=0 out_seq=0 2024-04-23T18:25:38.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.295+0000 7fd8f9600640 10 client.5212 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:25:38.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd8f9600640 1 -- 172.21.15.28:0/1417997016 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a8cbc6f7f0 con 0x55a8cbecf5a0 2024-04-23T18:25:38.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd8f9600640 10 client.5212 handle_command_reply: tid=0 2024-04-23T18:25:38.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 1 client.5212 shutdown 2024-04-23T18:25:38.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 1 -- 172.21.15.28:0/1417997016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 msgr2=0x55a8cbec29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:38.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 0x55a8cbec29e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd9080094b0 tx=0x7fd90805f890 comp rx=0 tx=0).stop 2024-04-23T18:25:38.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 1 -- 172.21.15.28:0/1417997016 shutdown_connections 2024-04-23T18:25:38.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a8cbecf5a0 0x55a8cbecf980 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec86c0 0x55a8cbec2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec8fe0 0x55a8cbece830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1417997016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 0x55a8cbec29e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd8f9600640 0 client.5212 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:25:38.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 1 -- 172.21.15.28:0/1417997016 >> 172.21.15.28:0/1417997016 conn(0x55a8cbec4470 msgr2=0x55a8cbec76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:25:38.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 1 -- 172.21.15.28:0/1417997016 shutdown_connections 2024-04-23T18:25:38.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 1 -- 172.21.15.28:0/1417997016 wait complete. 2024-04-23T18:25:38.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.299+0000 7fd91e06a000 20 client.5212 trim_cache size 0 max 16384 2024-04-23T18:25:38.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd91e06a000 1 Processor -- start 2024-04-23T18:25:38.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd91e06a000 1 -- start start 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec4470 0x55a8cbe8c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec3600 0x55a8cbee3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec86c0 0x55a8cbee3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd91e06a000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c188c10 con 0x55a8cbec4470 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd91e06a000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c17cb90 con 0x55a8cbec86c0 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd91e06a000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c188560 con 0x55a8cbec3600 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd913e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec4470 0x55a8cbe8c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd913e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec4470 0x55a8cbe8c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59316/0 (socket says 172.21.15.28:59316) 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd913e00640 1 -- 172.21.15.28:0/1744177315 learned_addr learned my addr 172.21.15.28:0/1744177315 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.335+0000 7fd918c00640 1 --2- 172.21.15.28:0/1744177315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec86c0 0x55a8cbee3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd913400640 1 --2- 172.21.15.28:0/1744177315 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec3600 0x55a8cbee3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd913e00640 1 -- 172.21.15.28:0/1744177315 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec3600 msgr2=0x55a8cbee3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:25:38.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd913e00640 1 --2- 172.21.15.28:0/1744177315 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec3600 0x55a8cbee3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd913e00640 1 -- 172.21.15.28:0/1744177315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec86c0 msgr2=0x55a8cbee3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:25:38.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd913e00640 1 --2- 172.21.15.28:0/1744177315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec86c0 0x55a8cbee3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd913e00640 1 -- 172.21.15.28:0/1744177315 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8cbc70a70 con 0x55a8cbec4470 2024-04-23T18:25:38.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd918c00640 1 --2- 172.21.15.28:0/1744177315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec86c0 0x55a8cbee3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:25:38.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd913e00640 1 --2- 172.21.15.28:0/1744177315 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec4470 0x55a8cbe8c0e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd908004780 tx=0x7fd90801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b1c1265d39e40d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:25:38.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd8fbe00640 1 -- 172.21.15.28:0/1744177315 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908055120 con 0x55a8cbec4470 2024-04-23T18:25:38.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd8fbe00640 1 -- 172.21.15.28:0/1744177315 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd908009c50 con 0x55a8cbec4470 2024-04-23T18:25:38.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd8fbe00640 1 -- 172.21.15.28:0/1744177315 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908075d60 con 0x55a8cbec4470 2024-04-23T18:25:38.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 -- 172.21.15.28:0/1744177315 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec4470 msgr2=0x55a8cbe8c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:38.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1744177315 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec4470 0x55a8cbe8c0e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd908004780 tx=0x7fd90801f000 comp rx=0 tx=0).stop 2024-04-23T18:25:38.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 -- 172.21.15.28:0/1744177315 shutdown_connections 2024-04-23T18:25:38.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1744177315 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec3600 0x55a8cbee3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1744177315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec86c0 0x55a8cbee3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1744177315 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec4470 0x55a8cbe8c0e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 -- 172.21.15.28:0/1744177315 >> 172.21.15.28:0/1744177315 conn(0x55a8cbece990 msgr2=0x55a8cbed99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:25:38.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 -- 172.21.15.28:0/1744177315 shutdown_connections 2024-04-23T18:25:38.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 -- 172.21.15.28:0/1744177315 wait complete. 2024-04-23T18:25:38.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 -- start start 2024-04-23T18:25:38.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 Processor -- start 2024-04-23T18:25:38.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 0x55a8cbe8a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec4470 0x55a8cbe8ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbe8b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55a8cbcd4900 con 0x55a8cbec86c0 2024-04-23T18:25:38.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a8cbc9fe60 con 0x55a8cbec3600 2024-04-23T18:25:38.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55a8cbcd9c20 con 0x55a8cbec4470 2024-04-23T18:25:38.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.339+0000 7fd91e06a000 10 client.0 _ll_register_callbacks cb 0x7fd908056e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:25:38.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd918c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbe8b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd913400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec4470 0x55a8cbe8ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd918c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbe8b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:59332/0 (socket says 172.21.15.28:59332) 2024-04-23T18:25:38.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd918c00640 1 -- 172.21.15.28:0/1191063843 learned_addr learned my addr 172.21.15.28:0/1191063843 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd913e00640 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 0x55a8cbe8a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd918c00640 1 -- 172.21.15.28:0/1191063843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec4470 msgr2=0x55a8cbe8ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd918c00640 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec4470 0x55a8cbe8ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd918c00640 1 -- 172.21.15.28:0/1191063843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 msgr2=0x55a8cbe8a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd918c00640 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 0x55a8cbe8a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd918c00640 1 -- 172.21.15.28:0/1191063843 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8cbd58080 con 0x55a8cbec86c0 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd918c00640 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbe8b1c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd914050b40 tx=0x7fd9140975d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afa0b02dfea6740 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd8f9600640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd8f9600640 1 -- 172.21.15.28:0/1191063843 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914121c90 con 0x55a8cbec86c0 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd91e06a000 1 -- 172.21.15.28:0/1191063843 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd908009c50 con 0x55a8cbec86c0 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd8f9600640 1 -- 172.21.15.28:0/1191063843 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd91412e040 con 0x55a8cbec86c0 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd8f9600640 1 -- 172.21.15.28:0/1191063843 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fd914129ac0 con 0x55a8cbec86c0 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd91e06a000 10 client.5250 fetch_fsmap learned FSMap version 15 2024-04-23T18:25:38.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd91e06a000 1 -- 172.21.15.28:0/1191063843 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a8cbc7b3e0 con 0x55a8cbec86c0 2024-04-23T18:25:38.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd8f9600640 1 -- 172.21.15.28:0/1191063843 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd908009c50 con 0x55a8cbec86c0 2024-04-23T18:25:38.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd8f9600640 1 -- 172.21.15.28:0/1191063843 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fd914129c60 con 0x55a8cbec86c0 2024-04-23T18:25:38.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd91e06a000 10 client.5250 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:25:38.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd91e06a000 10 client.5250 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:25:38.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd91e06a000 20 client.5250 populate_metadata read hostname 'smithi028' 2024-04-23T18:25:38.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a8cbec8fe0 0x55a8cbf44a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:25:38.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd91e06a000 4 client.5250 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.55, "await_for": 42.0}] 2024-04-23T18:25:38.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd91e06a000 1 -- 172.21.15.28:0/1191063843 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.55, "await_for": 42.0}) -- 0x55a8cbc7e940 con 0x55a8cbec8fe0 2024-04-23T18:25:38.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd913e00640 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a8cbec8fe0 0x55a8cbf44a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:25:38.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd8f9600640 10 client.5250 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:25:38.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.343+0000 7fd913e00640 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a8cbec8fe0 0x55a8cbf44a90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a885f8e9c51c2a0c server_cookie=7d9e719663eea21a in_seq=0 out_seq=0 2024-04-23T18:25:38.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.807+0000 7fd8f9600640 1 -- 172.21.15.28:0/1191063843 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a8cbc7e940 con 0x55a8cbec8fe0 2024-04-23T18:25:38.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.807+0000 7fd8f9600640 10 client.5250 handle_command_reply: tid=0 2024-04-23T18:25:38.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.807+0000 7fd91e06a000 1 client.5250 shutdown 2024-04-23T18:25:38.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.807+0000 7fd91e06a000 1 -- 172.21.15.28:0/1191063843 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 msgr2=0x55a8cbe8b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:38.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.807+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbe8b1c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd914050b40 tx=0x7fd9140975d0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd91e06a000 1 -- 172.21.15.28:0/1191063843 shutdown_connections 2024-04-23T18:25:38.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a8cbec8fe0 0x55a8cbf44a90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a8cbec4470 0x55a8cbe8ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a8cbec86c0 0x55a8cbe8b1c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd91e06a000 1 --2- 172.21.15.28:0/1191063843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a8cbec3600 0x55a8cbe8a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd8f9600640 0 client.5250 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:25:38.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd91e06a000 1 -- 172.21.15.28:0/1191063843 >> 172.21.15.28:0/1191063843 conn(0x55a8cbece990 msgr2=0x55a8cbec6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:25:38.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd91e06a000 1 -- 172.21.15.28:0/1191063843 shutdown_connections 2024-04-23T18:25:38.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd91e06a000 1 -- 172.21.15.28:0/1191063843 wait complete. 2024-04-23T18:25:38.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd91e06a000 20 client.5250 trim_cache size 0 max 16384 2024-04-23T18:25:38.805 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:25:38.805 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 15, 2024-04-23T18:25:38.805 INFO:teuthology.orchestra.run.smithi028.stdout: "leader": 4297, 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "set_version": 10, 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "sets": { 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "247798b0": { 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "version": 10, 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "age_ref": 0.0, 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "QUIESCED", 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "timeout": 60.0, 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "expiration": 87.5, 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "members": { 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "file:/": { 2024-04-23T18:25:38.806 INFO:teuthology.orchestra.run.smithi028.stdout: "excluded": false, 2024-04-23T18:25:38.807 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:25:38.807 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "QUIESCED", 2024-04-23T18:25:38.807 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:25:38.807 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:25:38.807 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:25:38.807 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:25:38.807 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:25:38.807 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:25:38.807 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:25:38.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 -- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8f4068380 msgr2=0x7fd8f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:38.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8f4068380 0x7fd8f406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0cfa60 tx=0x7fd900009190 comp rx=0 tx=0).stop 2024-04-23T18:25:38.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 -- 172.21.15.28:0/4013044189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd90c04b0f0 msgr2=0x7fd90c0d2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:25:38.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd90c04b0f0 0x7fd90c0d2f10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd90800d800 tx=0x7fd90800dcc0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 -- 172.21.15.28:0/4013044189 shutdown_connections 2024-04-23T18:25:38.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fd8f4068380 0x7fd8f406a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd90c0d9060 0x7fd90c034e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd90c0ded20 0x7fd90c0d0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 --2- 172.21.15.28:0/4013044189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd90c04b0f0 0x7fd90c0d2f10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:25:38.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 -- 172.21.15.28:0/4013044189 >> 172.21.15.28:0/4013044189 conn(0x7fd90c0505e0 msgr2=0x7fd90c005a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:25:38.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 -- 172.21.15.28:0/4013044189 shutdown_connections 2024-04-23T18:25:38.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:25:38.811+0000 7fd919600640 1 -- 172.21.15.28:0/4013044189 wait complete. 2024-04-23T18:25:38.832 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '247798b0', quiesce took 1.6 seconds. Will release after: 27.55 2024-04-23T18:25:58.516 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:25:58.521 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:26:06.383 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:26:06.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.591+0000 7f62ea600640 1 Processor -- start 2024-04-23T18:26:06.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.591+0000 7f62ea600640 1 -- start start 2024-04-23T18:26:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.595+0000 7f62ea600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62e4159800 0x7f62e415f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.595+0000 7f62ea600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e4159be0 con 0x7f62e40c8500 2024-04-23T18:26:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.595+0000 7f62ea600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e40716f0 con 0x7f62e40c73e0 2024-04-23T18:26:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.595+0000 7f62ea600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f62e415fd80 con 0x7f62e4159800 2024-04-23T18:26:06.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.595+0000 7f62e2a00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f62e40c8500 0x7f62e4072190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:51228/0 (socket says 172.21.15.28:51228) 2024-04-23T18:26:06.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.595+0000 7f62e2a00640 1 -- 172.21.15.28:0/4069189293 learned_addr learned my addr 172.21.15.28:0/4069189293 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:26:06.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.595+0000 7f62e3400640 1 --2- 172.21.15.28:0/4069189293 >> v2:172.21.15.28:3300/0 conn(0x7f62e4159800 0x7f62e415f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:06.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.595+0000 7f62e3400640 1 -- 172.21.15.28:0/4069189293 >> v1:172.21.15.137:6789/0 conn(0x7f62e40c73e0 legacy=0x7f62e4169e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:06.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.595+0000 7f62e3400640 1 -- 172.21.15.28:0/4069189293 >> v1:172.21.15.28:6789/0 conn(0x7f62e40c8500 legacy=0x7f62e4072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:06.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.595+0000 7f62e2000640 1 -- 172.21.15.28:0/4069189293 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699309859 0 0) 0x7f62e4159be0 con 0x7f62e40c8500 2024-04-23T18:26:06.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.595+0000 7f62e3400640 1 -- 172.21.15.28:0/4069189293 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e4160040 con 0x7f62e4159800 2024-04-23T18:26:06.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.599+0000 7f62e3400640 1 --2- 172.21.15.28:0/4069189293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e4159800 0x7f62e415f480 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f62e40718c0 tx=0x7f62d401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b704f4547099384 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:06.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.599+0000 7f62e2000640 1 -- 172.21.15.28:0/4069189293 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d40b5070 con 0x7f62e4159800 2024-04-23T18:26:06.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.599+0000 7f62e2000640 1 -- 172.21.15.28:0/4069189293 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d40a8990 con 0x7f62e4159800 2024-04-23T18:26:06.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.599+0000 7f62e2000640 1 -- 172.21.15.28:0/4069189293 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d40a8d60 con 0x7f62e4159800 2024-04-23T18:26:06.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.599+0000 7f62ea600640 1 -- 172.21.15.28:0/4069189293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e4159800 msgr2=0x7f62e415f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:06.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.599+0000 7f62ea600640 1 --2- 172.21.15.28:0/4069189293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e4159800 0x7f62e415f480 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f62e40718c0 tx=0x7f62d401ec90 comp rx=0 tx=0).stop 2024-04-23T18:26:06.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.599+0000 7f62ea600640 1 -- 172.21.15.28:0/4069189293 shutdown_connections 2024-04-23T18:26:06.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.599+0000 7f62ea600640 1 --2- 172.21.15.28:0/4069189293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e4159800 0x7f62e415f480 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:06.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.599+0000 7f62ea600640 1 -- 172.21.15.28:0/4069189293 >> 172.21.15.28:0/4069189293 conn(0x7f62e406d0a0 msgr2=0x7f62e40676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:06.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.599+0000 7f62ea600640 1 -- 172.21.15.28:0/4069189293 shutdown_connections 2024-04-23T18:26:06.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.599+0000 7f62ea600640 1 -- 172.21.15.28:0/4069189293 wait complete. 2024-04-23T18:26:06.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62ea600640 1 Processor -- start 2024-04-23T18:26:06.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62ea600640 1 -- start start 2024-04-23T18:26:06.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62ea600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62e40c73e0 0x7f62e415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:06.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62ea600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62e40c8500 0x7f62e414f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:06.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62ea600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e4159800 0x7f62e414f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:06.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62ea600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4071c70 con 0x7f62e4159800 2024-04-23T18:26:06.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62ea600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4071990 con 0x7f62e40c8500 2024-04-23T18:26:06.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62ea600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f62e40c8be0 con 0x7f62e40c73e0 2024-04-23T18:26:06.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62e3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e4159800 0x7f62e414f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:06.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62e2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62e40c8500 0x7f62e414f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:06.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62e3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e4159800 0x7f62e414f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34604/0 (socket says 172.21.15.28:34604) 2024-04-23T18:26:06.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62e3e00640 1 -- 172.21.15.28:0/3694014005 learned_addr learned my addr 172.21.15.28:0/3694014005 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:06.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62e3400640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62e40c73e0 0x7f62e415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:06.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62e3e00640 1 -- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62e40c73e0 msgr2=0x7f62e415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:06.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62e3e00640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62e40c73e0 0x7f62e415ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:06.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62e3e00640 1 -- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62e40c8500 msgr2=0x7f62e414f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:06.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62e3e00640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62e40c8500 0x7f62e414f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:06.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62e3e00640 1 -- 172.21.15.28:0/3694014005 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e41f5030 con 0x7f62e4159800 2024-04-23T18:26:06.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.603+0000 7f62e3e00640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e4159800 0x7f62e414f9d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00c770 tx=0x7f62dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:06.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.607+0000 7f62db400640 1 -- 172.21.15.28:0/3694014005 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc003b80 con 0x7f62e4159800 2024-04-23T18:26:06.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.607+0000 7f62db400640 1 -- 172.21.15.28:0/3694014005 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc003d20 con 0x7f62e4159800 2024-04-23T18:26:06.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.607+0000 7f62db400640 1 -- 172.21.15.28:0/3694014005 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc00aa30 con 0x7f62e4159800 2024-04-23T18:26:06.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.607+0000 7f62ea600640 1 -- 172.21.15.28:0/3694014005 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e4160b70 con 0x7f62e4159800 2024-04-23T18:26:06.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.607+0000 7f62ea600640 1 -- 172.21.15.28:0/3694014005 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e41f5580 con 0x7f62e4159800 2024-04-23T18:26:06.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.607+0000 7f62ea600640 1 -- 172.21.15.28:0/3694014005 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e41f5b90 con 0x7f62e4159800 2024-04-23T18:26:06.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.611+0000 7f62db400640 1 -- 172.21.15.28:0/3694014005 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f62dc00abd0 con 0x7f62e4159800 2024-04-23T18:26:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.611+0000 7f62db400640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62c40683b0 0x7f62c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.611+0000 7f62db400640 1 -- 172.21.15.28:0/3694014005 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f62dc086ce0 con 0x7f62e4159800 2024-04-23T18:26:06.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.611+0000 7f62e3400640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62c40683b0 0x7f62c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:06.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.611+0000 7f62e3400640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62c40683b0 0x7f62c406a870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f62d40b2000 tx=0x7f62d40aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:06.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.615+0000 7f62db400640 1 -- 172.21.15.28:0/3694014005 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f62e4160b70 con 0x7f62e4159800 2024-04-23T18:26:06.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 -- 172.21.15.28:0/3694014005 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62e4068cd0 con 0x7f62e4159800 2024-04-23T18:26:06.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62db400640 1 -- 172.21.15.28:0/3694014005 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f62dc056d70 con 0x7f62e4159800 2024-04-23T18:26:06.865 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:26:06.865 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:26:06.867 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:26:06.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 -- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62c40683b0 msgr2=0x7f62c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:06.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62c40683b0 0x7f62c406a870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f62d40b2000 tx=0x7f62d40aa070 comp rx=0 tx=0).stop 2024-04-23T18:26:06.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 -- 172.21.15.28:0/3694014005 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e4159800 msgr2=0x7f62e414f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:06.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e4159800 0x7f62e414f9d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00c770 tx=0x7f62dc00cc30 comp rx=0 tx=0).stop 2024-04-23T18:26:06.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 -- 172.21.15.28:0/3694014005 shutdown_connections 2024-04-23T18:26:06.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f62c40683b0 0x7f62c406a870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:06.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62e4159800 0x7f62e414f9d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:06.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62e40c8500 0x7f62e414f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:06.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 --2- 172.21.15.28:0/3694014005 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62e40c73e0 0x7f62e415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:06.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 -- 172.21.15.28:0/3694014005 >> 172.21.15.28:0/3694014005 conn(0x7f62e406d0a0 msgr2=0x7f62e40ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:06.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 -- 172.21.15.28:0/3694014005 shutdown_connections 2024-04-23T18:26:06.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:06.871+0000 7f62ea600640 1 -- 172.21.15.28:0/3694014005 wait complete. 2024-04-23T18:26:06.889 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4297 quiesce db --set-id 247798b0 --release --await' 2024-04-23T18:26:06.889 DEBUG:teuthology.orchestra.run.smithi028:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4297 quiesce db --set-id 247798b0 --release --await 2024-04-23T18:26:07.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb74000640 1 Processor -- start 2024-04-23T18:26:07.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb74000640 1 -- start start 2024-04-23T18:26:07.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb74000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcb6c0c8a80 0x7fcb6c15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb74000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcb6c06ee90 0x7fcb6c06f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb74000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6c06f840 con 0x7fcb6c070890 2024-04-23T18:26:07.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb74000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6c15c150 con 0x7fcb6c0c8a80 2024-04-23T18:26:07.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb74000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6c15e780 con 0x7fcb6c06ee90 2024-04-23T18:26:07.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb71600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcb6c0c8a80 0x7fcb6c15bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb72000640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcb6c070890 0x7fcb6c070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:51230/0 (socket says 172.21.15.28:51230) 2024-04-23T18:26:07.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb72000640 1 -- 172.21.15.28:0/3340113108 learned_addr learned my addr 172.21.15.28:0/3340113108 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:26:07.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb70c00640 1 --2- 172.21.15.28:0/3340113108 >> v2:172.21.15.137:3300/0 conn(0x7fcb6c06ee90 0x7fcb6c06f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb71600640 1 -- 172.21.15.28:0/3340113108 >> v2:172.21.15.137:3300/0 conn(0x7fcb6c06ee90 msgr2=0x7fcb6c06f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb71600640 1 --2- 172.21.15.28:0/3340113108 >> v2:172.21.15.137:3300/0 conn(0x7fcb6c06ee90 0x7fcb6c06f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb71600640 1 -- 172.21.15.28:0/3340113108 >> v1:172.21.15.28:6789/0 conn(0x7fcb6c070890 legacy=0x7fcb6c070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.079+0000 7fcb71600640 1 -- 172.21.15.28:0/3340113108 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c15e9d0 con 0x7fcb6c0c8a80 2024-04-23T18:26:07.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb71600640 1 --2- 172.21.15.28:0/3340113108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb6c0c8a80 0x7fcb6c15bc10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c072b70 tx=0x7fcb6001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b1c5a3938674b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb6be00640 1 -- 172.21.15.28:0/3340113108 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb600b5070 con 0x7fcb6c0c8a80 2024-04-23T18:26:07.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb6be00640 1 -- 172.21.15.28:0/3340113108 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb600a8970 con 0x7fcb6c0c8a80 2024-04-23T18:26:07.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb6be00640 1 -- 172.21.15.28:0/3340113108 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb600a8d40 con 0x7fcb6c0c8a80 2024-04-23T18:26:07.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb74000640 1 -- 172.21.15.28:0/3340113108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb6c0c8a80 msgr2=0x7fcb6c15bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb74000640 1 --2- 172.21.15.28:0/3340113108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb6c0c8a80 0x7fcb6c15bc10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c072b70 tx=0x7fcb6001ec70 comp rx=0 tx=0).stop 2024-04-23T18:26:07.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb74000640 1 -- 172.21.15.28:0/3340113108 shutdown_connections 2024-04-23T18:26:07.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb74000640 1 --2- 172.21.15.28:0/3340113108 >> v2:172.21.15.137:3300/0 conn(0x7fcb6c06ee90 0x7fcb6c06f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb74000640 1 --2- 172.21.15.28:0/3340113108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb6c0c8a80 0x7fcb6c15bc10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb74000640 1 -- 172.21.15.28:0/3340113108 >> 172.21.15.28:0/3340113108 conn(0x7fcb6c0ce850 msgr2=0x7fcb6c0cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb74000640 1 -- 172.21.15.28:0/3340113108 shutdown_connections 2024-04-23T18:26:07.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.083+0000 7fcb74000640 1 -- 172.21.15.28:0/3340113108 wait complete. 2024-04-23T18:26:07.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.087+0000 7fcb74000640 1 Processor -- start 2024-04-23T18:26:07.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.087+0000 7fcb74000640 1 -- start start 2024-04-23T18:26:07.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.087+0000 7fcb74000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb6c06ee90 0x7fcb6c0c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.087+0000 7fcb74000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb6c070890 0x7fcb6c14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.087+0000 7fcb74000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb6c0c8a80 0x7fcb6c0c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.087+0000 7fcb74000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c15ef90 con 0x7fcb6c070890 2024-04-23T18:26:07.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.087+0000 7fcb74000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c06ea00 con 0x7fcb6c06ee90 2024-04-23T18:26:07.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.087+0000 7fcb74000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c15f270 con 0x7fcb6c0c8a80 2024-04-23T18:26:07.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb70c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb6c070890 0x7fcb6c14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb71600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb6c06ee90 0x7fcb6c0c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb70c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb6c070890 0x7fcb6c14a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34626/0 (socket says 172.21.15.28:34626) 2024-04-23T18:26:07.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb70c00640 1 -- 172.21.15.28:0/1774970986 learned_addr learned my addr 172.21.15.28:0/1774970986 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:07.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb72000640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb6c0c8a80 0x7fcb6c0c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb70c00640 1 -- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb6c0c8a80 msgr2=0x7fcb6c0c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb70c00640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb6c0c8a80 0x7fcb6c0c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb70c00640 1 -- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb6c06ee90 msgr2=0x7fcb6c0c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb70c00640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb6c06ee90 0x7fcb6c0c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb70c00640 1 -- 172.21.15.28:0/1774970986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c1f42f0 con 0x7fcb6c070890 2024-04-23T18:26:07.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb70c00640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb6c070890 0x7fcb6c14a5f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800d5f0 tx=0x7fcb5800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb69600640 1 -- 172.21.15.28:0/1774970986 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb580125f0 con 0x7fcb6c070890 2024-04-23T18:26:07.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb69600640 1 -- 172.21.15.28:0/1774970986 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb58019070 con 0x7fcb6c070890 2024-04-23T18:26:07.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb74000640 1 -- 172.21.15.28:0/1774970986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c1f4590 con 0x7fcb6c070890 2024-04-23T18:26:07.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb69600640 1 -- 172.21.15.28:0/1774970986 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb580129b0 con 0x7fcb6c070890 2024-04-23T18:26:07.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.091+0000 7fcb74000640 1 -- 172.21.15.28:0/1774970986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c1f1170 con 0x7fcb6c070890 2024-04-23T18:26:07.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb774fb000 1 Processor -- start 2024-04-23T18:26:07.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb774fb000 1 -- start start 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631983558a0 0x56319831e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56319831ef00 0x56319831f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x56319835a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb774fb000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x563198166660 con 0x56319835a120 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb774fb000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56319810b5d0 con 0x5631983558a0 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb774fb000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x563198162620 con 0x56319831ef00 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb69600640 1 -- 172.21.15.28:0/1774970986 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb58012b50 con 0x7fcb6c070890 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb70c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x56319835a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb71600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56319831ef00 0x56319831f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb72000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631983558a0 0x56319831e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb70c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x56319835a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34636/0 (socket says 172.21.15.28:34636) 2024-04-23T18:26:07.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.095+0000 7fcb70c00640 1 -- 172.21.15.28:0/3186374311 learned_addr learned my addr 172.21.15.28:0/3186374311 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:07.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb71600640 1 -- 172.21.15.28:0/3186374311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631983558a0 msgr2=0x56319831e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb71600640 1 --2- 172.21.15.28:0/3186374311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631983558a0 0x56319831e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb69600640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcb4c068380 0x7fcb4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb71600640 1 -- 172.21.15.28:0/3186374311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 msgr2=0x56319835a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb71600640 1 --2- 172.21.15.28:0/3186374311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x56319835a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb71600640 1 -- 172.21.15.28:0/3186374311 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56319813fbd0 con 0x56319831ef00 2024-04-23T18:26:07.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb70c00640 1 --2- 172.21.15.28:0/3186374311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x56319835a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb69600640 1 -- 172.21.15.28:0/1774970986 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fcb58087110 con 0x7fcb6c070890 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb72000640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcb4c068380 0x7fcb4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb71600640 1 --2- 172.21.15.28:0/3186374311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56319831ef00 0x56319831f2e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb600af000 tx=0x7fcb600aa070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74e2955e3bf048f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb5e000640 1 -- 172.21.15.28:0/3186374311 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb600b5040 con 0x56319831ef00 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb5e000640 1 -- 172.21.15.28:0/3186374311 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb600a8ab0 con 0x56319831ef00 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb5e000640 1 -- 172.21.15.28:0/3186374311 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb600b0440 con 0x56319831ef00 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 -- 172.21.15.28:0/3186374311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56319831ef00 msgr2=0x56319831f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb72000640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcb4c068380 0x7fcb4c06a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcb64005c10 tx=0x7fcb64009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 --2- 172.21.15.28:0/3186374311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56319831ef00 0x56319831f2e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb600af000 tx=0x7fcb600aa070 comp rx=0 tx=0).stop 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 -- 172.21.15.28:0/3186374311 shutdown_connections 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 --2- 172.21.15.28:0/3186374311 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56319831ef00 0x56319831f2e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 --2- 172.21.15.28:0/3186374311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x56319835a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 --2- 172.21.15.28:0/3186374311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631983558a0 0x56319831e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 -- 172.21.15.28:0/3186374311 >> 172.21.15.28:0/3186374311 conn(0x563198200b00 msgr2=0x563198357ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 -- 172.21.15.28:0/3186374311 shutdown_connections 2024-04-23T18:26:07.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 -- 172.21.15.28:0/3186374311 wait complete. 2024-04-23T18:26:07.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 -- start start 2024-04-23T18:26:07.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 Processor -- start 2024-04-23T18:26:07.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.099+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 0x563198354650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 0x563198354b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x5631983198d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x563198223d40 con 0x56319835a120 2024-04-23T18:26:07.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563198120eb0 con 0x56319831ef00 2024-04-23T18:26:07.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x5631981612a0 con 0x5631983558a0 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 10 client.0 _ll_register_callbacks cb 0x563198304a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb72000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x5631983198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb70c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 0x563198354b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb70c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 0x563198354b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:54940/0 (socket says 172.21.15.28:54940) 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb70c00640 1 -- 172.21.15.28:0/651124476 learned_addr learned my addr 172.21.15.28:0/651124476 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb71600640 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 0x563198354650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb70c00640 1 -- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 msgr2=0x563198354650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb70c00640 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 0x563198354650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb70c00640 1 -- 172.21.15.28:0/651124476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 msgr2=0x5631983198d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb70c00640 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x5631983198d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb70c00640 1 -- 172.21.15.28:0/651124476 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5631981acb30 con 0x5631983558a0 2024-04-23T18:26:07.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb71600640 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 0x563198354650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:26:07.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb70c00640 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 0x563198354b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800dfb0 tx=0x7fcb58052fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9f7fa1026a88cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb52a00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3301/0 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb52a00640 1 -- 172.21.15.28:0/651124476 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58056c80 con 0x5631983558a0 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 1 -- 172.21.15.28:0/651124476 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x563198100060 con 0x5631983558a0 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb52a00640 1 -- 172.21.15.28:0/651124476 <== mon.2 v2:172.21.15.137:3301/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fcb58054f80 con 0x5631983558a0 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb52a00640 1 -- 172.21.15.28:0/651124476 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fcb5805af80 con 0x5631983558a0 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 10 client.5015 fetch_fsmap learned FSMap version 15 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 1 -- 172.21.15.28:0/651124476 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x563198105b70 con 0x5631983558a0 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb52a00640 1 -- 172.21.15.28:0/651124476 <== mon.2 v2:172.21.15.137:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x563198100060 con 0x5631983558a0 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb52a00640 1 -- 172.21.15.28:0/651124476 <== mon.2 v2:172.21.15.137:3301/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fcb58013070 con 0x5631983558a0 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 10 client.5015 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 10 client.5015 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 20 client.5015 populate_metadata read hostname 'smithi028' 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56319831a670 0x56319831aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 4 client.5015 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:26:07.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb774fb000 1 -- 172.21.15.28:0/651124476 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56319813ee30 con 0x56319831a670 2024-04-23T18:26:07.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.103+0000 7fcb71600640 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56319831a670 0x56319831aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.107+0000 7fcb71600640 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56319831a670 0x56319831aa80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa1720d5208090e2 server_cookie=749898c7ca4c41a8 in_seq=0 out_seq=0 2024-04-23T18:26:07.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.107+0000 7fcb52a00640 10 client.5015 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:07.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.107+0000 7fcb52a00640 1 -- 172.21.15.28:0/651124476 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56319813ee30 con 0x56319831a670 2024-04-23T18:26:07.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.107+0000 7fcb52a00640 10 client.5015 handle_command_reply: tid=0 2024-04-23T18:26:07.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.107+0000 7fcb774fb000 1 client.5015 shutdown 2024-04-23T18:26:07.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.107+0000 7fcb774fb000 1 -- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 msgr2=0x563198354b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.107+0000 7fcb774fb000 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 0x563198354b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800dfb0 tx=0x7fcb58052fa0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.111+0000 7fcb774fb000 1 -- 172.21.15.28:0/651124476 shutdown_connections 2024-04-23T18:26:07.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.111+0000 7fcb774fb000 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56319831a670 0x56319831aa80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.111+0000 7fcb774fb000 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 0x563198354b90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.111+0000 7fcb774fb000 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x5631983198d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.111+0000 7fcb774fb000 1 --2- 172.21.15.28:0/651124476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 0x563198354650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.111+0000 7fcb774fb000 1 -- 172.21.15.28:0/651124476 >> 172.21.15.28:0/651124476 conn(0x563198200b00 msgr2=0x5631983599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.111+0000 7fcb52a00640 0 client.5015 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:07.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.111+0000 7fcb774fb000 1 -- 172.21.15.28:0/651124476 shutdown_connections 2024-04-23T18:26:07.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.111+0000 7fcb774fb000 1 -- 172.21.15.28:0/651124476 wait complete. 2024-04-23T18:26:07.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.111+0000 7fcb774fb000 20 client.5015 trim_cache size 0 max 16384 2024-04-23T18:26:07.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.131+0000 7fcb774fb000 1 Processor -- start 2024-04-23T18:26:07.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.131+0000 7fcb774fb000 1 -- start start 2024-04-23T18:26:07.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.131+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 0x5631983c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.131+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 0x5631983c4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.131+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x5631983c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.131+0000 7fcb774fb000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1fde80 con 0x56319835a120 2024-04-23T18:26:07.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.131+0000 7fcb774fb000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1fd190 con 0x56319831ef00 2024-04-23T18:26:07.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.131+0000 7fcb774fb000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c1fd7b0 con 0x5631983558a0 2024-04-23T18:26:07.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb71600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 0x5631983c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb72000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x5631983c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb70c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 0x5631983c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb72000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x5631983c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34646/0 (socket says 172.21.15.28:34646) 2024-04-23T18:26:07.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb71600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 0x5631983c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:48714/0 (socket says 172.21.15.28:48714) 2024-04-23T18:26:07.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb72000640 1 -- 172.21.15.28:0/1549295338 learned_addr learned my addr 172.21.15.28:0/1549295338 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:07.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb72000640 1 -- 172.21.15.28:0/1549295338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 msgr2=0x5631983c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb72000640 1 --2- 172.21.15.28:0/1549295338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 0x5631983c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb72000640 1 -- 172.21.15.28:0/1549295338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 msgr2=0x5631983c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb72000640 1 --2- 172.21.15.28:0/1549295338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 0x5631983c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb72000640 1 -- 172.21.15.28:0/1549295338 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631981e85e0 con 0x56319835a120 2024-04-23T18:26:07.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb72000640 1 --2- 172.21.15.28:0/1549295338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x5631983c4570 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcb64015810 tx=0x7fcb64015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc4e1044e10b7d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb5d600640 1 -- 172.21.15.28:0/1549295338 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64019040 con 0x56319835a120 2024-04-23T18:26:07.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb5d600640 1 -- 172.21.15.28:0/1549295338 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb64026030 con 0x56319835a120 2024-04-23T18:26:07.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb5d600640 1 -- 172.21.15.28:0/1549295338 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64022800 con 0x56319835a120 2024-04-23T18:26:07.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb774fb000 1 -- 172.21.15.28:0/1549295338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 msgr2=0x5631983c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb774fb000 1 --2- 172.21.15.28:0/1549295338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x5631983c4570 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcb64015810 tx=0x7fcb64015000 comp rx=0 tx=0).stop 2024-04-23T18:26:07.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb774fb000 1 -- 172.21.15.28:0/1549295338 shutdown_connections 2024-04-23T18:26:07.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb774fb000 1 --2- 172.21.15.28:0/1549295338 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x5631983558a0 0x5631983c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb774fb000 1 --2- 172.21.15.28:0/1549295338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56319835a120 0x5631983c4570 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb774fb000 1 --2- 172.21.15.28:0/1549295338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319831ef00 0x5631983c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb774fb000 1 -- 172.21.15.28:0/1549295338 >> 172.21.15.28:0/1549295338 conn(0x563198200b00 msgr2=0x56319831ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb774fb000 1 -- 172.21.15.28:0/1549295338 shutdown_connections 2024-04-23T18:26:07.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.135+0000 7fcb774fb000 1 -- 172.21.15.28:0/1549295338 wait complete. 2024-04-23T18:26:07.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.139+0000 7fcb774fb000 1 -- start start 2024-04-23T18:26:07.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.139+0000 7fcb774fb000 1 Processor -- start 2024-04-23T18:26:07.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56319831ef00 0x5631983c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5631983558a0 0x5631983c8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319835a120 0x5631983c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x563198165970 con 0x5631983558a0 2024-04-23T18:26:07.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56319811b8f0 con 0x56319835a120 2024-04-23T18:26:07.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x56319816ac90 con 0x56319831ef00 2024-04-23T18:26:07.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 10 client.0 _ll_register_callbacks cb 0x7fcb580073a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:26:07.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb70c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5631983558a0 0x5631983c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb71600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56319831ef00 0x5631983c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb70c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5631983558a0 0x5631983c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34650/0 (socket says 172.21.15.28:34650) 2024-04-23T18:26:07.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb70c00640 1 -- 172.21.15.28:0/2672124654 learned_addr learned my addr 172.21.15.28:0/2672124654 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:07.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb72000640 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319835a120 0x5631983c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb70c00640 1 -- 172.21.15.28:0/2672124654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56319831ef00 msgr2=0x5631983c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb70c00640 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56319831ef00 0x5631983c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb70c00640 1 -- 172.21.15.28:0/2672124654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319835a120 msgr2=0x5631983c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb70c00640 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319835a120 0x5631983c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb70c00640 1 -- 172.21.15.28:0/2672124654 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631980f8ae0 con 0x5631983558a0 2024-04-23T18:26:07.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb70c00640 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5631983558a0 0x5631983c8460 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcb58056980 tx=0x7fcb58085110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7a9b63eef8eaff server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb52a00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:26:07.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb52a00640 1 -- 172.21.15.28:0/2672124654 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58083060 con 0x5631983558a0 2024-04-23T18:26:07.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb52a00640 1 -- 172.21.15.28:0/2672124654 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fcb5807edb0 con 0x5631983558a0 2024-04-23T18:26:07.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 1 -- 172.21.15.28:0/2672124654 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb64026030 con 0x5631983558a0 2024-04-23T18:26:07.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb52a00640 1 -- 172.21.15.28:0/2672124654 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fcb58056c80 con 0x5631983558a0 2024-04-23T18:26:07.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 10 client.5280 fetch_fsmap learned FSMap version 15 2024-04-23T18:26:07.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 1 -- 172.21.15.28:0/2672124654 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5631980fbd80 con 0x5631983558a0 2024-04-23T18:26:07.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb52a00640 1 -- 172.21.15.28:0/2672124654 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb64026030 con 0x5631983558a0 2024-04-23T18:26:07.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb52a00640 1 -- 172.21.15.28:0/2672124654 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fcb5805d180 con 0x5631983558a0 2024-04-23T18:26:07.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 10 client.5280 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:26:07.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 10 client.5280 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:26:07.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 20 client.5280 populate_metadata read hostname 'smithi028' 2024-04-23T18:26:07.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5631983c9710 0x5631983c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 4 client.5280 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "247798b0", "release": true, "await": true}] 2024-04-23T18:26:07.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb774fb000 1 -- 172.21.15.28:0/2672124654 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "quiesce db", "set_id": "247798b0", "release": true, "await": true}) -- 0x5631981040d0 con 0x5631983c9710 2024-04-23T18:26:07.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb71600640 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5631983c9710 0x5631983c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb52a00640 10 client.5280 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:07.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.143+0000 7fcb71600640 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5631983c9710 0x5631983c9b20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56f88ab7d2d5a0ff server_cookie=1cdcd3db583eef35 in_seq=0 out_seq=0 2024-04-23T18:26:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb52a00640 1 -- 172.21.15.28:0/2672124654 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5631981040d0 con 0x5631983c9710 2024-04-23T18:26:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb52a00640 10 client.5280 handle_command_reply: tid=0 2024-04-23T18:26:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 1 client.5280 shutdown 2024-04-23T18:26:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 1 -- 172.21.15.28:0/2672124654 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5631983558a0 msgr2=0x5631983c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5631983558a0 0x5631983c8460 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcb58056980 tx=0x7fcb58085110 comp rx=0 tx=0).stop 2024-04-23T18:26:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 1 -- 172.21.15.28:0/2672124654 shutdown_connections 2024-04-23T18:26:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x5631983c9710 0x5631983c9b20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56319835a120 0x5631983c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5631983558a0 0x5631983c8460 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 1 --2- 172.21.15.28:0/2672124654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56319831ef00 0x5631983c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb52a00640 0 client.5280 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:07.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 1 -- 172.21.15.28:0/2672124654 >> 172.21.15.28:0/2672124654 conn(0x563198200b00 msgr2=0x563198319870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 1 -- 172.21.15.28:0/2672124654 shutdown_connections 2024-04-23T18:26:07.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 1 -- 172.21.15.28:0/2672124654 wait complete. 2024-04-23T18:26:07.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb774fb000 20 client.5280 trim_cache size 0 max 16384 2024-04-23T18:26:07.143 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:26:07.143 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 15, 2024-04-23T18:26:07.143 INFO:teuthology.orchestra.run.smithi028.stdout: "leader": 4297, 2024-04-23T18:26:07.143 INFO:teuthology.orchestra.run.smithi028.stdout: "set_version": 12, 2024-04-23T18:26:07.143 INFO:teuthology.orchestra.run.smithi028.stdout: "sets": { 2024-04-23T18:26:07.143 INFO:teuthology.orchestra.run.smithi028.stdout: "247798b0": { 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "version": 12, 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "age_ref": 0.0, 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RELEASED", 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "timeout": 60.0, 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "expiration": 87.5, 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "members": { 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "file:/": { 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "excluded": false, 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RELEASED", 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:26:07.144 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:07.145 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:07.145 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:07.145 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:07.145 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:07.145 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:26:07.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 -- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcb4c068380 msgr2=0x7fcb4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcb4c068380 0x7fcb4c06a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcb64005c10 tx=0x7fcb64009040 comp rx=0 tx=0).stop 2024-04-23T18:26:07.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 -- 172.21.15.28:0/1774970986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb6c070890 msgr2=0x7fcb6c14a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb6c070890 0x7fcb6c14a5f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800d5f0 tx=0x7fcb5800dab0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 -- 172.21.15.28:0/1774970986 shutdown_connections 2024-04-23T18:26:07.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fcb4c068380 0x7fcb4c06a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcb6c0c8a80 0x7fcb6c0c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcb6c070890 0x7fcb6c14a5f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 --2- 172.21.15.28:0/1774970986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb6c06ee90 0x7fcb6c0c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 -- 172.21.15.28:0/1774970986 >> 172.21.15.28:0/1774970986 conn(0x7fcb6c0ce850 msgr2=0x7fcb6c0cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 -- 172.21.15.28:0/1774970986 shutdown_connections 2024-04-23T18:26:07.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.147+0000 7fcb74000640 1 -- 172.21.15.28:0/1774970986 wait complete. 2024-04-23T18:26:07.163 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '247798b0', seconds elapsed: 29.9 2024-04-23T18:26:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.55 2024-04-23T18:26:07.163 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:26:07.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.375+0000 7f88f3c00640 1 Processor -- start 2024-04-23T18:26:07.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.375+0000 7f88f3c00640 1 -- start start 2024-04-23T18:26:07.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f3c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f88ec1531a0 0x7f88ec0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f3c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f88ec0c9a00 0x7f88ec158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f3c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ec0c3bc0 con 0x7f88ec0c9e70 2024-04-23T18:26:07.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f3c00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f88ec0c4940 con 0x7f88ec0c9a00 2024-04-23T18:26:07.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f3c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f88ec0c6790 con 0x7f88ec1531a0 2024-04-23T18:26:07.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88ebe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f88ec0c9a00 0x7f88ec158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f1200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f88ec1531a0 0x7f88ec0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f1c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f88ec0c9e70 0x7f88ec072f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:48214/0 (socket says 172.21.15.28:48214) 2024-04-23T18:26:07.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f1c00640 1 -- 172.21.15.28:0/2396585589 learned_addr learned my addr 172.21.15.28:0/2396585589 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:26:07.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f1200640 1 -- 172.21.15.28:0/2396585589 >> v2:172.21.15.28:3300/0 conn(0x7f88ec0c9a00 msgr2=0x7f88ec158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f1200640 1 --2- 172.21.15.28:0/2396585589 >> v2:172.21.15.28:3300/0 conn(0x7f88ec0c9a00 0x7f88ec158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f1200640 1 -- 172.21.15.28:0/2396585589 >> v1:172.21.15.137:6789/0 conn(0x7f88ec0c9e70 legacy=0x7f88ec072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.379+0000 7f88f1200640 1 -- 172.21.15.28:0/2396585589 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec0c6a70 con 0x7f88ec1531a0 2024-04-23T18:26:07.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88f1200640 1 --2- 172.21.15.28:0/2396585589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec1531a0 0x7f88ec0c5ec0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f88ec073d60 tx=0x7f88dc01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97fc947c2f0108ef server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88eb400640 1 -- 172.21.15.28:0/2396585589 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0b5070 con 0x7f88ec1531a0 2024-04-23T18:26:07.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88eb400640 1 -- 172.21.15.28:0/2396585589 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88dc0a8970 con 0x7f88ec1531a0 2024-04-23T18:26:07.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88eb400640 1 -- 172.21.15.28:0/2396585589 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0a8d40 con 0x7f88ec1531a0 2024-04-23T18:26:07.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88f3c00640 1 -- 172.21.15.28:0/2396585589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec1531a0 msgr2=0x7f88ec0c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88f3c00640 1 --2- 172.21.15.28:0/2396585589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec1531a0 0x7f88ec0c5ec0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f88ec073d60 tx=0x7f88dc01ec70 comp rx=0 tx=0).stop 2024-04-23T18:26:07.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88f3c00640 1 -- 172.21.15.28:0/2396585589 shutdown_connections 2024-04-23T18:26:07.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88f3c00640 1 --2- 172.21.15.28:0/2396585589 >> v2:172.21.15.28:3300/0 conn(0x7f88ec0c9a00 0x7f88ec158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88f3c00640 1 --2- 172.21.15.28:0/2396585589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec1531a0 0x7f88ec0c5ec0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88f3c00640 1 -- 172.21.15.28:0/2396585589 >> 172.21.15.28:0/2396585589 conn(0x7f88ec06d0a0 msgr2=0x7f88ec0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88f3c00640 1 -- 172.21.15.28:0/2396585589 shutdown_connections 2024-04-23T18:26:07.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.383+0000 7f88f3c00640 1 -- 172.21.15.28:0/2396585589 wait complete. 2024-04-23T18:26:07.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.387+0000 7f88f3c00640 1 Processor -- start 2024-04-23T18:26:07.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.387+0000 7f88f3c00640 1 -- start start 2024-04-23T18:26:07.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f3c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88ec0c9a00 0x7f88ec1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f3c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec1531a0 0x7f88ec141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f3c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88ec156470 0x7f88ec153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f3c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec0c4420 con 0x7f88ec0c9a00 2024-04-23T18:26:07.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f3c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec0c4140 con 0x7f88ec1531a0 2024-04-23T18:26:07.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f3c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f88ec153580 con 0x7f88ec156470 2024-04-23T18:26:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f1200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88ec0c9a00 0x7f88ec1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f1200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88ec0c9a00 0x7f88ec1558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34656/0 (socket says 172.21.15.28:34656) 2024-04-23T18:26:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f1200640 1 -- 172.21.15.28:0/1311439378 learned_addr learned my addr 172.21.15.28:0/1311439378 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88ebe00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec1531a0 0x7f88ec141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f1c00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88ec156470 0x7f88ec153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f1200640 1 -- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88ec156470 msgr2=0x7f88ec153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f1200640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88ec156470 0x7f88ec153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f1200640 1 -- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec1531a0 msgr2=0x7f88ec141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f1200640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec1531a0 0x7f88ec141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f1200640 1 -- 172.21.15.28:0/1311439378 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec1f3410 con 0x7f88ec0c9a00 2024-04-23T18:26:07.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f1c00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88ec156470 0x7f88ec153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:26:07.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f1200640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88ec0c9a00 0x7f88ec1558f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0b3040 tx=0x7f88dc01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88e8c00640 1 -- 172.21.15.28:0/1311439378 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0bf070 con 0x7f88ec0c9a00 2024-04-23T18:26:07.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88e8c00640 1 -- 172.21.15.28:0/1311439378 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88dc0b0640 con 0x7f88ec0c9a00 2024-04-23T18:26:07.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88e8c00640 1 -- 172.21.15.28:0/1311439378 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0b5040 con 0x7f88ec0c9a00 2024-04-23T18:26:07.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f3c00640 1 -- 172.21.15.28:0/1311439378 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ec148c60 con 0x7f88ec0c9a00 2024-04-23T18:26:07.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f3c00640 1 -- 172.21.15.28:0/1311439378 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ec147130 con 0x7f88ec0c9a00 2024-04-23T18:26:07.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.391+0000 7f88f3c00640 1 -- 172.21.15.28:0/1311439378 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ec068cd0 con 0x7f88ec0c9a00 2024-04-23T18:26:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.395+0000 7f88e8c00640 1 -- 172.21.15.28:0/1311439378 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88dc0c2070 con 0x7f88ec0c9a00 2024-04-23T18:26:07.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.395+0000 7f88e8c00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f88c80683d0 0x7f88c806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.395+0000 7f88e8c00640 1 -- 172.21.15.28:0/1311439378 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f88dc1235b0 con 0x7f88ec0c9a00 2024-04-23T18:26:07.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.399+0000 7f88ebe00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f88c80683d0 0x7f88c806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.399+0000 7f88ebe00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f88c80683d0 0x7f88c806a890 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0cd6a0 tx=0x7f88d4009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.403+0000 7f88e8c00640 1 -- 172.21.15.28:0/1311439378 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f88dc0187d0 con 0x7f88ec0c9a00 2024-04-23T18:26:07.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.643+0000 7f88f3c00640 1 -- 172.21.15.28:0/1311439378 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88ec148ec0 con 0x7f88ec0c9a00 2024-04-23T18:26:07.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88e8c00640 1 -- 172.21.15.28:0/1311439378 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f88dc0f3200 con 0x7f88ec0c9a00 2024-04-23T18:26:07.639 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:26:07.639 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:26:07.640 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:26:07.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 -- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f88c80683d0 msgr2=0x7f88c806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f88c80683d0 0x7f88c806a890 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0cd6a0 tx=0x7f88d4009190 comp rx=0 tx=0).stop 2024-04-23T18:26:07.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 -- 172.21.15.28:0/1311439378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88ec0c9a00 msgr2=0x7f88ec1558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88ec0c9a00 0x7f88ec1558f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0b3040 tx=0x7f88dc01ba10 comp rx=0 tx=0).stop 2024-04-23T18:26:07.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 -- 172.21.15.28:0/1311439378 shutdown_connections 2024-04-23T18:26:07.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f88c80683d0 0x7f88c806a890 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f88ec156470 0x7f88ec153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec1531a0 0x7f88ec141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 --2- 172.21.15.28:0/1311439378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88ec0c9a00 0x7f88ec1558f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 -- 172.21.15.28:0/1311439378 >> 172.21.15.28:0/1311439378 conn(0x7f88ec06d0a0 msgr2=0x7f88ec145170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 -- 172.21.15.28:0/1311439378 shutdown_connections 2024-04-23T18:26:07.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.647+0000 7f88f3c00640 1 -- 172.21.15.28:0/1311439378 wait complete. 2024-04-23T18:26:07.661 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4297 quiesce db / --timeout 60 --expiration 87.55 --await-for 42.0' 2024-04-23T18:26:07.662 DEBUG:teuthology.orchestra.run.smithi028:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4297 quiesce db / --timeout 60 --expiration 87.55 --await-for 42.0 2024-04-23T18:26:07.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa707c00640 1 Processor -- start 2024-04-23T18:26:07.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa707c00640 1 -- start start 2024-04-23T18:26:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa707c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7001521f0 0x7fa70015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa707c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa700072c40 0x7fa700073090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa707c00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa70015c150 con 0x7fa70015f1b0 2024-04-23T18:26:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa707c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa7000c5cc0 con 0x7fa700072c40 2024-04-23T18:26:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa707c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa70015b8b0 con 0x7fa7001521f0 2024-04-23T18:26:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa6ffe00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa70015f1b0 0x7fa7000c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:51244/0 (socket says 172.21.15.28:51244) 2024-04-23T18:26:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa6ffe00640 1 -- 172.21.15.28:0/3806219654 learned_addr learned my addr 172.21.15.28:0/3806219654 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:26:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa705200640 1 --2- 172.21.15.28:0/3806219654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7001521f0 0x7fa70015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa705c00640 1 --2- 172.21.15.28:0/3806219654 >> v2:172.21.15.137:3300/0 conn(0x7fa700072c40 0x7fa700073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa6ff400640 1 -- 172.21.15.28:0/3806219654 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837526992 0 0) 0x7fa70015c150 con 0x7fa70015f1b0 2024-04-23T18:26:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.823+0000 7fa6ff400640 1 -- 172.21.15.28:0/3806219654 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6e8003530 con 0x7fa70015f1b0 2024-04-23T18:26:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.827+0000 7fa705c00640 1 -- 172.21.15.28:0/3806219654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7001521f0 msgr2=0x7fa70015b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.827+0000 7fa705c00640 1 --2- 172.21.15.28:0/3806219654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7001521f0 0x7fa70015b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.827+0000 7fa705c00640 1 -- 172.21.15.28:0/3806219654 >> v1:172.21.15.28:6789/0 conn(0x7fa70015f1b0 legacy=0x7fa7000c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.827+0000 7fa705c00640 1 -- 172.21.15.28:0/3806219654 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70015bb90 con 0x7fa700072c40 2024-04-23T18:26:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.827+0000 7fa705200640 1 --2- 172.21.15.28:0/3806219654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7001521f0 0x7fa70015b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:26:07.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.827+0000 7fa705c00640 1 --2- 172.21.15.28:0/3806219654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa700072c40 0x7fa700073090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009d90 tx=0x7fa6f801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b6f01ff3c1cb026 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.827+0000 7fa6ff400640 1 -- 172.21.15.28:0/3806219654 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80b2070 con 0x7fa700072c40 2024-04-23T18:26:07.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.827+0000 7fa6ff400640 1 -- 172.21.15.28:0/3806219654 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f80a5940 con 0x7fa700072c40 2024-04-23T18:26:07.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.827+0000 7fa6ff400640 1 -- 172.21.15.28:0/3806219654 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80a5cf0 con 0x7fa700072c40 2024-04-23T18:26:07.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 -- 172.21.15.28:0/3806219654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa700072c40 msgr2=0x7fa700073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 --2- 172.21.15.28:0/3806219654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa700072c40 0x7fa700073090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009d90 tx=0x7fa6f801c970 comp rx=0 tx=0).stop 2024-04-23T18:26:07.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 -- 172.21.15.28:0/3806219654 shutdown_connections 2024-04-23T18:26:07.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 --2- 172.21.15.28:0/3806219654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa700072c40 0x7fa700073090 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 --2- 172.21.15.28:0/3806219654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7001521f0 0x7fa70015b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 -- 172.21.15.28:0/3806219654 >> 172.21.15.28:0/3806219654 conn(0x7fa700075dd0 msgr2=0x7fa70006ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 -- 172.21.15.28:0/3806219654 shutdown_connections 2024-04-23T18:26:07.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 -- 172.21.15.28:0/3806219654 wait complete. 2024-04-23T18:26:07.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 Processor -- start 2024-04-23T18:26:07.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 -- start start 2024-04-23T18:26:07.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa700072c40 0x7fa7001550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7001521f0 0x7fa700156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa70015f1b0 0x7fa700156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa70015f710 con 0x7fa700072c40 2024-04-23T18:26:07.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa70015f590 con 0x7fa70015f1b0 2024-04-23T18:26:07.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa707c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa7000c6860 con 0x7fa7001521f0 2024-04-23T18:26:07.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa705200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa700072c40 0x7fa7001550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa705200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa700072c40 0x7fa7001550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34658/0 (socket says 172.21.15.28:34658) 2024-04-23T18:26:07.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa705200640 1 -- 172.21.15.28:0/1013839836 learned_addr learned my addr 172.21.15.28:0/1013839836 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:07.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa6ffe00640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7001521f0 0x7fa700156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa705c00640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa70015f1b0 0x7fa700156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.831+0000 7fa705200640 1 -- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7001521f0 msgr2=0x7fa700156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa705200640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7001521f0 0x7fa700156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa705200640 1 -- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa70015f1b0 msgr2=0x7fa700156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa705200640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa70015f1b0 0x7fa700156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa705200640 1 -- 172.21.15.28:0/1013839836 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa700157f60 con 0x7fa700072c40 2024-04-23T18:26:07.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa705200640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa700072c40 0x7fa7001550e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400ebe0 tx=0x7fa6f400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa6fcc00640 1 -- 172.21.15.28:0/1013839836 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4017070 con 0x7fa700072c40 2024-04-23T18:26:07.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa6fcc00640 1 -- 172.21.15.28:0/1013839836 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f400cbd0 con 0x7fa700072c40 2024-04-23T18:26:07.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa6fcc00640 1 -- 172.21.15.28:0/1013839836 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4013470 con 0x7fa700072c40 2024-04-23T18:26:07.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa707c00640 1 -- 172.21.15.28:0/1013839836 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7001581d0 con 0x7fa700072c40 2024-04-23T18:26:07.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa707c00640 1 -- 172.21.15.28:0/1013839836 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa700158790 con 0x7fa700072c40 2024-04-23T18:26:07.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa6fcc00640 1 -- 172.21.15.28:0/1013839836 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6f401a070 con 0x7fa700072c40 2024-04-23T18:26:07.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa6fcc00640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa6e0068380 0x7fa6e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.835+0000 7fa6fcc00640 1 -- 172.21.15.28:0/1013839836 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa6f4086cb0 con 0x7fa700072c40 2024-04-23T18:26:07.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa6ffe00640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa6e0068380 0x7fa6e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 Processor -- start 2024-04-23T18:26:07.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 -- start start 2024-04-23T18:26:07.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa6ffe00640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa6e0068380 0x7fa6e006a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec007fd0 tx=0x7fa6ec009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd8599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85e6c0 0x55a7dd85eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd85efe0 0x55a7dd85f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55a7dd7052a0 con 0x55a7dd859600 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a7dd66b5f0 con 0x55a7dd85e6c0 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55a7dd606820 con 0x55a7dd85efe0 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa705200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd8599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa705200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd8599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34670/0 (socket says 172.21.15.28:34670) 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa705200640 1 -- 172.21.15.28:0/570414794 learned_addr learned my addr 172.21.15.28:0/570414794 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa6ffe00640 1 --2- 172.21.15.28:0/570414794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85e6c0 0x55a7dd85eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa705c00640 1 --2- 172.21.15.28:0/570414794 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd85efe0 0x55a7dd85f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa705200640 1 -- 172.21.15.28:0/570414794 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd85efe0 msgr2=0x55a7dd85f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa705200640 1 --2- 172.21.15.28:0/570414794 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd85efe0 0x55a7dd85f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa705200640 1 -- 172.21.15.28:0/570414794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85e6c0 msgr2=0x55a7dd85eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa705200640 1 --2- 172.21.15.28:0/570414794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85e6c0 0x55a7dd85eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa705200640 1 -- 172.21.15.28:0/570414794 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7dd6b1c00 con 0x55a7dd859600 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa6ffe00640 1 --2- 172.21.15.28:0/570414794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85e6c0 0x55a7dd85eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:26:07.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa705200640 1 --2- 172.21.15.28:0/570414794 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd8599e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400f010 tx=0x7fa6f40566f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4d568797a723d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa6f1600640 1 -- 172.21.15.28:0/570414794 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4083070 con 0x55a7dd859600 2024-04-23T18:26:07.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa6f1600640 1 -- 172.21.15.28:0/570414794 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f406d030 con 0x55a7dd859600 2024-04-23T18:26:07.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa6f1600640 1 -- 172.21.15.28:0/570414794 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4021040 con 0x55a7dd859600 2024-04-23T18:26:07.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 -- 172.21.15.28:0/570414794 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 msgr2=0x55a7dd8599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 --2- 172.21.15.28:0/570414794 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd8599e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400f010 tx=0x7fa6f40566f0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 -- 172.21.15.28:0/570414794 shutdown_connections 2024-04-23T18:26:07.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 --2- 172.21.15.28:0/570414794 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd85efe0 0x55a7dd85f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 --2- 172.21.15.28:0/570414794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85e6c0 0x55a7dd85eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 --2- 172.21.15.28:0/570414794 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd8599e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 -- 172.21.15.28:0/570414794 >> 172.21.15.28:0/570414794 conn(0x55a7dd85a470 msgr2=0x55a7dd85c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 -- 172.21.15.28:0/570414794 shutdown_connections 2024-04-23T18:26:07.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.839+0000 7fa70b000000 1 -- 172.21.15.28:0/570414794 wait complete. 2024-04-23T18:26:07.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 -- start start 2024-04-23T18:26:07.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 Processor -- start 2024-04-23T18:26:07.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd859600 0x55a7dd8589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85e6c0 0x55a7dd858f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85efe0 0x55a7dd864830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55a7dd616c60 con 0x55a7dd85e6c0 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a7dd6edbf0 con 0x55a7dd85efe0 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55a7dd728560 con 0x55a7dd859600 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 10 client.0 _ll_register_callbacks cb 0x55a7dd642570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85e6c0 0x55a7dd858f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85e6c0 0x55a7dd858f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34674/0 (socket says 172.21.15.28:34674) 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6ffe00640 1 -- 172.21.15.28:0/3589629684 learned_addr learned my addr 172.21.15.28:0/3589629684 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa705c00640 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85efe0 0x55a7dd864830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa705200640 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd859600 0x55a7dd8589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6ffe00640 1 -- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd859600 msgr2=0x55a7dd8589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6ffe00640 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd859600 0x55a7dd8589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6ffe00640 1 -- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85efe0 msgr2=0x55a7dd864830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6ffe00640 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85efe0 0x55a7dd864830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6ffe00640 1 -- 172.21.15.28:0/3589629684 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7dd6a6630 con 0x55a7dd85e6c0 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6ffe00640 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85e6c0 0x55a7dd858f20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec015790 tx=0x7fa6ec0010b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c1d3efa77d83d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6e6000640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6e6000640 1 -- 172.21.15.28:0/3589629684 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec013680 con 0x55a7dd85e6c0 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 -- 172.21.15.28:0/3589629684 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6f406d030 con 0x55a7dd85e6c0 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6e6000640 1 -- 172.21.15.28:0/3589629684 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa6ec010040 con 0x55a7dd85e6c0 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6e6000640 1 -- 172.21.15.28:0/3589629684 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fa6ec02e050 con 0x55a7dd85e6c0 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 10 client.5298 fetch_fsmap learned FSMap version 15 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 -- 172.21.15.28:0/3589629684 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a7dd60b490 con 0x55a7dd85e6c0 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6e6000640 1 -- 172.21.15.28:0/3589629684 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f406d030 con 0x55a7dd85e6c0 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa6e6000640 1 -- 172.21.15.28:0/3589629684 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fa6ec031020 con 0x55a7dd85e6c0 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 10 client.5298 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 10 client.5298 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 20 client.5298 populate_metadata read hostname 'smithi028' 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a7dd8655d0 0x55a7dd8659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 4 client.5298 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:26:07.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa70b000000 1 -- 172.21.15.28:0/3589629684 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7dd6057f0 con 0x55a7dd8655d0 2024-04-23T18:26:07.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.843+0000 7fa705200640 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a7dd8655d0 0x55a7dd8659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa705200640 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a7dd8655d0 0x55a7dd8659e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7466ee98d1db02df server_cookie=5d9a6f0e957a2df3 in_seq=0 out_seq=0 2024-04-23T18:26:07.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa6e6000640 10 client.5298 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:07.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa6e6000640 1 -- 172.21.15.28:0/3589629684 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a7dd6057f0 con 0x55a7dd8655d0 2024-04-23T18:26:07.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa6e6000640 10 client.5298 handle_command_reply: tid=0 2024-04-23T18:26:07.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 1 client.5298 shutdown 2024-04-23T18:26:07.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 1 -- 172.21.15.28:0/3589629684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85e6c0 msgr2=0x55a7dd858f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85e6c0 0x55a7dd858f20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec015790 tx=0x7fa6ec0010b0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 1 -- 172.21.15.28:0/3589629684 shutdown_connections 2024-04-23T18:26:07.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a7dd8655d0 0x55a7dd8659e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85efe0 0x55a7dd864830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85e6c0 0x55a7dd858f20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 1 --2- 172.21.15.28:0/3589629684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd859600 0x55a7dd8589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 1 -- 172.21.15.28:0/3589629684 >> 172.21.15.28:0/3589629684 conn(0x55a7dd85a470 msgr2=0x55a7dd85d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa6e6000640 0 client.5298 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:07.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 1 -- 172.21.15.28:0/3589629684 shutdown_connections 2024-04-23T18:26:07.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 1 -- 172.21.15.28:0/3589629684 wait complete. 2024-04-23T18:26:07.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.847+0000 7fa70b000000 20 client.5298 trim_cache size 0 max 16384 2024-04-23T18:26:07.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 Processor -- start 2024-04-23T18:26:07.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 -- start start 2024-04-23T18:26:07.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd879010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd85e6c0 0x55a7dd879550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85efe0 0x55a7dd879a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa700200b40 con 0x55a7dd859600 2024-04-23T18:26:07.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa7001ffe70 con 0x55a7dd85efe0 2024-04-23T18:26:07.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa700200490 con 0x55a7dd85e6c0 2024-04-23T18:26:07.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa705200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd879010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa705200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd879010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34684/0 (socket says 172.21.15.28:34684) 2024-04-23T18:26:07.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa705200640 1 -- 172.21.15.28:0/3972823611 learned_addr learned my addr 172.21.15.28:0/3972823611 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:07.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa705c00640 1 --2- 172.21.15.28:0/3972823611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85efe0 0x55a7dd879a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa6ffe00640 1 --2- 172.21.15.28:0/3972823611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd85e6c0 0x55a7dd879550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa705200640 1 -- 172.21.15.28:0/3972823611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd85e6c0 msgr2=0x55a7dd879550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa705200640 1 --2- 172.21.15.28:0/3972823611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd85e6c0 0x55a7dd879550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa705200640 1 -- 172.21.15.28:0/3972823611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85efe0 msgr2=0x55a7dd879a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa705200640 1 --2- 172.21.15.28:0/3972823611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85efe0 0x55a7dd879a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa705200640 1 -- 172.21.15.28:0/3972823611 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7dd606a70 con 0x55a7dd859600 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa705200640 1 --2- 172.21.15.28:0/3972823611 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd879010 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa6f405abb0 tx=0x7fa6f401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabc94701a7b98d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa6f0c00640 1 -- 172.21.15.28:0/3972823611 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4072070 con 0x55a7dd859600 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa6f0c00640 1 -- 172.21.15.28:0/3972823611 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f406d040 con 0x55a7dd859600 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa6f0c00640 1 -- 172.21.15.28:0/3972823611 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4083040 con 0x55a7dd859600 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 -- 172.21.15.28:0/3972823611 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 msgr2=0x55a7dd879010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 --2- 172.21.15.28:0/3972823611 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd879010 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa6f405abb0 tx=0x7fa6f401e000 comp rx=0 tx=0).stop 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 -- 172.21.15.28:0/3972823611 shutdown_connections 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 --2- 172.21.15.28:0/3972823611 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd85e6c0 0x55a7dd879550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 --2- 172.21.15.28:0/3972823611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85efe0 0x55a7dd879a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 --2- 172.21.15.28:0/3972823611 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd859600 0x55a7dd879010 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 -- 172.21.15.28:0/3972823611 >> 172.21.15.28:0/3972823611 conn(0x55a7dd85a470 msgr2=0x55a7dd86feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 -- 172.21.15.28:0/3972823611 shutdown_connections 2024-04-23T18:26:07.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 -- 172.21.15.28:0/3972823611 wait complete. 2024-04-23T18:26:07.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.867+0000 7fa70b000000 1 -- start start 2024-04-23T18:26:07.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 1 Processor -- start 2024-04-23T18:26:07.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd859600 0x55a7dd86fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85e6c0 0x55a7dd870270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85efe0 0x55a7dd8211c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x55a7dd66a900 con 0x55a7dd85efe0 2024-04-23T18:26:07.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a7dd635e60 con 0x55a7dd85e6c0 2024-04-23T18:26:07.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x55a7dd66fc20 con 0x55a7dd859600 2024-04-23T18:26:07.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 10 client.0 _ll_register_callbacks cb 0x7fa6ec007bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:26:07.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85efe0 0x55a7dd8211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85efe0 0x55a7dd8211c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34692/0 (socket says 172.21.15.28:34692) 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705c00640 1 -- 172.21.15.28:0/2844241372 learned_addr learned my addr 172.21.15.28:0/2844241372 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705200640 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd859600 0x55a7dd86fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa6ffe00640 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85e6c0 0x55a7dd870270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705c00640 1 -- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd859600 msgr2=0x55a7dd86fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705c00640 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd859600 0x55a7dd86fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705c00640 1 -- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85e6c0 msgr2=0x55a7dd870270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705c00640 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85e6c0 0x55a7dd870270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705c00640 1 -- 172.21.15.28:0/2844241372 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7dd6ee080 con 0x55a7dd85efe0 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705200640 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd859600 0x55a7dd86fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705c00640 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85efe0 0x55a7dd8211c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80b0040 tx=0x7fa6f801b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d4aabfb0dbb9f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa6e6000640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa6e6000640 1 -- 172.21.15.28:0/2844241372 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80c9060 con 0x55a7dd85efe0 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa6e6000640 1 -- 172.21.15.28:0/2844241372 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa6f8003be0 con 0x55a7dd85efe0 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 1 -- 172.21.15.28:0/2844241372 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6f406d040 con 0x55a7dd85efe0 2024-04-23T18:26:07.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa6e6000640 1 -- 172.21.15.28:0/2844241372 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fa6f80b2040 con 0x55a7dd85efe0 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 10 client.5304 fetch_fsmap learned FSMap version 15 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 1 -- 172.21.15.28:0/2844241372 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a7dd6113e0 con 0x55a7dd85efe0 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa6e6000640 1 -- 172.21.15.28:0/2844241372 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f406d040 con 0x55a7dd85efe0 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa6e6000640 1 -- 172.21.15.28:0/2844241372 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fa6f80b8040 con 0x55a7dd85efe0 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 10 client.5304 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 10 client.5304 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 20 client.5304 populate_metadata read hostname 'smithi028' 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a7dd8d8a80 0x55a7dd8dae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 4 client.5304 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.55, "await_for": 42.0}] 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa70b000000 1 -- 172.21.15.28:0/2844241372 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.55, "await_for": 42.0}) -- 0x55a7dd614940 con 0x55a7dd8d8a80 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.871+0000 7fa705200640 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a7dd8d8a80 0x55a7dd8dae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.875+0000 7fa705200640 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a7dd8d8a80 0x55a7dd8dae70 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a66bcde24586e139 server_cookie=6668b5e42f59f132 in_seq=0 out_seq=0 2024-04-23T18:26:07.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.875+0000 7fa6e6000640 10 client.5304 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:07.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa6e6000640 1 -- 172.21.15.28:0/2844241372 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a7dd614940 con 0x55a7dd8d8a80 2024-04-23T18:26:07.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa6e6000640 10 client.5304 handle_command_reply: tid=0 2024-04-23T18:26:07.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 1 client.5304 shutdown 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 1 -- 172.21.15.28:0/2844241372 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85efe0 msgr2=0x55a7dd8211c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85efe0 0x55a7dd8211c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80b0040 tx=0x7fa6f801b1b0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 1 -- 172.21.15.28:0/2844241372 shutdown_connections 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x55a7dd8d8a80 0x55a7dd8dae70 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7dd85efe0 0x55a7dd8211c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a7dd85e6c0 0x55a7dd870270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa6e6000640 0 client.5304 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 1 --2- 172.21.15.28:0/2844241372 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55a7dd859600 0x55a7dd86fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 1 -- 172.21.15.28:0/2844241372 >> 172.21.15.28:0/2844241372 conn(0x55a7dd85a470 msgr2=0x55a7dd86f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 1 -- 172.21.15.28:0/2844241372 shutdown_connections 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 1 -- 172.21.15.28:0/2844241372 wait complete. 2024-04-23T18:26:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.887+0000 7fa70b000000 20 client.5304 trim_cache size 0 max 16384 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 15, 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: "leader": 4297, 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: "set_version": 14, 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: "sets": { 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: "2cd46e4e": { 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: "version": 14, 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: "age_ref": 0.0, 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "QUIESCED", 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:26:07.884 INFO:teuthology.orchestra.run.smithi028.stdout: "timeout": 60.0, 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: "expiration": 87.5, 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: "members": { 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: "file:/": { 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: "excluded": false, 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "QUIESCED", 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:07.885 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:26:07.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 -- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa6e0068380 msgr2=0x7fa6e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa6e0068380 0x7fa6e006a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec007fd0 tx=0x7fa6ec009040 comp rx=0 tx=0).stop 2024-04-23T18:26:07.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 -- 172.21.15.28:0/1013839836 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa700072c40 msgr2=0x7fa7001550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:07.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa700072c40 0x7fa7001550e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400ebe0 tx=0x7fa6f400c520 comp rx=0 tx=0).stop 2024-04-23T18:26:07.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 -- 172.21.15.28:0/1013839836 shutdown_connections 2024-04-23T18:26:07.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa6e0068380 0x7fa6e006a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7001521f0 0x7fa700156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa70015f1b0 0x7fa700156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 --2- 172.21.15.28:0/1013839836 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa700072c40 0x7fa7001550e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:07.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 -- 172.21.15.28:0/1013839836 >> 172.21.15.28:0/1013839836 conn(0x7fa700075dd0 msgr2=0x7fa7000cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:07.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 -- 172.21.15.28:0/1013839836 shutdown_connections 2024-04-23T18:26:07.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:07.891+0000 7fa707c00640 1 -- 172.21.15.28:0/1013839836 wait complete. 2024-04-23T18:26:07.902 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2cd46e4e', quiesce took 0.7 seconds. Will release after: 27.55 2024-04-23T18:26:28.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:26:28.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:26:35.453 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:26:35.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd3a00640 1 Processor -- start 2024-04-23T18:26:35.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd3a00640 1 -- start start 2024-04-23T18:26:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd3a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4bcc072080 0x7f4bcc0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd3a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4bcc152370 0x7f4bcc0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd3a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bcc0c9de0 con 0x7f4bcc151f90 2024-04-23T18:26:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd3a00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f4bcc0ca080 con 0x7f4bcc152370 2024-04-23T18:26:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd3a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4bcc158cf0 con 0x7f4bcc072080 2024-04-23T18:26:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd1a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4bcc152370 0x7f4bcc0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd1a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4bcc152370 0x7f4bcc0c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56322/0 (socket says 172.21.15.28:56322) 2024-04-23T18:26:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd1a00640 1 -- 172.21.15.28:0/2488494501 learned_addr learned my addr 172.21.15.28:0/2488494501 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bcbe00640 1 --2- 172.21.15.28:0/2488494501 >> v2:172.21.15.137:3300/0 conn(0x7f4bcc072080 0x7f4bcc0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd1a00640 1 -- 172.21.15.28:0/2488494501 >> v2:172.21.15.137:3300/0 conn(0x7f4bcc072080 msgr2=0x7f4bcc0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:35.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd1a00640 1 --2- 172.21.15.28:0/2488494501 >> v2:172.21.15.137:3300/0 conn(0x7f4bcc072080 0x7f4bcc0718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.610+0000 7f4bd1a00640 1 -- 172.21.15.28:0/2488494501 >> v1:172.21.15.137:6789/0 conn(0x7f4bcc151f90 legacy=0x7f4bcc15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:35.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bd1a00640 1 -- 172.21.15.28:0/2488494501 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bcc157f30 con 0x7f4bcc152370 2024-04-23T18:26:35.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bd1a00640 1 --2- 172.21.15.28:0/2488494501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bcc152370 0x7f4bcc0c96a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0c8c80 tx=0x7f4bc401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b197a343ee63c103 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bcb400640 1 -- 172.21.15.28:0/2488494501 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40b4070 con 0x7f4bcc152370 2024-04-23T18:26:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bcb400640 1 -- 172.21.15.28:0/2488494501 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc40af400 con 0x7f4bcc152370 2024-04-23T18:26:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bcb400640 1 -- 172.21.15.28:0/2488494501 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40af7d0 con 0x7f4bcc152370 2024-04-23T18:26:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bd3a00640 1 -- 172.21.15.28:0/2488494501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bcc152370 msgr2=0x7f4bcc0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bd3a00640 1 --2- 172.21.15.28:0/2488494501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bcc152370 0x7f4bcc0c96a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0c8c80 tx=0x7f4bc401f1e0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bd3a00640 1 -- 172.21.15.28:0/2488494501 shutdown_connections 2024-04-23T18:26:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bd3a00640 1 --2- 172.21.15.28:0/2488494501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bcc152370 0x7f4bcc0c96a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bd3a00640 1 --2- 172.21.15.28:0/2488494501 >> v2:172.21.15.137:3300/0 conn(0x7f4bcc072080 0x7f4bcc0718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bd3a00640 1 -- 172.21.15.28:0/2488494501 >> 172.21.15.28:0/2488494501 conn(0x7f4bcc06d0a0 msgr2=0x7f4bcc0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:35.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bd3a00640 1 -- 172.21.15.28:0/2488494501 shutdown_connections 2024-04-23T18:26:35.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.614+0000 7f4bd3a00640 1 -- 172.21.15.28:0/2488494501 wait complete. 2024-04-23T18:26:35.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd3a00640 1 Processor -- start 2024-04-23T18:26:35.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd3a00640 1 -- start start 2024-04-23T18:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd3a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bcc072080 0x7f4bcc156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd3a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bcc151f90 0x7f4bcc148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd3a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bcc152370 0x7f4bcc1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd3a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc1587d0 con 0x7f4bcc152370 2024-04-23T18:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd3a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc1584f0 con 0x7f4bcc072080 2024-04-23T18:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd3a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f4bcc15baa0 con 0x7f4bcc151f90 2024-04-23T18:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd1a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bcc152370 0x7f4bcc1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd1a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bcc152370 0x7f4bcc1599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56338/0 (socket says 172.21.15.28:56338) 2024-04-23T18:26:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd1a00640 1 -- 172.21.15.28:0/1878175474 learned_addr learned my addr 172.21.15.28:0/1878175474 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd1000640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bcc072080 0x7f4bcc156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bcbe00640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bcc151f90 0x7f4bcc148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd1a00640 1 -- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bcc151f90 msgr2=0x7f4bcc148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd1a00640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bcc151f90 0x7f4bcc148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd1a00640 1 -- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bcc072080 msgr2=0x7f4bcc156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd1a00640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bcc072080 0x7f4bcc156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd1a00640 1 -- 172.21.15.28:0/1878175474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bcc0c5630 con 0x7f4bcc152370 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd1a00640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bcc152370 0x7f4bcc1599d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4bc401ce10 tx=0x7f4bc401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bc8c00640 1 -- 172.21.15.28:0/1878175474 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40c0070 con 0x7f4bcc152370 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bc8c00640 1 -- 172.21.15.28:0/1878175474 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc40afcc0 con 0x7f4bcc152370 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bc8c00640 1 -- 172.21.15.28:0/1878175474 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40b4040 con 0x7f4bcc152370 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.618+0000 7f4bd3a00640 1 -- 172.21.15.28:0/1878175474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bcc1e36f0 con 0x7f4bcc152370 2024-04-23T18:26:35.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.622+0000 7f4bd3a00640 1 -- 172.21.15.28:0/1878175474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bcc1e3cb0 con 0x7f4bcc152370 2024-04-23T18:26:35.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.622+0000 7f4bd3a00640 1 -- 172.21.15.28:0/1878175474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bcc068cd0 con 0x7f4bcc152370 2024-04-23T18:26:35.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.622+0000 7f4bc8c00640 1 -- 172.21.15.28:0/1878175474 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4bc40c3070 con 0x7f4bcc152370 2024-04-23T18:26:35.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.622+0000 7f4bc8c00640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4bac068380 0x7f4bac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:35.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.622+0000 7f4bc8c00640 1 -- 172.21.15.28:0/1878175474 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4bc4124370 con 0x7f4bcc152370 2024-04-23T18:26:35.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.622+0000 7f4bd1000640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4bac068380 0x7f4bac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:35.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.626+0000 7f4bd1000640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4bac068380 0x7f4bac06a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0001810 tx=0x7f4bc0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:35.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.626+0000 7f4bc8c00640 1 -- 172.21.15.28:0/1878175474 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4bc4018d40 con 0x7f4bcc152370 2024-04-23T18:26:35.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.826+0000 7f4bd3a00640 1 -- 172.21.15.28:0/1878175474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bcc071280 con 0x7f4bcc152370 2024-04-23T18:26:35.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bc8c00640 1 -- 172.21.15.28:0/1878175474 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f4bc40f3e70 con 0x7f4bcc152370 2024-04-23T18:26:35.824 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:26:35.824 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:26:35.824 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:26:35.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 -- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4bac068380 msgr2=0x7f4bac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:35.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4bac068380 0x7f4bac06a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0001810 tx=0x7f4bc0009040 comp rx=0 tx=0).stop 2024-04-23T18:26:35.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 -- 172.21.15.28:0/1878175474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bcc152370 msgr2=0x7f4bcc1599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:35.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bcc152370 0x7f4bcc1599d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4bc401ce10 tx=0x7f4bc401bf80 comp rx=0 tx=0).stop 2024-04-23T18:26:35.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 -- 172.21.15.28:0/1878175474 shutdown_connections 2024-04-23T18:26:35.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4bac068380 0x7f4bac06a840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4bcc151f90 0x7f4bcc148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4bcc152370 0x7f4bcc1599d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 --2- 172.21.15.28:0/1878175474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bcc072080 0x7f4bcc156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 -- 172.21.15.28:0/1878175474 >> 172.21.15.28:0/1878175474 conn(0x7f4bcc06d0a0 msgr2=0x7f4bcc0c70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:35.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 -- 172.21.15.28:0/1878175474 shutdown_connections 2024-04-23T18:26:35.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.830+0000 7f4bd3a00640 1 -- 172.21.15.28:0/1878175474 wait complete. 2024-04-23T18:26:35.845 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4297 quiesce db --set-id 2cd46e4e --release --await' 2024-04-23T18:26:35.845 DEBUG:teuthology.orchestra.run.smithi028:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4297 quiesce db --set-id 2cd46e4e --release --await 2024-04-23T18:26:35.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc695600640 1 Processor -- start 2024-04-23T18:26:35.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc695600640 1 -- start start 2024-04-23T18:26:35.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc695600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc6900c9850 0x7fc690073c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:35.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc695600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6900c71f0 con 0x7fc690158f80 2024-04-23T18:26:35.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc695600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc690071d20 con 0x7fc690071940 2024-04-23T18:26:35.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc695600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc690070d40 con 0x7fc6900c9850 2024-04-23T18:26:35.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc686000640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc690158f80 0x7fc6900c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39288/0 (socket says 172.21.15.28:39288) 2024-04-23T18:26:35.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc686000640 1 -- 172.21.15.28:0/1927501576 learned_addr learned my addr 172.21.15.28:0/1927501576 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:26:35.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68f400640 1 --2- 172.21.15.28:0/1927501576 >> v2:172.21.15.137:3300/0 conn(0x7fc6900c9850 0x7fc690073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:35.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643996132 0 0) 0x7fc6900c71f0 con 0x7fc690158f80 2024-04-23T18:26:35.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc674003530 con 0x7fc690158f80 2024-04-23T18:26:35.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2799266334 0 0) 0x7fc674003530 con 0x7fc690158f80 2024-04-23T18:26:35.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 >> v2:172.21.15.137:3300/0 conn(0x7fc6900c9850 msgr2=0x7fc690073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:35.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68e000640 1 --2- 172.21.15.28:0/1927501576 >> v2:172.21.15.137:3300/0 conn(0x7fc6900c9850 0x7fc690073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 >> v1:172.21.15.137:6789/0 conn(0x7fc690071940 legacy=0x7fc6900ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc690159410 con 0x7fc690158f80 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7fc678001680 con 0x7fc690158f80 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68f400640 1 --2- 172.21.15.28:0/1927501576 >> v2:172.21.15.137:3300/0 conn(0x7fc6900c9850 0x7fc690073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 >> v1:172.21.15.28:6789/0 conn(0x7fc690158f80 legacy=0x7fc6900c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68e000640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 0x7fc674003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:35.998+0000 7fc68e000640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc674004810 0x7fc674004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68e000640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6740051d0 0x7fc67400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc67400c050 con 0x7fc6740039c0 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc67400c200 con 0x7fc6740051d0 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc67400c400 con 0x7fc674004810 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68ea00640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 0x7fc674003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc686000640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc674004810 0x7fc674004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68f400640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6740051d0 0x7fc67400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68ea00640 1 -- 172.21.15.28:0/1927501576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc674004810 msgr2=0x7fc674004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:35.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68ea00640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc674004810 0x7fc674004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68ea00640 1 -- 172.21.15.28:0/1927501576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6740051d0 msgr2=0x7fc67400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:35.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68ea00640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6740051d0 0x7fc67400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:35.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68ea00640 1 -- 172.21.15.28:0/1927501576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc674003530 con 0x7fc6740039c0 2024-04-23T18:26:35.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68f400640 1 -- 172.21.15.28:0/1927501576 reap_dead start 2024-04-23T18:26:35.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc686000640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc674004810 0x7fc674004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:26:35.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68ea00640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 0x7fc674003de0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc680001780 tx=0x7fc68001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2236b336e18557a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:35.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6800013a0 con 0x7fc6740039c0 2024-04-23T18:26:35.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6800052f0 con 0x7fc6740039c0 2024-04-23T18:26:35.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.002+0000 7fc68e000640 1 -- 172.21.15.28:0/1927501576 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680003840 con 0x7fc6740039c0 2024-04-23T18:26:36.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 -- 172.21.15.28:0/1927501576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 msgr2=0x7fc674003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:36.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 0x7fc674003de0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc680001780 tx=0x7fc68001c400 comp rx=0 tx=0).stop 2024-04-23T18:26:36.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 -- 172.21.15.28:0/1927501576 shutdown_connections 2024-04-23T18:26:36.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 --2- 172.21.15.28:0/1927501576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 0x7fc674003de0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 -- 172.21.15.28:0/1927501576 >> 172.21.15.28:0/1927501576 conn(0x7fc690075e30 msgr2=0x7fc6900676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:36.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 -- 172.21.15.28:0/1927501576 shutdown_connections 2024-04-23T18:26:36.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 -- 172.21.15.28:0/1927501576 wait complete. 2024-04-23T18:26:36.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 Processor -- start 2024-04-23T18:26:36.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 -- start start 2024-04-23T18:26:36.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 0x7fc690151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc690150450 0x7fc6900c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc690151d50 0x7fc6901e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc690159cb0 con 0x7fc6740039c0 2024-04-23T18:26:36.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6901599d0 con 0x7fc690150450 2024-04-23T18:26:36.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc695600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc6900cc680 con 0x7fc690151d50 2024-04-23T18:26:36.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc68ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 0x7fc690151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc68ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 0x7fc690151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56358/0 (socket says 172.21.15.28:56358) 2024-04-23T18:26:36.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc68ea00640 1 -- 172.21.15.28:0/162515278 learned_addr learned my addr 172.21.15.28:0/162515278 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:36.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc68f400640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc690151d50 0x7fc6901e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc686000640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc690150450 0x7fc6900c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc68ea00640 1 -- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc690151d50 msgr2=0x7fc6901e41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:36.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc68ea00640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc690151d50 0x7fc6901e41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc68ea00640 1 -- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc690150450 msgr2=0x7fc6900c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:36.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc68ea00640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc690150450 0x7fc6900c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.006+0000 7fc68ea00640 1 -- 172.21.15.28:0/162515278 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6901f0fc0 con 0x7fc6740039c0 2024-04-23T18:26:36.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.010+0000 7fc68ea00640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 0x7fc690151300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc680000c10 tx=0x7fc674005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:36.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.010+0000 7fc687400640 1 -- 172.21.15.28:0/162515278 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6800013a0 con 0x7fc6740039c0 2024-04-23T18:26:36.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.010+0000 7fc687400640 1 -- 172.21.15.28:0/162515278 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6800ba070 con 0x7fc6740039c0 2024-04-23T18:26:36.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.010+0000 7fc687400640 1 -- 172.21.15.28:0/162515278 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680007a40 con 0x7fc6740039c0 2024-04-23T18:26:36.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.010+0000 7fc695600640 1 -- 172.21.15.28:0/162515278 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6901f1230 con 0x7fc6740039c0 2024-04-23T18:26:36.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.010+0000 7fc695600640 1 -- 172.21.15.28:0/162515278 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6901f17f0 con 0x7fc6740039c0 2024-04-23T18:26:36.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.010+0000 7fc687400640 1 -- 172.21.15.28:0/162515278 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc680007470 con 0x7fc6740039c0 2024-04-23T18:26:36.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.010+0000 7fc687400640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc66c0683d0 0x7fc66c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.010+0000 7fc687400640 1 -- 172.21.15.28:0/162515278 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc6801210d0 con 0x7fc6740039c0 2024-04-23T18:26:36.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc686000640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc66c0683d0 0x7fc66c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 Processor -- start 2024-04-23T18:26:36.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 -- start start 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f0a98a0 0x56198f0729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f072f00 0x56198f0732e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0ae120 0x56198f0ae500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x56198eeba660 con 0x56198f0ae120 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56198ee5f5d0 con 0x56198f0a98a0 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc686000640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc66c0683d0 0x7fc66c06a890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6901e3eb0 tx=0x7fc678001120 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x56198eeb6620 con 0x56198f072f00 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc68f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0ae120 0x56198f0ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc68f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0ae120 0x56198f0ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56364/0 (socket says 172.21.15.28:56364) 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc68f400640 1 -- 172.21.15.28:0/3186121016 learned_addr learned my addr 172.21.15.28:0/3186121016 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc68ea00640 1 --2- 172.21.15.28:0/3186121016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f0a98a0 0x56198f0729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc686000640 1 --2- 172.21.15.28:0/3186121016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f072f00 0x56198f0732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc68f400640 1 -- 172.21.15.28:0/3186121016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f072f00 msgr2=0x56198f0732e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:36.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc68f400640 1 --2- 172.21.15.28:0/3186121016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f072f00 0x56198f0732e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc68f400640 1 -- 172.21.15.28:0/3186121016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f0a98a0 msgr2=0x56198f0729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:36.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc68f400640 1 --2- 172.21.15.28:0/3186121016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f0a98a0 0x56198f0729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc68f400640 1 -- 172.21.15.28:0/3186121016 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198ee93bd0 con 0x56198f0ae120 2024-04-23T18:26:36.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc68f400640 1 --2- 172.21.15.28:0/3186121016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0ae120 0x56198f0ae500 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc6900c9dc0 tx=0x7fc688009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a6a70091a4e6fa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:36.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc67f400640 1 -- 172.21.15.28:0/3186121016 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688003db0 con 0x56198f0ae120 2024-04-23T18:26:36.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc67f400640 1 -- 172.21.15.28:0/3186121016 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc688004030 con 0x56198f0ae120 2024-04-23T18:26:36.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc67f400640 1 -- 172.21.15.28:0/3186121016 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688004400 con 0x56198f0ae120 2024-04-23T18:26:36.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 -- 172.21.15.28:0/3186121016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0ae120 msgr2=0x56198f0ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:36.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 --2- 172.21.15.28:0/3186121016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0ae120 0x56198f0ae500 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc6900c9dc0 tx=0x7fc688009750 comp rx=0 tx=0).stop 2024-04-23T18:26:36.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 -- 172.21.15.28:0/3186121016 shutdown_connections 2024-04-23T18:26:36.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 --2- 172.21.15.28:0/3186121016 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f072f00 0x56198f0732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 --2- 172.21.15.28:0/3186121016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0ae120 0x56198f0ae500 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 --2- 172.21.15.28:0/3186121016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f0a98a0 0x56198f0729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 -- 172.21.15.28:0/3186121016 >> 172.21.15.28:0/3186121016 conn(0x56198ef54b00 msgr2=0x56198f0abee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:36.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 -- 172.21.15.28:0/3186121016 shutdown_connections 2024-04-23T18:26:36.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 -- 172.21.15.28:0/3186121016 wait complete. 2024-04-23T18:26:36.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 -- start start 2024-04-23T18:26:36.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.014+0000 7fc698a04000 1 Processor -- start 2024-04-23T18:26:36.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f072f00 0x56198f0a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f0a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x56198ef77d40 con 0x56198f0a98a0 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56198ee74eb0 con 0x56198f072f00 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x56198eeb52a0 con 0x56198f0ae120 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 10 client.0 _ll_register_callbacks cb 0x56198f058a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc686000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f0a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc686000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f0a8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56374/0 (socket says 172.21.15.28:56374) 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc68ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f072f00 0x56198f0a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc686000640 1 -- 172.21.15.28:0/3297220783 learned_addr learned my addr 172.21.15.28:0/3297220783 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc68f400640 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc686000640 1 -- 172.21.15.28:0/3297220783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 msgr2=0x56198f06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc686000640 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f06d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc686000640 1 -- 172.21.15.28:0/3297220783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f072f00 msgr2=0x56198f0a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc686000640 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f072f00 0x56198f0a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc686000640 1 -- 172.21.15.28:0/3297220783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56198ef00b30 con 0x56198f0a98a0 2024-04-23T18:26:36.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc686000640 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f0a8b90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc690069a90 tx=0x7fc678001c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d2b2ae805a4d59 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc673e00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc673e00640 1 -- 172.21.15.28:0/3297220783 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc678010040 con 0x56198f0a98a0 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc673e00640 1 -- 172.21.15.28:0/3297220783 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc67801bb90 con 0x56198f0a98a0 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 1 -- 172.21.15.28:0/3297220783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56198ee54060 con 0x56198f0a98a0 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc673e00640 1 -- 172.21.15.28:0/3297220783 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fc67801bd90 con 0x56198f0a98a0 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 10 client.5322 fetch_fsmap learned FSMap version 15 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 1 -- 172.21.15.28:0/3297220783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x56198ee59b70 con 0x56198f0a98a0 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc673e00640 1 -- 172.21.15.28:0/3297220783 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56198ee54060 con 0x56198f0a98a0 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc673e00640 1 -- 172.21.15.28:0/3297220783 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fc67801b3d0 con 0x56198f0a98a0 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 10 client.5322 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 10 client.5322 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 20 client.5322 populate_metadata read hostname 'smithi028' 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56198f06e670 0x56198f06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 4 client.5322 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:26:36.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc698a04000 1 -- 172.21.15.28:0/3297220783 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56198ee92e30 con 0x56198f06e670 2024-04-23T18:26:36.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc68ea00640 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56198f06e670 0x56198f06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc68ea00640 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56198f06e670 0x56198f06ea80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dd1ecef0aef7929 server_cookie=ae200ac93acab8e6 in_seq=0 out_seq=0 2024-04-23T18:26:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.018+0000 7fc673e00640 10 client.5322 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc673e00640 1 -- 172.21.15.28:0/3297220783 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56198ee92e30 con 0x56198f06e670 2024-04-23T18:26:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc673e00640 10 client.5322 handle_command_reply: tid=0 2024-04-23T18:26:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 1 client.5322 shutdown 2024-04-23T18:26:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 1 -- 172.21.15.28:0/3297220783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 msgr2=0x56198f0a8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f0a8b90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc690069a90 tx=0x7fc678001c50 comp rx=0 tx=0).stop 2024-04-23T18:26:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 1 -- 172.21.15.28:0/3297220783 shutdown_connections 2024-04-23T18:26:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56198f06e670 0x56198f06ea80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f0a8b90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc673e00640 0 client.5322 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:36.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 1 --2- 172.21.15.28:0/3297220783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f072f00 0x56198f0a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 1 -- 172.21.15.28:0/3297220783 >> 172.21.15.28:0/3297220783 conn(0x56198ef54b00 msgr2=0x56198f0ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:36.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 1 -- 172.21.15.28:0/3297220783 shutdown_connections 2024-04-23T18:26:36.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 1 -- 172.21.15.28:0/3297220783 wait complete. 2024-04-23T18:26:36.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.022+0000 7fc698a04000 20 client.5322 trim_cache size 0 max 16384 2024-04-23T18:26:36.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.038+0000 7fc698a04000 1 Processor -- start 2024-04-23T18:26:36.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.038+0000 7fc698a04000 1 -- start start 2024-04-23T18:26:36.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f072f00 0x56198f117af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f0a98a0 0x56198f118030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f118570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc6901fe3b0 con 0x56198f072f00 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6901fd6d0 con 0x56198f0a98a0 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc6901fdd20 con 0x56198f0ae120 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc68ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f072f00 0x56198f117af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc68ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f072f00 0x56198f117af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56382/0 (socket says 172.21.15.28:56382) 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc68ea00640 1 -- 172.21.15.28:0/1712913448 learned_addr learned my addr 172.21.15.28:0/1712913448 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc68f400640 1 --2- 172.21.15.28:0/1712913448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f118570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc686000640 1 --2- 172.21.15.28:0/1712913448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f0a98a0 0x56198f118030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc68ea00640 1 -- 172.21.15.28:0/1712913448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 msgr2=0x56198f118570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc68ea00640 1 --2- 172.21.15.28:0/1712913448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f118570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc68ea00640 1 -- 172.21.15.28:0/1712913448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f0a98a0 msgr2=0x56198f118030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc68ea00640 1 --2- 172.21.15.28:0/1712913448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f0a98a0 0x56198f118030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc68ea00640 1 -- 172.21.15.28:0/1712913448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198ef3c5e0 con 0x56198f072f00 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc686000640 1 --2- 172.21.15.28:0/1712913448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f0a98a0 0x56198f118030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:26:36.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc68ea00640 1 --2- 172.21.15.28:0/1712913448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f072f00 0x56198f117af0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc68001c8e0 tx=0x7fc68011f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540775a49b5c8bd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:36.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc67ea00640 1 -- 172.21.15.28:0/1712913448 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68011f2f0 con 0x56198f072f00 2024-04-23T18:26:36.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc67ea00640 1 -- 172.21.15.28:0/1712913448 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6800eefb0 con 0x56198f072f00 2024-04-23T18:26:36.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc67ea00640 1 -- 172.21.15.28:0/1712913448 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6800ed320 con 0x56198f072f00 2024-04-23T18:26:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- 172.21.15.28:0/1712913448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f072f00 msgr2=0x56198f117af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 --2- 172.21.15.28:0/1712913448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f072f00 0x56198f117af0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc68001c8e0 tx=0x7fc68011f140 comp rx=0 tx=0).stop 2024-04-23T18:26:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- 172.21.15.28:0/1712913448 shutdown_connections 2024-04-23T18:26:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 --2- 172.21.15.28:0/1712913448 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f118570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 --2- 172.21.15.28:0/1712913448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f0a98a0 0x56198f118030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 --2- 172.21.15.28:0/1712913448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f072f00 0x56198f117af0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- 172.21.15.28:0/1712913448 >> 172.21.15.28:0/1712913448 conn(0x56198ef54b00 msgr2=0x56198f070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- 172.21.15.28:0/1712913448 shutdown_connections 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- 172.21.15.28:0/1712913448 wait complete. 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- start start 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 Processor -- start 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f072f00 0x56198f11bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f11c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f11cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x56198eeb9970 con 0x56198f0a98a0 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56198ee6f8f0 con 0x56198f072f00 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x56198eebec90 con 0x56198f0ae120 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc698a04000 10 client.0 _ll_register_callbacks cb 0x7fc678014b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc686000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f11c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc686000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f11c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56388/0 (socket says 172.21.15.28:56388) 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.042+0000 7fc686000640 1 -- 172.21.15.28:0/551977719 learned_addr learned my addr 172.21.15.28:0/551977719 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:26:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc68f400640 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f11cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc68ea00640 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f072f00 0x56198f11bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc686000640 1 -- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 msgr2=0x56198f11cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc686000640 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f11cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc686000640 1 -- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f072f00 msgr2=0x56198f11bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc686000640 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f072f00 0x56198f11bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc686000640 1 -- 172.21.15.28:0/551977719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56198ee4cae0 con 0x56198f0a98a0 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc686000640 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f11c460 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc678014750 tx=0x7fc678019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64e264e30340662 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc673e00640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc673e00640 1 -- 172.21.15.28:0/551977719 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67803f020 con 0x56198f0a98a0 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc673e00640 1 -- 172.21.15.28:0/551977719 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc67801b160 con 0x56198f0a98a0 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc698a04000 1 -- 172.21.15.28:0/551977719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6800eefb0 con 0x56198f0a98a0 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc673e00640 1 -- 172.21.15.28:0/551977719 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fc678049050 con 0x56198f0a98a0 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc698a04000 10 client.5328 fetch_fsmap learned FSMap version 15 2024-04-23T18:26:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc698a04000 1 -- 172.21.15.28:0/551977719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x56198ee4fd80 con 0x56198f0a98a0 2024-04-23T18:26:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc673e00640 1 -- 172.21.15.28:0/551977719 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6800eefb0 con 0x56198f0a98a0 2024-04-23T18:26:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc673e00640 1 -- 172.21.15.28:0/551977719 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fc67804c020 con 0x56198f0a98a0 2024-04-23T18:26:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc698a04000 10 client.5328 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:26:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc698a04000 10 client.5328 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:26:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc698a04000 20 client.5328 populate_metadata read hostname 'smithi028' 2024-04-23T18:26:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc698a04000 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56198f11dae0 0x56198f11def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:26:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc698a04000 4 client.5328 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2cd46e4e", "release": true, "await": true}] 2024-04-23T18:26:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc698a04000 1 -- 172.21.15.28:0/551977719 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2cd46e4e", "release": true, "await": true}) -- 0x56198ee580d0 con 0x56198f11dae0 2024-04-23T18:26:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc68ea00640 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56198f11dae0 0x56198f11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:26:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc68ea00640 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56198f11dae0 0x56198f11def0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca50d4c35840eb07 server_cookie=bc87c8cbfb033d8b in_seq=0 out_seq=0 2024-04-23T18:26:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.046+0000 7fc673e00640 10 client.5328 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc673e00640 1 -- 172.21.15.28:0/551977719 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56198ee580d0 con 0x56198f11dae0 2024-04-23T18:26:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc673e00640 10 client.5328 handle_command_reply: tid=0 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 1 client.5328 shutdown 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 1 -- 172.21.15.28:0/551977719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 msgr2=0x56198f11c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f11c460 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc678014750 tx=0x7fc678019000 comp rx=0 tx=0).stop 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 1 -- 172.21.15.28:0/551977719 shutdown_connections 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x56198f11dae0 0x56198f11def0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x56198f0ae120 0x56198f11cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56198f0a98a0 0x56198f11c460 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 1 --2- 172.21.15.28:0/551977719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56198f072f00 0x56198f11bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 1 -- 172.21.15.28:0/551977719 >> 172.21.15.28:0/551977719 conn(0x56198ef54b00 msgr2=0x56198f06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc673e00640 0 client.5328 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 1 -- 172.21.15.28:0/551977719 shutdown_connections 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 1 -- 172.21.15.28:0/551977719 wait complete. 2024-04-23T18:26:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc698a04000 20 client.5328 trim_cache size 0 max 16384 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 15, 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "leader": 4297, 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "set_version": 16, 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "sets": { 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "2cd46e4e": { 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "version": 16, 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "age_ref": 0.0, 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RELEASED", 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "timeout": 60.0, 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "expiration": 87.5, 2024-04-23T18:26:36.047 INFO:teuthology.orchestra.run.smithi028.stdout: "members": { 2024-04-23T18:26:36.048 INFO:teuthology.orchestra.run.smithi028.stdout: "file:/": { 2024-04-23T18:26:36.048 INFO:teuthology.orchestra.run.smithi028.stdout: "excluded": false, 2024-04-23T18:26:36.048 INFO:teuthology.orchestra.run.smithi028.stdout: "state": { 2024-04-23T18:26:36.048 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "RELEASED", 2024-04-23T18:26:36.048 INFO:teuthology.orchestra.run.smithi028.stdout: "age": 0.0 2024-04-23T18:26:36.048 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:36.048 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:36.048 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:36.048 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:36.048 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-04-23T18:26:36.048 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 -- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc66c0683d0 msgr2=0x7fc66c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc66c0683d0 0x7fc66c06a890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6901e3eb0 tx=0x7fc678001120 comp rx=0 tx=0).stop 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 -- 172.21.15.28:0/162515278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 msgr2=0x7fc690151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 0x7fc690151300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc680000c10 tx=0x7fc674005840 comp rx=0 tx=0).stop 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 -- 172.21.15.28:0/162515278 shutdown_connections 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc66c0683d0 0x7fc66c06a890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc690151d50 0x7fc6901e41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc690150450 0x7fc6900c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 --2- 172.21.15.28:0/162515278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6740039c0 0x7fc690151300 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 -- 172.21.15.28:0/162515278 >> 172.21.15.28:0/162515278 conn(0x7fc690075e30 msgr2=0x7fc6900cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 -- 172.21.15.28:0/162515278 shutdown_connections 2024-04-23T18:26:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:26:36.050+0000 7fc695600640 1 -- 172.21.15.28:0/162515278 wait complete. 2024-04-23T18:26:36.066 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2cd46e4e', seconds elapsed: 28.9 2024-04-23T18:26:36.817 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:26:36.817 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 initial writers = 129244.21 kB/sec 2024-04-23T18:26:36.817 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 initial writers = 129243.34 kB/sec 2024-04-23T18:26:36.818 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 129244.21 kB/sec 2024-04-23T18:26:36.818 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 129244.21 kB/sec 2024-04-23T18:26:36.818 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 129244.21 kB/sec 2024-04-23T18:26:36.818 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 10485760.00 kB 2024-04-23T18:26:58.625 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:26:58.632 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:27:25.162 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:27:25.163 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 rewriters = 227785.81 kB/sec 2024-04-23T18:27:25.163 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 rewriters = 227783.27 kB/sec 2024-04-23T18:27:25.163 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 227785.81 kB/sec 2024-04-23T18:27:25.163 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 227785.81 kB/sec 2024-04-23T18:27:25.163 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 227785.81 kB/sec 2024-04-23T18:27:25.163 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 10485760.00 kB 2024-04-23T18:27:28.701 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:27:28.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:27:29.295 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:27:29.296 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 readers = 5955713.50 kB/sec 2024-04-23T18:27:29.296 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 readers = 5953938.05 kB/sec 2024-04-23T18:27:29.296 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 5955713.50 kB/sec 2024-04-23T18:27:29.296 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 5955713.50 kB/sec 2024-04-23T18:27:29.296 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 5955713.50 kB/sec 2024-04-23T18:27:29.296 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 10485760.00 kB 2024-04-23T18:27:34.128 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:27:34.129 INFO:tasks.workunit.client.0.smithi028.stdout: Children see throughput for 1 re-readers = 3906392.00 kB/sec 2024-04-23T18:27:34.129 INFO:tasks.workunit.client.0.smithi028.stdout: Parent sees throughput for 1 re-readers = 3905625.00 kB/sec 2024-04-23T18:27:34.129 INFO:tasks.workunit.client.0.smithi028.stdout: Min throughput per process = 3906392.00 kB/sec 2024-04-23T18:27:34.129 INFO:tasks.workunit.client.0.smithi028.stdout: Max throughput per process = 3906392.00 kB/sec 2024-04-23T18:27:34.129 INFO:tasks.workunit.client.0.smithi028.stdout: Avg throughput per process = 3906392.00 kB/sec 2024-04-23T18:27:34.129 INFO:tasks.workunit.client.0.smithi028.stdout: Min xfer = 10485760.00 kB 2024-04-23T18:27:42.166 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:27:42.166 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:27:42.167 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-04-23T18:27:42.167 INFO:tasks.workunit.client.0.smithi028.stdout:iozone test complete. 2024-04-23T18:27:42.169 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-23T18:27:42.169 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-23T18:27:43.175 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-04-23T18:27:43.176 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-23T18:27:45.268 DEBUG:teuthology.parallel:result is None 2024-04-23T18:27:45.268 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T18:27:45.313 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T18:27:45.313 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-23T18:27:45.324 INFO:tasks.quiescer:joining Quiescers 2024-04-23T18:27:45.324 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-04-23T18:27:45.324 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:27:45.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7118a00640 1 Processor -- start 2024-04-23T18:27:45.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7118a00640 1 -- start start 2024-04-23T18:27:45.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7118a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7114072080 0x7f71140718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:45.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7118a00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71140c9de0 con 0x7f7114152370 2024-04-23T18:27:45.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7118a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7114158cf0 con 0x7f7114151f90 2024-04-23T18:27:45.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7118a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f71140ca080 con 0x7f7114072080 2024-04-23T18:27:45.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7112800640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7114152370 0x7f71140c81d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49872/0 (socket says 172.21.15.28:49872) 2024-04-23T18:27:45.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7112800640 1 -- 172.21.15.28:0/2145334025 learned_addr learned my addr 172.21.15.28:0/2145334025 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:45.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f710be00640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7114072080 0x7f71140718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:45.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138491068 0 0) 0x7f71140c9de0 con 0x7f7114152370 2024-04-23T18:27:45.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70f8003530 con 0x7f7114152370 2024-04-23T18:27:45.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1933847270 0 0) 0x7f70f8003530 con 0x7f7114152370 2024-04-23T18:27:45.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7114072080 msgr2=0x7f71140718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:45.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7111400640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7114072080 0x7f71140718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:45.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 >> v1:172.21.15.137:6789/0 conn(0x7f7114151f90 legacy=0x7f711415b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:45.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7114157f30 con 0x7f7114152370 2024-04-23T18:27:45.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f710c001a20 con 0x7f7114152370 2024-04-23T18:27:45.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.545+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 >> v1:172.21.15.28:6789/0 conn(0x7f7114152370 legacy=0x7f71140c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:45.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7111400640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70f80039f0 0x7f70f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:45.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7111400640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7114072080 0x7f70f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:45.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7111400640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70f8004d50 0x7f70f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:45.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71140ca080 con 0x7f70f8004d50 2024-04-23T18:27:45.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70f800b9d0 con 0x7f70f80039f0 2024-04-23T18:27:45.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f70f800bbd0 con 0x7f7114072080 2024-04-23T18:27:45.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7112800640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70f8004d50 0x7f70f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:45.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7111e00640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70f80039f0 0x7f70f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:45.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f710be00640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7114072080 0x7f70f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:45.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7112800640 1 -- 172.21.15.28:0/2145334025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7114072080 msgr2=0x7f70f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:45.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7112800640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7114072080 0x7f70f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:45.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7112800640 1 -- 172.21.15.28:0/2145334025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70f80039f0 msgr2=0x7f70f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:45.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7112800640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70f80039f0 0x7f70f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:45.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7112800640 1 -- 172.21.15.28:0/2145334025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f8003530 con 0x7f70f8004d50 2024-04-23T18:27:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7112800640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70f8004d50 0x7f70f80051d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f710c00a7f0 tx=0x7f710c01d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13900d5a5e798161 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c00a450 con 0x7f70f8004d50 2024-04-23T18:27:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710c0072d0 con 0x7f70f8004d50 2024-04-23T18:27:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.549+0000 7f7111400640 1 -- 172.21.15.28:0/2145334025 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c0076c0 con 0x7f70f8004d50 2024-04-23T18:27:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 -- 172.21.15.28:0/2145334025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70f8004d50 msgr2=0x7f70f80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 --2- 172.21.15.28:0/2145334025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70f8004d50 0x7f70f80051d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f710c00a7f0 tx=0x7f710c01d2e0 comp rx=0 tx=0).stop 2024-04-23T18:27:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7112800640 1 -- 172.21.15.28:0/2145334025 reap_dead start 2024-04-23T18:27:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 -- 172.21.15.28:0/2145334025 shutdown_connections 2024-04-23T18:27:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 -- 172.21.15.28:0/2145334025 >> 172.21.15.28:0/2145334025 conn(0x7f711406d0a0 msgr2=0x7f71140676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 -- 172.21.15.28:0/2145334025 shutdown_connections 2024-04-23T18:27:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 -- 172.21.15.28:0/2145334025 wait complete. 2024-04-23T18:27:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 Processor -- start 2024-04-23T18:27:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 -- start start 2024-04-23T18:27:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8004d50 0x7f711414ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7114149270 0x7f71141f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71141f0ee0 0x7f71140c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71141587d0 con 0x7f7114149270 2024-04-23T18:27:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71141584f0 con 0x7f71141f0ee0 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7118a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f711415baa0 con 0x7f70f8004d50 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f710be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7114149270 0x7f71141f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f710be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7114149270 0x7f71141f44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49910/0 (socket says 172.21.15.28:49910) 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f710be00640 1 -- 172.21.15.28:0/1379673504 learned_addr learned my addr 172.21.15.28:0/1379673504 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7112800640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71141f0ee0 0x7f71140c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f7111e00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8004d50 0x7f711414ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f710be00640 1 -- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8004d50 msgr2=0x7f711414ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.553+0000 7f710be00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8004d50 0x7f711414ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f710be00640 1 -- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71141f0ee0 msgr2=0x7f71140c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f710be00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71141f0ee0 0x7f71140c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f710be00640 1 -- 172.21.15.28:0/1379673504 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71141f3d20 con 0x7f7114149270 2024-04-23T18:27:45.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f7111e00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8004d50 0x7f711414ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:45.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f710be00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7114149270 0x7f71141f44e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f70fc011610 tx=0x7f70fc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:45.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f710a000640 1 -- 172.21.15.28:0/1379673504 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00f8f0 con 0x7f7114149270 2024-04-23T18:27:45.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f710a000640 1 -- 172.21.15.28:0/1379673504 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70fc00fa90 con 0x7f7114149270 2024-04-23T18:27:45.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f710a000640 1 -- 172.21.15.28:0/1379673504 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00fe40 con 0x7f7114149270 2024-04-23T18:27:45.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f7118a00640 1 -- 172.21.15.28:0/1379673504 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71141e7d90 con 0x7f7114149270 2024-04-23T18:27:45.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f7118a00640 1 -- 172.21.15.28:0/1379673504 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71141e42e0 con 0x7f7114149270 2024-04-23T18:27:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f7118a00640 1 -- 172.21.15.28:0/1379673504 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7114068cd0 con 0x7f7114149270 2024-04-23T18:27:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f710a000640 1 -- 172.21.15.28:0/1379673504 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f70fc015460 con 0x7f7114149270 2024-04-23T18:27:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f710a000640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70f0068380 0x7f70f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f710a000640 1 -- 172.21.15.28:0/1379673504 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f70fc087470 con 0x7f7114149270 2024-04-23T18:27:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.557+0000 7f7111e00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70f0068380 0x7f70f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.561+0000 7f7111e00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70f0068380 0x7f70f006a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7104001980 tx=0x7f7104009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:45.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.561+0000 7f710a000640 1 -- 172.21.15.28:0/1379673504 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70fc019030 con 0x7f7114149270 2024-04-23T18:27:45.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.801+0000 7f7118a00640 1 -- 172.21.15.28:0/1379673504 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f711415b5d0 con 0x7f7114149270 2024-04-23T18:27:45.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.801+0000 7f710a000640 1 -- 172.21.15.28:0/1379673504 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f70fc057500 con 0x7f7114149270 2024-04-23T18:27:45.799 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:27:45.799 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:27:45.799 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:27:45.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.805+0000 7f7118a00640 1 -- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70f0068380 msgr2=0x7f70f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:45.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.805+0000 7f7118a00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70f0068380 0x7f70f006a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7104001980 tx=0x7f7104009040 comp rx=0 tx=0).stop 2024-04-23T18:27:45.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.805+0000 7f7118a00640 1 -- 172.21.15.28:0/1379673504 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7114149270 msgr2=0x7f71141f44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:45.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.805+0000 7f7118a00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7114149270 0x7f71141f44e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f70fc011610 tx=0x7f70fc011ad0 comp rx=0 tx=0).stop 2024-04-23T18:27:45.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.805+0000 7f7118a00640 1 -- 172.21.15.28:0/1379673504 shutdown_connections 2024-04-23T18:27:45.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.805+0000 7f7118a00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70f0068380 0x7f70f006a840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:45.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.805+0000 7f7118a00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71141f0ee0 0x7f71140c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:45.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.805+0000 7f7118a00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7114149270 0x7f71141f44e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:45.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.805+0000 7f7118a00640 1 --2- 172.21.15.28:0/1379673504 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70f8004d50 0x7f711414ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:45.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.805+0000 7f7118a00640 1 -- 172.21.15.28:0/1379673504 >> 172.21.15.28:0/1379673504 conn(0x7f711406d0a0 msgr2=0x7f71140c7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:45.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.805+0000 7f7118a00640 1 -- 172.21.15.28:0/1379673504 shutdown_connections 2024-04-23T18:27:45.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:45.809+0000 7f7118a00640 1 -- 172.21.15.28:0/1379673504 wait complete. 2024-04-23T18:27:45.830 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4297 quiesce db --cancel --all' 2024-04-23T18:27:45.830 DEBUG:teuthology.orchestra.run.smithi028:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4297 quiesce db --cancel --all 2024-04-23T18:27:46.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.033+0000 7fe88ee00640 1 Processor -- start 2024-04-23T18:27:46.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.033+0000 7fe88ee00640 1 -- start start 2024-04-23T18:27:46.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe88ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8880c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe88ee00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe8880c6230 0x7fe888155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe88ee00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8880c6780 con 0x7fe88815eba0 2024-04-23T18:27:46.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe88ee00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe8880c7780 con 0x7fe8880c6230 2024-04-23T18:27:46.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe88ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe8880c6db0 con 0x7fe8880c9100 2024-04-23T18:27:46.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe887400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8880c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe88ce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe8880c6230 0x7fe888155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe887400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8880c7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:55010/0 (socket says 172.21.15.28:55010) 2024-04-23T18:27:46.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe887400640 1 -- 172.21.15.28:0/2499183304 learned_addr learned my addr 172.21.15.28:0/2499183304 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:46.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe887400640 1 -- 172.21.15.28:0/2499183304 >> v2:172.21.15.137:3300/0 conn(0x7fe8880c6230 msgr2=0x7fe888155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe887400640 1 --2- 172.21.15.28:0/2499183304 >> v2:172.21.15.137:3300/0 conn(0x7fe8880c6230 0x7fe888155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe887400640 1 -- 172.21.15.28:0/2499183304 >> v1:172.21.15.28:6789/0 conn(0x7fe88815eba0 legacy=0x7fe88815ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.037+0000 7fe887400640 1 -- 172.21.15.28:0/2499183304 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88806d330 con 0x7fe8880c9100 2024-04-23T18:27:46.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.041+0000 7fe887400640 1 --2- 172.21.15.28:0/2499183304 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8880c7240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe874009870 tx=0x7fe87401ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c83a18939b67d8f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.045+0000 7fe886a00640 1 -- 172.21.15.28:0/2499183304 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8740b5070 con 0x7fe8880c9100 2024-04-23T18:27:46.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.045+0000 7fe886a00640 1 -- 172.21.15.28:0/2499183304 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8740a8a50 con 0x7fe8880c9100 2024-04-23T18:27:46.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.045+0000 7fe886a00640 1 -- 172.21.15.28:0/2499183304 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8740a8e20 con 0x7fe8880c9100 2024-04-23T18:27:46.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.045+0000 7fe88ee00640 1 -- 172.21.15.28:0/2499183304 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 msgr2=0x7fe8880c7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.045+0000 7fe88ee00640 1 --2- 172.21.15.28:0/2499183304 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8880c7240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe874009870 tx=0x7fe87401ed70 comp rx=0 tx=0).stop 2024-04-23T18:27:46.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.045+0000 7fe88ee00640 1 -- 172.21.15.28:0/2499183304 shutdown_connections 2024-04-23T18:27:46.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.045+0000 7fe88ee00640 1 --2- 172.21.15.28:0/2499183304 >> v2:172.21.15.137:3300/0 conn(0x7fe8880c6230 0x7fe888155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.045+0000 7fe88ee00640 1 --2- 172.21.15.28:0/2499183304 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8880c7240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.045+0000 7fe88ee00640 1 -- 172.21.15.28:0/2499183304 >> 172.21.15.28:0/2499183304 conn(0x7fe8880d0da0 msgr2=0x7fe8880d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:46.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.045+0000 7fe88ee00640 1 -- 172.21.15.28:0/2499183304 shutdown_connections 2024-04-23T18:27:46.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.045+0000 7fe88ee00640 1 -- 172.21.15.28:0/2499183304 wait complete. 2024-04-23T18:27:46.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe88ee00640 1 Processor -- start 2024-04-23T18:27:46.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe88ee00640 1 -- start start 2024-04-23T18:27:46.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe88ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8880c6230 0x7fe8881529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe88ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8881e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe88ee00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe88815eba0 0x7fe8881e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe88ee00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880c8880 con 0x7fe88815eba0 2024-04-23T18:27:46.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe88ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880c6a40 con 0x7fe8880c6230 2024-04-23T18:27:46.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe88ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe8880c8a00 con 0x7fe8880c9100 2024-04-23T18:27:46.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe887400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8881e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe88ce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe88815eba0 0x7fe8881e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe887e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8880c6230 0x7fe8881529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe887400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8881e7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:55012/0 (socket says 172.21.15.28:55012) 2024-04-23T18:27:46.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe88ce00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe88815eba0 0x7fe8881e81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49914/0 (socket says 172.21.15.28:49914) 2024-04-23T18:27:46.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.049+0000 7fe887400640 1 -- 172.21.15.28:0/664190580 learned_addr learned my addr 172.21.15.28:0/664190580 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:46.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.053+0000 7fe887400640 1 -- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8880c6230 msgr2=0x7fe8881529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.053+0000 7fe887400640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8880c6230 0x7fe8881529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.053+0000 7fe887400640 1 -- 172.21.15.28:0/664190580 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe88815eba0 msgr2=0x7fe8881e81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.053+0000 7fe887400640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe88815eba0 0x7fe8881e81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.053+0000 7fe887400640 1 -- 172.21.15.28:0/664190580 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8880b6180 con 0x7fe8880c9100 2024-04-23T18:27:46.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.053+0000 7fe887400640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8881e7c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8740b3040 tx=0x7fe87401bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.053+0000 7fe87fe00640 1 -- 172.21.15.28:0/664190580 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8740b5070 con 0x7fe8880c9100 2024-04-23T18:27:46.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.053+0000 7fe88ee00640 1 -- 172.21.15.28:0/664190580 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8880b5600 con 0x7fe8880c9100 2024-04-23T18:27:46.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.053+0000 7fe87fe00640 1 -- 172.21.15.28:0/664190580 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8740b0de0 con 0x7fe8880c9100 2024-04-23T18:27:46.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.053+0000 7fe88ee00640 1 -- 172.21.15.28:0/664190580 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8880b5bc0 con 0x7fe8880c9100 2024-04-23T18:27:46.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.053+0000 7fe87fe00640 1 -- 172.21.15.28:0/664190580 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8740bb670 con 0x7fe8880c9100 2024-04-23T18:27:46.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.057+0000 7fe87fe00640 1 -- 172.21.15.28:0/664190580 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe8740c2060 con 0x7fe8880c9100 2024-04-23T18:27:46.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.057+0000 7fe8921ed000 1 Processor -- start 2024-04-23T18:27:46.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.057+0000 7fe87fe00640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe868068380 0x7fe86806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.057+0000 7fe8921ed000 1 -- start start 2024-04-23T18:27:46.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.057+0000 7fe87fe00640 1 -- 172.21.15.28:0/664190580 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe8741242c0 con 0x7fe8880c9100 2024-04-23T18:27:46.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.057+0000 7fe88ce00640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe868068380 0x7fe86806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.057+0000 7fe88ce00640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe868068380 0x7fe86806a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe88804fd60 tx=0x7fe88000b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c5e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c63460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 0x559a86c63d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe8921ed000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x559a86b09b30 con 0x559a86c5e190 2024-04-23T18:27:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe8921ed000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559a86a702c0 con 0x559a86c5eab0 2024-04-23T18:27:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe8921ed000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x559a86a294c0 con 0x559a86c639a0 2024-04-23T18:27:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe88ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 0x559a86c63d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe88ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 0x559a86c63d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:55024/0 (socket says 172.21.15.28:55024) 2024-04-23T18:27:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe88ce00640 1 -- 172.21.15.28:0/3745825468 learned_addr learned my addr 172.21.15.28:0/3745825468 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe887400640 1 --2- 172.21.15.28:0/3745825468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c63460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe88ce00640 1 -- 172.21.15.28:0/3745825468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 msgr2=0x559a86c63460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe88ce00640 1 --2- 172.21.15.28:0/3745825468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c63460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe88ce00640 1 -- 172.21.15.28:0/3745825468 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 msgr2=0x559a86c5e570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T18:27:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe88ce00640 1 --2- 172.21.15.28:0/3745825468 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c5e570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe88ce00640 1 -- 172.21.15.28:0/3745825468 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a86a6aeb0 con 0x559a86c639a0 2024-04-23T18:27:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe88ce00640 1 --2- 172.21.15.28:0/3745825468 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 0x559a86c63d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe880016820 tx=0x7fe880014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52593c0377827e94 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe87cc00640 1 -- 172.21.15.28:0/3745825468 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88001d040 con 0x559a86c639a0 2024-04-23T18:27:46.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe87cc00640 1 -- 172.21.15.28:0/3745825468 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe880026070 con 0x559a86c639a0 2024-04-23T18:27:46.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe87cc00640 1 -- 172.21.15.28:0/3745825468 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880017980 con 0x559a86c639a0 2024-04-23T18:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe8921ed000 1 -- 172.21.15.28:0/3745825468 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 msgr2=0x559a86c63d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.061+0000 7fe8921ed000 1 --2- 172.21.15.28:0/3745825468 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 0x559a86c63d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe880016820 tx=0x7fe880014000 comp rx=0 tx=0).stop 2024-04-23T18:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.065+0000 7fe8921ed000 1 -- 172.21.15.28:0/3745825468 shutdown_connections 2024-04-23T18:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.065+0000 7fe8921ed000 1 --2- 172.21.15.28:0/3745825468 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 0x559a86c63d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.065+0000 7fe8921ed000 1 --2- 172.21.15.28:0/3745825468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c63460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.065+0000 7fe8921ed000 1 --2- 172.21.15.28:0/3745825468 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c5e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.065+0000 7fe8921ed000 1 -- 172.21.15.28:0/3745825468 >> 172.21.15.28:0/3745825468 conn(0x559a86c5f210 msgr2=0x559a86c61600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.065+0000 7fe8921ed000 1 -- 172.21.15.28:0/3745825468 shutdown_connections 2024-04-23T18:27:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.065+0000 7fe8921ed000 1 -- 172.21.15.28:0/3745825468 wait complete. 2024-04-23T18:27:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.065+0000 7fe8921ed000 1 -- start start 2024-04-23T18:27:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.065+0000 7fe8921ed000 1 Processor -- start 2024-04-23T18:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c5d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c5dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 0x559a86c68f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x559a86a6c280 con 0x559a86c5e190 2024-04-23T18:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559a86a2e9d0 con 0x559a86c5eab0 2024-04-23T18:27:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x559a86a151b0 con 0x559a86c639a0 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 10 client.0 _ll_register_callbacks cb 0x559a86b24700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe887400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c5dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe887400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c5dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:58630/0 (socket says 172.21.15.28:58630) 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe887400640 1 -- 172.21.15.28:0/1218132745 learned_addr learned my addr 172.21.15.28:0/1218132745 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe88ce00640 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 0x559a86c68f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe887e00640 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c5d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe88ce00640 1 -- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 msgr2=0x559a86c5dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe88ce00640 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c5dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe88ce00640 1 -- 172.21.15.28:0/1218132745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 msgr2=0x559a86c5d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe88ce00640 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c5d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe88ce00640 1 -- 172.21.15.28:0/1218132745 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x559a869f3e70 con 0x559a86c639a0 2024-04-23T18:27:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe887e00640 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c5d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:27:46.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe88ce00640 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 0x559a86c68f70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe8800167f0 tx=0x7fe880004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19788d5b8d2f0aba server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe871600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3301/0 2024-04-23T18:27:46.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe871600640 1 -- 172.21.15.28:0/1218132745 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88002a3f0 con 0x559a86c639a0 2024-04-23T18:27:46.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe871600640 1 -- 172.21.15.28:0/1218132745 <== mon.2 v2:172.21.15.137:3301/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe88002a590 con 0x559a86c639a0 2024-04-23T18:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 1 -- 172.21.15.28:0/1218132745 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe880026070 con 0x559a86c639a0 2024-04-23T18:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe871600640 1 -- 172.21.15.28:0/1218132745 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fe88003c050 con 0x559a86c639a0 2024-04-23T18:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 10 client.5075 fetch_fsmap learned FSMap version 15 2024-04-23T18:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 1 -- 172.21.15.28:0/1218132745 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x559a86a29710 con 0x559a86c639a0 2024-04-23T18:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe871600640 1 -- 172.21.15.28:0/1218132745 <== mon.2 v2:172.21.15.137:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe880026070 con 0x559a86c639a0 2024-04-23T18:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe871600640 1 -- 172.21.15.28:0/1218132745 <== mon.2 v2:172.21.15.137:3301/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fe88003f020 con 0x559a86c639a0 2024-04-23T18:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 10 client.5075 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 10 client.5075 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:27:46.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 20 client.5075 populate_metadata read hostname 'smithi028' 2024-04-23T18:27:46.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x559a86c69d10 0x559a86c6a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 4 client.5075 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T18:27:46.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.069+0000 7fe8921ed000 1 -- 172.21.15.28:0/1218132745 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a86a09df0 con 0x559a86c69d10 2024-04-23T18:27:46.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.073+0000 7fe887e00640 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x559a86c69d10 0x559a86c6a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.077+0000 7fe871600640 10 client.5075 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:27:46.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.077+0000 7fe887e00640 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x559a86c69d10 0x559a86c6a0f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b3603be8189fb51 server_cookie=38e35c9aca1cd375 in_seq=0 out_seq=0 2024-04-23T18:27:46.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.077+0000 7fe871600640 1 -- 172.21.15.28:0/1218132745 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559a86a09df0 con 0x559a86c69d10 2024-04-23T18:27:46.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.077+0000 7fe871600640 10 client.5075 handle_command_reply: tid=0 2024-04-23T18:27:46.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.077+0000 7fe8921ed000 1 client.5075 shutdown 2024-04-23T18:27:46.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.077+0000 7fe8921ed000 1 -- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 msgr2=0x559a86c68f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.077+0000 7fe8921ed000 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 0x559a86c68f70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe8800167f0 tx=0x7fe880004a50 comp rx=0 tx=0).stop 2024-04-23T18:27:46.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.081+0000 7fe8921ed000 1 -- 172.21.15.28:0/1218132745 shutdown_connections 2024-04-23T18:27:46.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.081+0000 7fe8921ed000 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x559a86c69d10 0x559a86c6a0f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.081+0000 7fe8921ed000 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c639a0 0x559a86c68f70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.081+0000 7fe8921ed000 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c5dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.081+0000 7fe8921ed000 1 --2- 172.21.15.28:0/1218132745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c5d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.081+0000 7fe871600640 0 client.5075 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:27:46.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.081+0000 7fe8921ed000 1 -- 172.21.15.28:0/1218132745 >> 172.21.15.28:0/1218132745 conn(0x559a86c5f210 msgr2=0x559a86c61600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:46.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.081+0000 7fe8921ed000 1 -- 172.21.15.28:0/1218132745 shutdown_connections 2024-04-23T18:27:46.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.081+0000 7fe8921ed000 1 -- 172.21.15.28:0/1218132745 wait complete. 2024-04-23T18:27:46.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.085+0000 7fe8921ed000 20 client.5075 trim_cache size 0 max 16384 2024-04-23T18:27:46.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.133+0000 7fe8921ed000 1 Processor -- start 2024-04-23T18:27:46.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.137+0000 7fe8921ed000 1 -- start start 2024-04-23T18:27:46.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.137+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5f210 0x559a86c6a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.137+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c6a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.137+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5eab0 0x559a86c6ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.137+0000 7fe8921ed000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe888201fa0 con 0x559a86c5e190 2024-04-23T18:27:46.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.137+0000 7fe8921ed000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880ca380 con 0x559a86c5f210 2024-04-23T18:27:46.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.137+0000 7fe8921ed000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe8882018d0 con 0x559a86c5eab0 2024-04-23T18:27:46.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe88ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5eab0 0x559a86c6ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe887e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5f210 0x559a86c6a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe887e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5f210 0x559a86c6a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:58638/0 (socket says 172.21.15.28:58638) 2024-04-23T18:27:46.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe887e00640 1 -- 172.21.15.28:0/1343426540 learned_addr learned my addr 172.21.15.28:0/1343426540 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:46.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe887e00640 1 -- 172.21.15.28:0/1343426540 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5eab0 msgr2=0x559a86c6ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe887e00640 1 --2- 172.21.15.28:0/1343426540 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5eab0 0x559a86c6ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe887e00640 1 -- 172.21.15.28:0/1343426540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 msgr2=0x559a86c6a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe887e00640 1 --2- 172.21.15.28:0/1343426540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c6a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe887e00640 1 -- 172.21.15.28:0/1343426540 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a86af29f0 con 0x559a86c5f210 2024-04-23T18:27:46.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe887e00640 1 --2- 172.21.15.28:0/1343426540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5f210 0x559a86c6a0f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe878005500 tx=0x7fe878007e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57a191c1024b4546 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe873e00640 1 -- 172.21.15.28:0/1343426540 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878004c40 con 0x559a86c5f210 2024-04-23T18:27:46.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe873e00640 1 -- 172.21.15.28:0/1343426540 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe878004de0 con 0x559a86c5f210 2024-04-23T18:27:46.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe873e00640 1 -- 172.21.15.28:0/1343426540 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878007250 con 0x559a86c5f210 2024-04-23T18:27:46.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe8921ed000 1 -- 172.21.15.28:0/1343426540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5f210 msgr2=0x559a86c6a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.141+0000 7fe8921ed000 1 --2- 172.21.15.28:0/1343426540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5f210 0x559a86c6a0f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe878005500 tx=0x7fe878007e40 comp rx=0 tx=0).stop 2024-04-23T18:27:46.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.145+0000 7fe8921ed000 1 -- 172.21.15.28:0/1343426540 shutdown_connections 2024-04-23T18:27:46.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.145+0000 7fe8921ed000 1 --2- 172.21.15.28:0/1343426540 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5eab0 0x559a86c6ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.145+0000 7fe8921ed000 1 --2- 172.21.15.28:0/1343426540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c6a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.145+0000 7fe8921ed000 1 --2- 172.21.15.28:0/1343426540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5f210 0x559a86c6a0f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.145+0000 7fe8921ed000 1 -- 172.21.15.28:0/1343426540 >> 172.21.15.28:0/1343426540 conn(0x559a86c7f040 msgr2=0x559a86c1e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:46.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.145+0000 7fe8921ed000 1 -- 172.21.15.28:0/1343426540 shutdown_connections 2024-04-23T18:27:46.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.145+0000 7fe8921ed000 1 -- 172.21.15.28:0/1343426540 wait complete. 2024-04-23T18:27:46.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.149+0000 7fe8921ed000 1 -- start start 2024-04-23T18:27:46.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.149+0000 7fe8921ed000 1 Processor -- start 2024-04-23T18:27:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c24950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c24e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe8921ed000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5f210 0x559a86c253d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe8921ed000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x559a86a6f5d0 con 0x559a86c5e190 2024-04-23T18:27:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe8921ed000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559a86a103d0 con 0x559a86c5eab0 2024-04-23T18:27:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe8921ed000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x559a86a748f0 con 0x559a86c5f210 2024-04-23T18:27:46.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe8921ed000 10 client.0 _ll_register_callbacks cb 0x7fe874009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T18:27:46.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe88ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5f210 0x559a86c253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe88ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5f210 0x559a86c253d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.28:55034/0 (socket says 172.21.15.28:55034) 2024-04-23T18:27:46.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe88ce00640 1 -- 172.21.15.28:0/623629586 learned_addr learned my addr 172.21.15.28:0/623629586 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:46.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe887400640 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c24e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.157+0000 7fe887e00640 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c24950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe88ce00640 1 -- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 msgr2=0x559a86c24e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe88ce00640 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c24e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe88ce00640 1 -- 172.21.15.28:0/623629586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 msgr2=0x559a86c24950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe88ce00640 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c24950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe88ce00640 1 -- 172.21.15.28:0/623629586 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) -- 0x559a86a3ad90 con 0x559a86c5f210 2024-04-23T18:27:46.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe88ce00640 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5f210 0x559a86c253d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8800164a0 tx=0x7fe880017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5fba0be7e014e23 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe871600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3301/0 2024-04-23T18:27:46.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe871600640 1 -- 172.21.15.28:0/623629586 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88002a720 con 0x559a86c5f210 2024-04-23T18:27:46.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe871600640 1 -- 172.21.15.28:0/623629586 <== mon.2 v2:172.21.15.137:3301/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe88002ac00 con 0x559a86c5f210 2024-04-23T18:27:46.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe8921ed000 1 -- 172.21.15.28:0/623629586 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe878004de0 con 0x559a86c5f210 2024-04-23T18:27:46.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe871600640 1 -- 172.21.15.28:0/623629586 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fe88002ae00 con 0x559a86c5f210 2024-04-23T18:27:46.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe8921ed000 10 client.5081 fetch_fsmap learned FSMap version 15 2024-04-23T18:27:46.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe8921ed000 1 -- 172.21.15.28:0/623629586 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x559a86a153a0 con 0x559a86c5f210 2024-04-23T18:27:46.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe871600640 1 -- 172.21.15.28:0/623629586 <== mon.2 v2:172.21.15.137:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe878004de0 con 0x559a86c5f210 2024-04-23T18:27:46.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe871600640 1 -- 172.21.15.28:0/623629586 <== mon.2 v2:172.21.15.137:3301/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fe88003f040 con 0x559a86c5f210 2024-04-23T18:27:46.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe8921ed000 10 client.5081 fetch_fsmap finished waiting for FSMap version 15 2024-04-23T18:27:46.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe8921ed000 10 client.5081 resolve_mds: validated gid 4297 aka daemon mds.b 2024-04-23T18:27:46.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.161+0000 7fe8921ed000 20 client.5081 populate_metadata read hostname 'smithi028' 2024-04-23T18:27:46.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.165+0000 7fe8921ed000 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x559a86c639a0 0x559a86ce03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.165+0000 7fe8921ed000 4 client.5081 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-23T18:27:46.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.165+0000 7fe8921ed000 1 -- 172.21.15.28:0/623629586 --> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x559a86a7dce0 con 0x559a86c639a0 2024-04-23T18:27:46.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.169+0000 7fe887e00640 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x559a86c639a0 0x559a86ce03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.169+0000 7fe887e00640 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x559a86c639a0 0x559a86ce03e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea7f7eea86d071f5 server_cookie=19727790ee461eab in_seq=0 out_seq=0 2024-04-23T18:27:46.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.169+0000 7fe871600640 10 client.5081 ms_handle_connect on v2:172.21.15.137:6837/1022932690 2024-04-23T18:27:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.169+0000 7fe871600640 1 -- 172.21.15.28:0/623629586 <== mds.0 v2:172.21.15.137:6837/1022932690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x559a86a7dce0 con 0x559a86c639a0 2024-04-23T18:27:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.169+0000 7fe871600640 10 client.5081 handle_command_reply: tid=0 2024-04-23T18:27:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.169+0000 7fe8921ed000 1 client.5081 shutdown 2024-04-23T18:27:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.169+0000 7fe8921ed000 1 -- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5f210 msgr2=0x559a86c253d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.169+0000 7fe8921ed000 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5f210 0x559a86c253d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8800164a0 tx=0x7fe880017000 comp rx=0 tx=0).stop 2024-04-23T18:27:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.173+0000 7fe8921ed000 1 -- 172.21.15.28:0/623629586 shutdown_connections 2024-04-23T18:27:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.173+0000 7fe8921ed000 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:6837/1022932690,v1:172.21.15.137:6839/1022932690] conn(0x559a86c639a0 0x559a86ce03e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.173+0000 7fe8921ed000 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x559a86c5f210 0x559a86c253d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.173+0000 7fe8921ed000 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a86c5eab0 0x559a86c24e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.173+0000 7fe8921ed000 1 --2- 172.21.15.28:0/623629586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559a86c5e190 0x559a86c24950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.173+0000 7fe8921ed000 1 -- 172.21.15.28:0/623629586 >> 172.21.15.28:0/623629586 conn(0x559a86c7f040 msgr2=0x559a86c6b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:46.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.173+0000 7fe871600640 0 client.5081 ms_handle_reset on v2:172.21.15.137:6837/1022932690 2024-04-23T18:27:46.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.173+0000 7fe8921ed000 1 -- 172.21.15.28:0/623629586 shutdown_connections 2024-04-23T18:27:46.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.173+0000 7fe8921ed000 1 -- 172.21.15.28:0/623629586 wait complete. 2024-04-23T18:27:46.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.173+0000 7fe8921ed000 20 client.5081 trim_cache size 0 max 16384 2024-04-23T18:27:46.170 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:27:46.170 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 15, 2024-04-23T18:27:46.170 INFO:teuthology.orchestra.run.smithi028.stdout: "leader": 4297, 2024-04-23T18:27:46.170 INFO:teuthology.orchestra.run.smithi028.stdout: "set_version": 16, 2024-04-23T18:27:46.170 INFO:teuthology.orchestra.run.smithi028.stdout: "sets": {} 2024-04-23T18:27:46.170 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:27:46.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 -- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe868068380 msgr2=0x7fe86806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe868068380 0x7fe86806a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe88804fd60 tx=0x7fe88000b040 comp rx=0 tx=0).stop 2024-04-23T18:27:46.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 -- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 msgr2=0x7fe8881e7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8881e7c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8740b3040 tx=0x7fe87401bb10 comp rx=0 tx=0).stop 2024-04-23T18:27:46.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 -- 172.21.15.28:0/664190580 shutdown_connections 2024-04-23T18:27:46.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe868068380 0x7fe86806a840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe8880c9100 0x7fe8881e7c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe88815eba0 0x7fe8881e81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 --2- 172.21.15.28:0/664190580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8880c6230 0x7fe8881529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 -- 172.21.15.28:0/664190580 >> 172.21.15.28:0/664190580 conn(0x7fe8880d0da0 msgr2=0x7fe88815d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:46.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 -- 172.21.15.28:0/664190580 shutdown_connections 2024-04-23T18:27:46.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.177+0000 7fe88ee00640 1 -- 172.21.15.28:0/664190580 wait complete. 2024-04-23T18:27:46.221 INFO:tasks.quiescer:done joining Quiescers 2024-04-23T18:27:46.222 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-23T18:27:46.231 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-23T18:27:46.231 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:27:46.231 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T18:27:46.249 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-04-23T18:27:46.249 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T18:27:46.309 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:27:46.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2f000640 1 Processor -- start 2024-04-23T18:27:46.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2f000640 1 -- start start 2024-04-23T18:27:46.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2f000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e280c91e0 0x7f6e280710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2f000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6e2806c3f0 0x7f6e2815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2f000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e2815b650 con 0x7f6e281444e0 2024-04-23T18:27:46.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2f000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f6e2815b930 con 0x7f6e2806c3f0 2024-04-23T18:27:46.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2f000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e2815bc10 con 0x7f6e280c91e0 2024-04-23T18:27:46.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2d000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6e2806c3f0 0x7f6e2815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2d000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6e2806c3f0 0x7f6e2815ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49950/0 (socket says 172.21.15.28:49950) 2024-04-23T18:27:46.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2d000640 1 -- 172.21.15.28:0/4122105937 learned_addr learned my addr 172.21.15.28:0/4122105937 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:46.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e27400640 1 --2- 172.21.15.28:0/4122105937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e280c91e0 0x7f6e280710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e26a00640 1 -- 172.21.15.28:0/4122105937 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041994496 0 0) 0x7f6e2815b650 con 0x7f6e281444e0 2024-04-23T18:27:46.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2d000640 1 -- 172.21.15.28:0/4122105937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e280c91e0 msgr2=0x7f6e280710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2d000640 1 --2- 172.21.15.28:0/4122105937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e280c91e0 0x7f6e280710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2d000640 1 -- 172.21.15.28:0/4122105937 >> v1:172.21.15.137:6789/0 conn(0x7f6e281444e0 legacy=0x7f6e28072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.565+0000 7f6e2d000640 1 -- 172.21.15.28:0/4122105937 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2815bef0 con 0x7f6e2806c3f0 2024-04-23T18:27:46.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e2d000640 1 --2- 172.21.15.28:0/4122105937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e2806c3f0 0x7f6e2815ca50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009e50 tx=0x7f6e2001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbf7bba8bae08cd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e26a00640 1 -- 172.21.15.28:0/4122105937 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e200b4070 con 0x7f6e2806c3f0 2024-04-23T18:27:46.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e26a00640 1 -- 172.21.15.28:0/4122105937 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e200af400 con 0x7f6e2806c3f0 2024-04-23T18:27:46.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e26a00640 1 -- 172.21.15.28:0/4122105937 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e200af7d0 con 0x7f6e2806c3f0 2024-04-23T18:27:46.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e2f000640 1 -- 172.21.15.28:0/4122105937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e2806c3f0 msgr2=0x7f6e2815ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e2f000640 1 --2- 172.21.15.28:0/4122105937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e2806c3f0 0x7f6e2815ca50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009e50 tx=0x7f6e2001f210 comp rx=0 tx=0).stop 2024-04-23T18:27:46.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e2f000640 1 -- 172.21.15.28:0/4122105937 shutdown_connections 2024-04-23T18:27:46.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e2f000640 1 --2- 172.21.15.28:0/4122105937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e2806c3f0 0x7f6e2815ca50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e2f000640 1 --2- 172.21.15.28:0/4122105937 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e280c91e0 0x7f6e280710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e2f000640 1 -- 172.21.15.28:0/4122105937 >> 172.21.15.28:0/4122105937 conn(0x7f6e280676e0 msgr2=0x7f6e28067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:46.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e2f000640 1 -- 172.21.15.28:0/4122105937 shutdown_connections 2024-04-23T18:27:46.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.569+0000 7f6e2f000640 1 -- 172.21.15.28:0/4122105937 wait complete. 2024-04-23T18:27:46.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e2f000640 1 Processor -- start 2024-04-23T18:27:46.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e2f000640 1 -- start start 2024-04-23T18:27:46.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e2f000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e2806c3f0 0x7f6e2815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e2f000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e280c91e0 0x7f6e2815a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e2f000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e281444e0 0x7f6e28156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e2f000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281448c0 con 0x7f6e280c91e0 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e2f000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2815b300 con 0x7f6e2806c3f0 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e2f000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6e28144a40 con 0x7f6e281444e0 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e27400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e280c91e0 0x7f6e2815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e27400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e280c91e0 0x7f6e2815a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49954/0 (socket says 172.21.15.28:49954) 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e27400640 1 -- 172.21.15.28:0/3976099187 learned_addr learned my addr 172.21.15.28:0/3976099187 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e2d000640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e281444e0 0x7f6e28156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e27e00640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e2806c3f0 0x7f6e2815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e27400640 1 -- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e281444e0 msgr2=0x7f6e28156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e27400640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e281444e0 0x7f6e28156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e27400640 1 -- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e2806c3f0 msgr2=0x7f6e2815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e27400640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e2806c3f0 0x7f6e2815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e27400640 1 -- 172.21.15.28:0/3976099187 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e281f1460 con 0x7f6e280c91e0 2024-04-23T18:27:46.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e27400640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e280c91e0 0x7f6e2815a960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e930 tx=0x7f6e1400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e1fe00640 1 -- 172.21.15.28:0/3976099187 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e14017070 con 0x7f6e280c91e0 2024-04-23T18:27:46.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e1fe00640 1 -- 172.21.15.28:0/3976099187 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1400c9a0 con 0x7f6e280c91e0 2024-04-23T18:27:46.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e1fe00640 1 -- 172.21.15.28:0/3976099187 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400cd70 con 0x7f6e280c91e0 2024-04-23T18:27:46.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e2f000640 1 -- 172.21.15.28:0/3976099187 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e281f1740 con 0x7f6e280c91e0 2024-04-23T18:27:46.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.573+0000 7f6e2f000640 1 -- 172.21.15.28:0/3976099187 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e281561a0 con 0x7f6e280c91e0 2024-04-23T18:27:46.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.577+0000 7f6e2f000640 1 -- 172.21.15.28:0/3976099187 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e28068cd0 con 0x7f6e280c91e0 2024-04-23T18:27:46.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.577+0000 7f6e1fe00640 1 -- 172.21.15.28:0/3976099187 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6e1401a070 con 0x7f6e280c91e0 2024-04-23T18:27:46.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.577+0000 7f6e1fe00640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e08068380 0x7f6e0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.577+0000 7f6e1fe00640 1 -- 172.21.15.28:0/3976099187 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6e14087060 con 0x7f6e280c91e0 2024-04-23T18:27:46.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.577+0000 7f6e27e00640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e08068380 0x7f6e0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.581+0000 7f6e27e00640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e08068380 0x7f6e0806a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e18007fd0 tx=0x7f6e18009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.581+0000 7f6e1fe00640 1 -- 172.21.15.28:0/3976099187 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6e14056c80 con 0x7f6e280c91e0 2024-04-23T18:27:46.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.761+0000 7f6e2f000640 1 -- 172.21.15.28:0/3976099187 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e28070720 con 0x7f6e280c91e0 2024-04-23T18:27:46.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.761+0000 7f6e1fe00640 1 -- 172.21.15.28:0/3976099187 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18891 (secure 0 0 0) 0x7f6e1405af80 con 0x7f6e280c91e0 2024-04-23T18:27:46.757 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:27:46.757 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:23:14.705611+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:27:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 -- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e08068380 msgr2=0x7f6e0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e08068380 0x7f6e0806a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e18007fd0 tx=0x7f6e18009040 comp rx=0 tx=0).stop 2024-04-23T18:27:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 -- 172.21.15.28:0/3976099187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e280c91e0 msgr2=0x7f6e2815a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e280c91e0 0x7f6e2815a960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e930 tx=0x7f6e1400edf0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 -- 172.21.15.28:0/3976099187 shutdown_connections 2024-04-23T18:27:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6e08068380 0x7f6e0806a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6e281444e0 0x7f6e28156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e280c91e0 0x7f6e2815a960 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 --2- 172.21.15.28:0/3976099187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e2806c3f0 0x7f6e2815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 -- 172.21.15.28:0/3976099187 >> 172.21.15.28:0/3976099187 conn(0x7f6e280676e0 msgr2=0x7f6e28072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:46.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 -- 172.21.15.28:0/3976099187 shutdown_connections 2024-04-23T18:27:46.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.765+0000 7f6e2f000640 1 -- 172.21.15.28:0/3976099187 wait complete. 2024-04-23T18:27:46.778 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T18:22:19.363864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T18:22:31.040656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T18:22:31.703845+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T18:22:35.387908+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T18:27:46.779 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T18:27:46.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe11e00640 1 Processor -- start 2024-04-23T18:27:46.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe11e00640 1 -- start start 2024-04-23T18:27:46.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe11e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe0c1446e0 0x7efe0c15b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe11e00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe0c15e970 con 0x7efe0c0c91e0 2024-04-23T18:27:46.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe11e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe0c15ec50 con 0x7efe0c144300 2024-04-23T18:27:46.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe11e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efe0c0c9f00 con 0x7efe0c1446e0 2024-04-23T18:27:46.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0b400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efe0c0c91e0 0x7efe0c06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49900/0 (socket says 172.21.15.28:49900) 2024-04-23T18:27:46.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0b400640 1 -- 172.21.15.28:0/2771466894 learned_addr learned my addr 172.21.15.28:0/2771466894 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:46.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe03e00640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe0c1446e0 0x7efe0c15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704088673 0 0) 0x7efe0c15e970 con 0x7efe0c0c91e0 2024-04-23T18:27:46.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf0003530 con 0x7efe0c0c91e0 2024-04-23T18:27:46.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 511865150 0 0) 0x7efe0c15ec50 con 0x7efe0c144300 2024-04-23T18:27:46.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe0c15e970 con 0x7efe0c144300 2024-04-23T18:27:46.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2831567069 0 0) 0x7efdf0003530 con 0x7efe0c0c91e0 2024-04-23T18:27:46.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe0c1446e0 msgr2=0x7efe0c15b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe0c1446e0 0x7efe0c15b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 >> v1:172.21.15.137:6789/0 conn(0x7efe0c144300 legacy=0x7efe0c0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0c15ef30 con 0x7efe0c0c91e0 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7efe04001a00 con 0x7efe0c0c91e0 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 >> v1:172.21.15.28:6789/0 conn(0x7efe0c0c91e0 legacy=0x7efe0c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdf0003b80 0x7efdf0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe0c1446e0 0x7efdf0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdf0004d50 0x7efdf00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7efdf000ba80 con 0x7efdf0004d50 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efdf000bc00 con 0x7efdf0003b80 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efdf000bdb0 con 0x7efe0c1446e0 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0b400640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdf0004d50 0x7efdf00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0aa00640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdf0003b80 0x7efdf0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe03e00640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe0c1446e0 0x7efdf0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0b400640 1 -- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe0c1446e0 msgr2=0x7efdf0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0b400640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe0c1446e0 0x7efdf0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0b400640 1 -- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdf0003b80 msgr2=0x7efdf0003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:46.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0b400640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdf0003b80 0x7efdf0003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe0b400640 1 -- 172.21.15.28:0/2771466894 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf0003530 con 0x7efdf0004d50 2024-04-23T18:27:46.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.933+0000 7efe03e00640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe0c1446e0 0x7efdf0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:46.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.937+0000 7efe0b400640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdf0004d50 0x7efdf00051d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efe0400a7f0 tx=0x7efe0401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91405b49eb53a1ed server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.937+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0400a410 con 0x7efdf0004d50 2024-04-23T18:27:46.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.937+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe040ad630 con 0x7efdf0004d50 2024-04-23T18:27:46.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.937+0000 7efe0a000640 1 -- 172.21.15.28:0/2771466894 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040ada20 con 0x7efdf0004d50 2024-04-23T18:27:46.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.937+0000 7efe11e00640 1 -- 172.21.15.28:0/2771466894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdf0004d50 msgr2=0x7efdf00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.937+0000 7efe11e00640 1 --2- 172.21.15.28:0/2771466894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efdf0004d50 0x7efdf00051d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efe0400a7f0 tx=0x7efe0401d300 comp rx=0 tx=0).stop 2024-04-23T18:27:46.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.937+0000 7efe0b400640 1 -- 172.21.15.28:0/2771466894 reap_dead start 2024-04-23T18:27:46.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.937+0000 7efe11e00640 1 -- 172.21.15.28:0/2771466894 shutdown_connections 2024-04-23T18:27:46.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.937+0000 7efe11e00640 1 -- 172.21.15.28:0/2771466894 >> 172.21.15.28:0/2771466894 conn(0x7efe0c0ce7e0 msgr2=0x7efe0c0cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:46.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.937+0000 7efe11e00640 1 -- 172.21.15.28:0/2771466894 shutdown_connections 2024-04-23T18:27:46.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.937+0000 7efe11e00640 1 -- 172.21.15.28:0/2771466894 wait complete. 2024-04-23T18:27:46.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe11e00640 1 Processor -- start 2024-04-23T18:27:46.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe11e00640 1 -- start start 2024-04-23T18:27:46.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe11e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efdf0004d50 0x7efe0c15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe11e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe0c1564a0 0x7efe0c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe11e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe0c1f12e0 0x7efe0c1f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe11e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c15f4f0 con 0x7efe0c1f12e0 2024-04-23T18:27:46.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe11e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c15e720 con 0x7efe0c1564a0 2024-04-23T18:27:46.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe11e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7efe0c0caaa0 con 0x7efdf0004d50 2024-04-23T18:27:46.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe0b400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe0c1f12e0 0x7efe0c1f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe0b400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe0c1f12e0 0x7efe0c1f1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49962/0 (socket says 172.21.15.28:49962) 2024-04-23T18:27:46.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe0b400640 1 -- 172.21.15.28:0/2420046642 learned_addr learned my addr 172.21.15.28:0/2420046642 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe0aa00640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efdf0004d50 0x7efe0c15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe03e00640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe0c1564a0 0x7efe0c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe0b400640 1 -- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efdf0004d50 msgr2=0x7efe0c15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe0b400640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efdf0004d50 0x7efe0c15d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe0b400640 1 -- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe0c1564a0 msgr2=0x7efe0c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe0b400640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe0c1564a0 0x7efe0c0cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe0b400640 1 -- 172.21.15.28:0/2420046642 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0c1f1ca0 con 0x7efe0c1f12e0 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe0aa00640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efdf0004d50 0x7efe0c15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe0b400640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe0c1f12e0 0x7efe0c1f1760 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efe04098d20 tx=0x7efdf0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe03400640 1 -- 172.21.15.28:0/2420046642 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0400a410 con 0x7efe0c1f12e0 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe03400640 1 -- 172.21.15.28:0/2420046642 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe040ad430 con 0x7efe0c1f12e0 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe11e00640 1 -- 172.21.15.28:0/2420046642 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe0c1f4510 con 0x7efe0c1f12e0 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe03400640 1 -- 172.21.15.28:0/2420046642 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04001f90 con 0x7efe0c1f12e0 2024-04-23T18:27:46.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.941+0000 7efe11e00640 1 -- 172.21.15.28:0/2420046642 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe0c1f4ab0 con 0x7efe0c1f12e0 2024-04-23T18:27:46.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.945+0000 7efe11e00640 1 -- 172.21.15.28:0/2420046642 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe0c068db0 con 0x7efe0c1f12e0 2024-04-23T18:27:46.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.945+0000 7efe03400640 1 -- 172.21.15.28:0/2420046642 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe040b5070 con 0x7efe0c1f12e0 2024-04-23T18:27:46.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.945+0000 7efe03400640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efde80683b0 0x7efde806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:46.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.945+0000 7efe03400640 1 -- 172.21.15.28:0/2420046642 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7efe04120bf0 con 0x7efe0c1f12e0 2024-04-23T18:27:46.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.945+0000 7efe0aa00640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efde80683b0 0x7efde806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:46.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.945+0000 7efe0aa00640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efde80683b0 0x7efde806a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efdfc007fd0 tx=0x7efdfc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:46.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:46.949+0000 7efe03400640 1 -- 172.21.15.28:0/2420046642 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe040bd060 con 0x7efe0c1f12e0 2024-04-23T18:27:47.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.181+0000 7efe11e00640 1 -- 172.21.15.28:0/2420046642 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efe0c073d80 con 0x7efe0c1f12e0 2024-04-23T18:27:47.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.181+0000 7efe03400640 1 -- 172.21.15.28:0/2420046642 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7efe0c1f1ca0 con 0x7efe0c1f12e0 2024-04-23T18:27:47.176 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-04-23T18:27:47.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 -- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efde80683b0 msgr2=0x7efde806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efde80683b0 0x7efde806a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efdfc007fd0 tx=0x7efdfc009040 comp rx=0 tx=0).stop 2024-04-23T18:27:47.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 -- 172.21.15.28:0/2420046642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe0c1f12e0 msgr2=0x7efe0c1f1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe0c1f12e0 0x7efe0c1f1760 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efe04098d20 tx=0x7efdf0005840 comp rx=0 tx=0).stop 2024-04-23T18:27:47.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 -- 172.21.15.28:0/2420046642 shutdown_connections 2024-04-23T18:27:47.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7efde80683b0 0x7efde806a870 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efdfc007fd0 tx=0x7efdfc009040 comp rx=0 tx=0).stop 2024-04-23T18:27:47.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efe0c1f12e0 0x7efe0c1f1760 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe0c1564a0 0x7efe0c0cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 --2- 172.21.15.28:0/2420046642 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efdf0004d50 0x7efe0c15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 -- 172.21.15.28:0/2420046642 >> 172.21.15.28:0/2420046642 conn(0x7efe0c0ce7e0 msgr2=0x7efe0c15a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:47.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 -- 172.21.15.28:0/2420046642 shutdown_connections 2024-04-23T18:27:47.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.185+0000 7efe11e00640 1 -- 172.21.15.28:0/2420046642 wait complete. 2024-04-23T18:27:47.215 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T18:27:47.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.425+0000 7fbb3de00640 1 Processor -- start 2024-04-23T18:27:47.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.425+0000 7fbb3de00640 1 -- start start 2024-04-23T18:27:47.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3de00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbb38154ee0 0x7fbb380713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb38070ec0 0x7fbb3806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3de00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb3815b320 con 0x7fbb3806bf20 2024-04-23T18:27:47.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3de00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fbb3815b600 con 0x7fbb38154ee0 2024-04-23T18:27:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3815b8e0 con 0x7fbb38070ec0 2024-04-23T18:27:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3ca00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbb38154ee0 0x7fbb380713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3ca00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbb38154ee0 0x7fbb380713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49974/0 (socket says 172.21.15.28:49974) 2024-04-23T18:27:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3ca00640 1 -- 172.21.15.28:0/1129569578 learned_addr learned my addr 172.21.15.28:0/1129569578 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb37e00640 1 --2- 172.21.15.28:0/1129569578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb38070ec0 0x7fbb3806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3ca00640 1 -- 172.21.15.28:0/1129569578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb38070ec0 msgr2=0x7fbb3806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3ca00640 1 --2- 172.21.15.28:0/1129569578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb38070ec0 0x7fbb3806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3ca00640 1 -- 172.21.15.28:0/1129569578 >> v1:172.21.15.137:6789/0 conn(0x7fbb3806bf20 legacy=0x7fbb380ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.429+0000 7fbb3ca00640 1 -- 172.21.15.28:0/1129569578 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3815bbc0 con 0x7fbb38154ee0 2024-04-23T18:27:47.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb3ca00640 1 --2- 172.21.15.28:0/1129569578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb38154ee0 0x7fbb380713f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009870 tx=0x7fbb2c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8750eb958624a95 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb37400640 1 -- 172.21.15.28:0/1129569578 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0b5070 con 0x7fbb38154ee0 2024-04-23T18:27:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb37400640 1 -- 172.21.15.28:0/1129569578 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2c0a8a50 con 0x7fbb38154ee0 2024-04-23T18:27:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb37400640 1 -- 172.21.15.28:0/1129569578 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0a8e20 con 0x7fbb38154ee0 2024-04-23T18:27:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb3de00640 1 -- 172.21.15.28:0/1129569578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb38154ee0 msgr2=0x7fbb380713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb3de00640 1 --2- 172.21.15.28:0/1129569578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb38154ee0 0x7fbb380713f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009870 tx=0x7fbb2c01ed50 comp rx=0 tx=0).stop 2024-04-23T18:27:47.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb3de00640 1 -- 172.21.15.28:0/1129569578 shutdown_connections 2024-04-23T18:27:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb3de00640 1 --2- 172.21.15.28:0/1129569578 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb38070ec0 0x7fbb3806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb3de00640 1 --2- 172.21.15.28:0/1129569578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb38154ee0 0x7fbb380713f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb3de00640 1 -- 172.21.15.28:0/1129569578 >> 172.21.15.28:0/1129569578 conn(0x7fbb380ce5e0 msgr2=0x7fbb380ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb3de00640 1 -- 172.21.15.28:0/1129569578 shutdown_connections 2024-04-23T18:27:47.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb3de00640 1 -- 172.21.15.28:0/1129569578 wait complete. 2024-04-23T18:27:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb3de00640 1 Processor -- start 2024-04-23T18:27:47.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.433+0000 7fbb3de00640 1 -- start start 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3de00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb3806bf20 0x7fbb38158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb38070ec0 0x7fbb38156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb38154ee0 0x7fbb38148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3de00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbb38155440 con 0x7fbb3806bf20 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381552c0 con 0x7fbb38154ee0 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3815af00 con 0x7fbb38070ec0 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3ca00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb3806bf20 0x7fbb38158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3ca00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb3806bf20 0x7fbb38158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49984/0 (socket says 172.21.15.28:49984) 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3ca00640 1 -- 172.21.15.28:0/3039091110 learned_addr learned my addr 172.21.15.28:0/3039091110 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb37e00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb38070ec0 0x7fbb38156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3d400640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb38154ee0 0x7fbb38148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3ca00640 1 -- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb38070ec0 msgr2=0x7fbb38156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3ca00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb38070ec0 0x7fbb38156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3ca00640 1 -- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb38154ee0 msgr2=0x7fbb38148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3ca00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb38154ee0 0x7fbb38148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3ca00640 1 -- 172.21.15.28:0/3039091110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb381501e0 con 0x7fbb3806bf20 2024-04-23T18:27:47.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3d400640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb38154ee0 0x7fbb38148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:47.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3ca00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb3806bf20 0x7fbb38158270 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0b3040 tx=0x7fbb2c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb34c00640 1 -- 172.21.15.28:0/3039091110 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0b5070 con 0x7fbb3806bf20 2024-04-23T18:27:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb34c00640 1 -- 172.21.15.28:0/3039091110 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2c0b0de0 con 0x7fbb3806bf20 2024-04-23T18:27:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3de00640 1 -- 172.21.15.28:0/3039091110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb381504a0 con 0x7fbb3806bf20 2024-04-23T18:27:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb34c00640 1 -- 172.21.15.28:0/3039091110 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0bb670 con 0x7fbb3806bf20 2024-04-23T18:27:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3de00640 1 -- 172.21.15.28:0/3039091110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb38150f60 con 0x7fbb3806bf20 2024-04-23T18:27:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb3de00640 1 -- 172.21.15.28:0/3039091110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb381509c0 con 0x7fbb3806bf20 2024-04-23T18:27:47.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.437+0000 7fbb34c00640 1 -- 172.21.15.28:0/3039091110 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb2c0c2060 con 0x7fbb3806bf20 2024-04-23T18:27:47.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.441+0000 7fbb34c00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb180683b0 0x7fbb1806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.441+0000 7fbb34c00640 1 -- 172.21.15.28:0/3039091110 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fbb2c124170 con 0x7fbb3806bf20 2024-04-23T18:27:47.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.441+0000 7fbb37e00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb180683b0 0x7fbb1806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.441+0000 7fbb37e00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb180683b0 0x7fbb1806a870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbb380c8be0 tx=0x7fbb24009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:47.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.445+0000 7fbb34c00640 1 -- 172.21.15.28:0/3039091110 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb2c0188b0 con 0x7fbb3806bf20 2024-04-23T18:27:47.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.625+0000 7fbb3de00640 1 -- 172.21.15.28:0/3039091110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbb38068cd0 con 0x7fbb3806bf20 2024-04-23T18:27:47.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.625+0000 7fbb34c00640 1 -- 172.21.15.28:0/3039091110 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fbb2c0f4320 con 0x7fbb3806bf20 2024-04-23T18:27:47.622 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:27:47.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 -- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb180683b0 msgr2=0x7fbb1806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb180683b0 0x7fbb1806a870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbb380c8be0 tx=0x7fbb24009190 comp rx=0 tx=0).stop 2024-04-23T18:27:47.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 -- 172.21.15.28:0/3039091110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb3806bf20 msgr2=0x7fbb38158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb3806bf20 0x7fbb38158270 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0b3040 tx=0x7fbb2c01baf0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 -- 172.21.15.28:0/3039091110 shutdown_connections 2024-04-23T18:27:47.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbb180683b0 0x7fbb1806a870 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbb380c8be0 tx=0x7fbb24009190 comp rx=0 tx=0).stop 2024-04-23T18:27:47.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb38070ec0 0x7fbb38156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb38154ee0 0x7fbb38148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 --2- 172.21.15.28:0/3039091110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb3806bf20 0x7fbb38158270 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 -- 172.21.15.28:0/3039091110 >> 172.21.15.28:0/3039091110 conn(0x7fbb380ce5e0 msgr2=0x7fbb3814b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:47.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 -- 172.21.15.28:0/3039091110 shutdown_connections 2024-04-23T18:27:47.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.629+0000 7fbb3de00640 1 -- 172.21.15.28:0/3039091110 wait complete. 2024-04-23T18:27:47.651 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T18:27:47.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5eaf800640 1 Processor -- start 2024-04-23T18:27:47.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5eaf800640 1 -- start start 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5eaf800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ea80c9e50 0x7f5ea815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5eaf800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5ea80c8d50 0x7f5ea806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5eaf800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea815b520 con 0x7f5ea8152100 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5eaf800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea8071d40 con 0x7f5ea80c8d50 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5eaf800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea8072020 con 0x7f5ea80c9e50 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5eace00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5ea8152100 0x7f5ea8072300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49910/0 (socket says 172.21.15.28:49910) 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5eace00640 1 -- 172.21.15.28:0/3203790110 learned_addr learned my addr 172.21.15.28:0/3203790110 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5ead800640 1 --2- 172.21.15.28:0/3203790110 >> v2:172.21.15.28:3300/0 conn(0x7f5ea80c8d50 0x7f5ea806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5e9fe00640 1 --2- 172.21.15.28:0/3203790110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ea80c9e50 0x7f5ea815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5ea7e00640 1 -- 172.21.15.28:0/3203790110 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2191669019 0 0) 0x7f5ea815b520 con 0x7f5ea8152100 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5ea7e00640 1 -- 172.21.15.28:0/3203790110 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e8c003530 con 0x7f5ea8152100 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5ead800640 1 -- 172.21.15.28:0/3203790110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ea80c9e50 msgr2=0x7f5ea815bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:47.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5ead800640 1 --2- 172.21.15.28:0/3203790110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ea80c9e50 0x7f5ea815bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5ead800640 1 -- 172.21.15.28:0/3203790110 >> v1:172.21.15.28:6789/0 conn(0x7f5ea8152100 legacy=0x7f5ea8072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.801+0000 7f5ead800640 1 -- 172.21.15.28:0/3203790110 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea815b7c0 con 0x7f5ea80c8d50 2024-04-23T18:27:47.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5ead800640 1 --2- 172.21.15.28:0/3203790110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ea80c8d50 0x7f5ea806ca30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009d90 tx=0x7f5ea001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae991ca8d1f83c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5ea7e00640 1 -- 172.21.15.28:0/3203790110 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00b4070 con 0x7f5ea80c8d50 2024-04-23T18:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5ea7e00640 1 -- 172.21.15.28:0/3203790110 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea00af600 con 0x7f5ea80c8d50 2024-04-23T18:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5ea7e00640 1 -- 172.21.15.28:0/3203790110 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00af9d0 con 0x7f5ea80c8d50 2024-04-23T18:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5eaf800640 1 -- 172.21.15.28:0/3203790110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ea80c8d50 msgr2=0x7f5ea806ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5eaf800640 1 --2- 172.21.15.28:0/3203790110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ea80c8d50 0x7f5ea806ca30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009d90 tx=0x7f5ea001f150 comp rx=0 tx=0).stop 2024-04-23T18:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5eaf800640 1 -- 172.21.15.28:0/3203790110 shutdown_connections 2024-04-23T18:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5eaf800640 1 --2- 172.21.15.28:0/3203790110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ea80c8d50 0x7f5ea806ca30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5eaf800640 1 --2- 172.21.15.28:0/3203790110 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ea80c9e50 0x7f5ea815bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5eaf800640 1 -- 172.21.15.28:0/3203790110 >> 172.21.15.28:0/3203790110 conn(0x7f5ea80c9330 msgr2=0x7f5ea80c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5eaf800640 1 -- 172.21.15.28:0/3203790110 shutdown_connections 2024-04-23T18:27:47.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.805+0000 7f5eaf800640 1 -- 172.21.15.28:0/3203790110 wait complete. 2024-04-23T18:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eaf800640 1 Processor -- start 2024-04-23T18:27:47.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eaf800640 1 -- start start 2024-04-23T18:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eaf800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ea80c8d50 0x7f5ea815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eaf800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ea80c9e50 0x7f5ea8152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eaf800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea8152100 0x7f5ea8158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eaf800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea8070fc0 con 0x7f5ea80c8d50 2024-04-23T18:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eaf800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea8070e40 con 0x7f5ea8152100 2024-04-23T18:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eaf800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea8071140 con 0x7f5ea80c9e50 2024-04-23T18:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eace00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ea80c8d50 0x7f5ea815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eace00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ea80c8d50 0x7f5ea815a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50002/0 (socket says 172.21.15.28:50002) 2024-04-23T18:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eace00640 1 -- 172.21.15.28:0/3818610356 learned_addr learned my addr 172.21.15.28:0/3818610356 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:47.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5e9fe00640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ea80c9e50 0x7f5ea8152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5ead800640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea8152100 0x7f5ea8158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eace00640 1 -- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ea80c9e50 msgr2=0x7f5ea8152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eace00640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ea80c9e50 0x7f5ea8152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eace00640 1 -- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea8152100 msgr2=0x7f5ea8158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eace00640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea8152100 0x7f5ea8158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eace00640 1 -- 172.21.15.28:0/3818610356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea80731d0 con 0x7f5ea80c8d50 2024-04-23T18:27:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5e9fe00640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ea80c9e50 0x7f5ea8152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5ead800640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea8152100 0x7f5ea8158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:47.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eace00640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ea80c8d50 0x7f5ea815a510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c3f0 tx=0x7f5e9800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5ea5600640 1 -- 172.21.15.28:0/3818610356 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e98017070 con 0x7f5ea80c8d50 2024-04-23T18:27:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5ea5600640 1 -- 172.21.15.28:0/3818610356 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e98005cf0 con 0x7f5ea80c8d50 2024-04-23T18:27:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eaf800640 1 -- 172.21.15.28:0/3818610356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea8153d70 con 0x7f5ea80c8d50 2024-04-23T18:27:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5ea5600640 1 -- 172.21.15.28:0/3818610356 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e980072f0 con 0x7f5ea80c8d50 2024-04-23T18:27:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.809+0000 7f5eaf800640 1 -- 172.21.15.28:0/3818610356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea81542f0 con 0x7f5ea80c8d50 2024-04-23T18:27:47.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.813+0000 7f5eaf800640 1 -- 172.21.15.28:0/3818610356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea8068db0 con 0x7f5ea80c8d50 2024-04-23T18:27:47.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.813+0000 7f5ea5600640 1 -- 172.21.15.28:0/3818610356 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e9801a070 con 0x7f5ea80c8d50 2024-04-23T18:27:47.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.813+0000 7f5ea5600640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5e84068380 0x7f5e8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:47.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.813+0000 7f5ea5600640 1 -- 172.21.15.28:0/3818610356 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5e980862c0 con 0x7f5ea80c8d50 2024-04-23T18:27:47.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.813+0000 7f5e9fe00640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5e84068380 0x7f5e8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:47.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.817+0000 7f5e9fe00640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5e84068380 0x7f5e8406a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8074470 tx=0x7f5e90008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:47.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.817+0000 7f5ea5600640 1 -- 172.21.15.28:0/3818610356 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5e980563e0 con 0x7f5ea80c8d50 2024-04-23T18:27:47.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 -- 172.21.15.28:0/3818610356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5ea8071860 con 0x7f5ea80c8d50 2024-04-23T18:27:47.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5ea5600640 1 -- 172.21.15.28:0/3818610356 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f5e98055ce0 con 0x7f5ea80c8d50 2024-04-23T18:27:47.980 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2024-04-23T18:27:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 -- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5e84068380 msgr2=0x7f5e8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5e84068380 0x7f5e8406a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8074470 tx=0x7f5e90008040 comp rx=0 tx=0).stop 2024-04-23T18:27:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 -- 172.21.15.28:0/3818610356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ea80c8d50 msgr2=0x7f5ea815a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ea80c8d50 0x7f5ea815a510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c3f0 tx=0x7f5e9800c8b0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 -- 172.21.15.28:0/3818610356 shutdown_connections 2024-04-23T18:27:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5e84068380 0x7f5e8406a840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ea80c9e50 0x7f5ea8152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea8152100 0x7f5ea8158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 --2- 172.21.15.28:0/3818610356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ea80c8d50 0x7f5ea815a510 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 -- 172.21.15.28:0/3818610356 >> 172.21.15.28:0/3818610356 conn(0x7f5ea80c9330 msgr2=0x7f5ea80c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 -- 172.21.15.28:0/3818610356 shutdown_connections 2024-04-23T18:27:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:47.985+0000 7f5eaf800640 1 -- 172.21.15.28:0/3818610356 wait complete. 2024-04-23T18:27:48.002 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T18:27:48.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.161+0000 7f6dd8600640 1 Processor -- start 2024-04-23T18:27:48.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.161+0000 7f6dd8600640 1 -- start start 2024-04-23T18:27:48.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.161+0000 7f6dd8600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 0x7f6dd015bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:48.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.161+0000 7f6dd8600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6dd00c8d50 0x7f6dd006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:48.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd8600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dd015b520 con 0x7f6dd0152100 2024-04-23T18:27:48.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd8600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd0071d40 con 0x7f6dd00c8d50 2024-04-23T18:27:48.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd8600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd0072020 con 0x7f6dd00c9e50 2024-04-23T18:27:48.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd5c00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6dd0152100 0x7f6dd0072300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49912/0 (socket says 172.21.15.28:49912) 2024-04-23T18:27:48.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd5c00640 1 -- 172.21.15.28:0/3157739483 learned_addr learned my addr 172.21.15.28:0/3157739483 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:48.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd5200640 1 --2- 172.21.15.28:0/3157739483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 0x7f6dd015bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:48.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd6600640 1 --2- 172.21.15.28:0/3157739483 >> v2:172.21.15.137:3300/0 conn(0x7f6dd00c8d50 0x7f6dd006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:48.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dcfe00640 1 -- 172.21.15.28:0/3157739483 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069251978 0 0) 0x7f6dd015b520 con 0x7f6dd0152100 2024-04-23T18:27:48.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dcfe00640 1 -- 172.21.15.28:0/3157739483 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6db8003530 con 0x7f6dd0152100 2024-04-23T18:27:48.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd5200640 1 -- 172.21.15.28:0/3157739483 >> v2:172.21.15.137:3300/0 conn(0x7f6dd00c8d50 msgr2=0x7f6dd006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:48.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd5200640 1 --2- 172.21.15.28:0/3157739483 >> v2:172.21.15.137:3300/0 conn(0x7f6dd00c8d50 0x7f6dd006ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dcfe00640 1 -- 172.21.15.28:0/3157739483 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1313047030 0 0) 0x7f6db8003530 con 0x7f6dd0152100 2024-04-23T18:27:48.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd5200640 1 -- 172.21.15.28:0/3157739483 >> v1:172.21.15.28:6789/0 conn(0x7f6dd0152100 legacy=0x7f6dd0072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd5200640 1 -- 172.21.15.28:0/3157739483 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd015b7c0 con 0x7f6dd00c9e50 2024-04-23T18:27:48.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.165+0000 7f6dd5200640 1 --2- 172.21.15.28:0/3157739483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 0x7f6dd015bfc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0097c0 tx=0x7f6dbc01ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b838e0025b2600e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:48.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dcfe00640 1 -- 172.21.15.28:0/3157739483 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0b5070 con 0x7f6dd00c9e50 2024-04-23T18:27:48.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dcfe00640 1 -- 172.21.15.28:0/3157739483 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc0a85f0 con 0x7f6dd00c9e50 2024-04-23T18:27:48.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dcfe00640 1 -- 172.21.15.28:0/3157739483 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4001680 con 0x7f6dd00c9e50 2024-04-23T18:27:48.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 -- 172.21.15.28:0/3157739483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 msgr2=0x7f6dd015bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 --2- 172.21.15.28:0/3157739483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 0x7f6dd015bfc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0097c0 tx=0x7f6dbc01ebb0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 -- 172.21.15.28:0/3157739483 shutdown_connections 2024-04-23T18:27:48.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 --2- 172.21.15.28:0/3157739483 >> v2:172.21.15.137:3300/0 conn(0x7f6dd00c8d50 0x7f6dd006ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 --2- 172.21.15.28:0/3157739483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 0x7f6dd015bfc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 -- 172.21.15.28:0/3157739483 >> 172.21.15.28:0/3157739483 conn(0x7f6dd00c9330 msgr2=0x7f6dd00c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:48.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 -- 172.21.15.28:0/3157739483 shutdown_connections 2024-04-23T18:27:48.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 -- 172.21.15.28:0/3157739483 wait complete. 2024-04-23T18:27:48.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 Processor -- start 2024-04-23T18:27:48.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 -- start start 2024-04-23T18:27:48.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd00c8d50 0x7f6dd014dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:48.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 0x7f6dd00c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:48.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dd0152100 0x7f6dd015a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:48.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0070fc0 con 0x7f6dd0152100 2024-04-23T18:27:48.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0070e40 con 0x7f6dd00c8d50 2024-04-23T18:27:48.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd8600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd0071140 con 0x7f6dd00c9e50 2024-04-23T18:27:48.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd6600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dd0152100 0x7f6dd015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:48.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd6600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dd0152100 0x7f6dd015a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50012/0 (socket says 172.21.15.28:50012) 2024-04-23T18:27:48.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd6600640 1 -- 172.21.15.28:0/367123916 learned_addr learned my addr 172.21.15.28:0/367123916 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:48.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.169+0000 7f6dd5c00640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd00c8d50 0x7f6dd014dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:48.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd5200640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 0x7f6dd00c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:48.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd6600640 1 -- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 msgr2=0x7f6dd00c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd6600640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 0x7f6dd00c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd6600640 1 -- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd00c8d50 msgr2=0x7f6dd014dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd6600640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd00c8d50 0x7f6dd014dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd6600640 1 -- 172.21.15.28:0/367123916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd01478d0 con 0x7f6dd0152100 2024-04-23T18:27:48.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd5c00640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd00c8d50 0x7f6dd014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:48.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd5200640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 0x7f6dd00c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:48.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd6600640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dd0152100 0x7f6dd015a920 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800efc0 tx=0x7f6dc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:48.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dcd600640 1 -- 172.21.15.28:0/367123916 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8018020 con 0x7f6dd0152100 2024-04-23T18:27:48.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dcd600640 1 -- 172.21.15.28:0/367123916 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8009b10 con 0x7f6dd0152100 2024-04-23T18:27:48.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dcd600640 1 -- 172.21.15.28:0/367123916 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80146c0 con 0x7f6dd0152100 2024-04-23T18:27:48.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd8600640 1 -- 172.21.15.28:0/367123916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd0146c30 con 0x7f6dd0152100 2024-04-23T18:27:48.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd8600640 1 -- 172.21.15.28:0/367123916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd01471d0 con 0x7f6dd0152100 2024-04-23T18:27:48.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dd8600640 1 -- 172.21.15.28:0/367123916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd0068db0 con 0x7f6dd0152100 2024-04-23T18:27:48.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dcd600640 1 -- 172.21.15.28:0/367123916 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6dc801b020 con 0x7f6dd0152100 2024-04-23T18:27:48.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dcd600640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6db00683b0 0x7f6db006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:48.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.173+0000 7f6dcd600640 1 -- 172.21.15.28:0/367123916 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6dc8087730 con 0x7f6dd0152100 2024-04-23T18:27:48.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.177+0000 7f6dd5c00640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6db00683b0 0x7f6db006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:48.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.177+0000 7f6dd5c00640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6db00683b0 0x7f6db006a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4007a10 tx=0x7f6dc4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:48.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.181+0000 7f6dcd600640 1 -- 172.21.15.28:0/367123916 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6dc8022070 con 0x7f6dd0152100 2024-04-23T18:27:48.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 -- 172.21.15.28:0/367123916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6dd0147410 con 0x7f6dd0152100 2024-04-23T18:27:48.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dcd600640 1 -- 172.21.15.28:0/367123916 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f6dc8010040 con 0x7f6dd0152100 2024-04-23T18:27:48.340 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2024-04-23T18:27:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 -- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6db00683b0 msgr2=0x7f6db006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6db00683b0 0x7f6db006a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4007a10 tx=0x7f6dc4009040 comp rx=0 tx=0).stop 2024-04-23T18:27:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 -- 172.21.15.28:0/367123916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dd0152100 msgr2=0x7f6dd015a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dd0152100 0x7f6dd015a920 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800efc0 tx=0x7f6dc800c490 comp rx=0 tx=0).stop 2024-04-23T18:27:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 -- 172.21.15.28:0/367123916 shutdown_connections 2024-04-23T18:27:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6db00683b0 0x7f6db006a870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6dd00c9e50 0x7f6dd00c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dd0152100 0x7f6dd015a920 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 --2- 172.21.15.28:0/367123916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd00c8d50 0x7f6dd014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 -- 172.21.15.28:0/367123916 >> 172.21.15.28:0/367123916 conn(0x7f6dd00c9330 msgr2=0x7f6dd0072ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 -- 172.21.15.28:0/367123916 shutdown_connections 2024-04-23T18:27:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.345+0000 7f6dd8600640 1 -- 172.21.15.28:0/367123916 wait complete. 2024-04-23T18:27:48.360 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T18:27:48.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f424fe00640 1 Processor -- start 2024-04-23T18:27:48.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f424fe00640 1 -- start start 2024-04-23T18:27:48.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f424fe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4250158d40 0x7f42500704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:48.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f424fe00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f425015cdc0 con 0x7f4250073a40 2024-04-23T18:27:48.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f424fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f425015d060 con 0x7f4250152ee0 2024-04-23T18:27:48.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f424fe00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f4250073ed0 con 0x7f4250158d40 2024-04-23T18:27:48.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f4247e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4250158d40 0x7f42500704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:48.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f424f400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4250073a40 0x7f425015c250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49928/0 (socket says 172.21.15.28:49928) 2024-04-23T18:27:48.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f424f400640 1 -- 172.21.15.28:0/810159691 learned_addr learned my addr 172.21.15.28:0/810159691 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:48.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f4247e00640 1 -- 172.21.15.28:0/810159691 >> v1:172.21.15.137:6789/0 conn(0x7f4250152ee0 legacy=0x7f42500c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f4247e00640 1 -- 172.21.15.28:0/810159691 >> v1:172.21.15.28:6789/0 conn(0x7f4250073a40 legacy=0x7f425015c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f4247e00640 1 -- 172.21.15.28:0/810159691 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4250072c80 con 0x7f4250158d40 2024-04-23T18:27:48.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.509+0000 7f424e000640 1 -- 172.21.15.28:0/810159691 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146463483 0 0) 0x7f425015cdc0 con 0x7f4250073a40 2024-04-23T18:27:48.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.513+0000 7f4247e00640 1 --2- 172.21.15.28:0/810159691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4250158d40 0x7f42500704b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f42380097c0 tx=0x7f423801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22eeab493aa4853b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:48.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.513+0000 7f424e000640 1 -- 172.21.15.28:0/810159691 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380b5070 con 0x7f4250158d40 2024-04-23T18:27:48.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.513+0000 7f424e000640 1 -- 172.21.15.28:0/810159691 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42380a8990 con 0x7f4250158d40 2024-04-23T18:27:48.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.513+0000 7f424e000640 1 -- 172.21.15.28:0/810159691 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380a8d60 con 0x7f4250158d40 2024-04-23T18:27:48.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.513+0000 7f424fe00640 1 -- 172.21.15.28:0/810159691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4250158d40 msgr2=0x7f42500704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.513+0000 7f424fe00640 1 --2- 172.21.15.28:0/810159691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4250158d40 0x7f42500704b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f42380097c0 tx=0x7f423801ec90 comp rx=0 tx=0).stop 2024-04-23T18:27:48.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.513+0000 7f424fe00640 1 -- 172.21.15.28:0/810159691 shutdown_connections 2024-04-23T18:27:48.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.513+0000 7f424fe00640 1 --2- 172.21.15.28:0/810159691 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4250158d40 0x7f42500704b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.513+0000 7f424fe00640 1 -- 172.21.15.28:0/810159691 >> 172.21.15.28:0/810159691 conn(0x7f42500ce5e0 msgr2=0x7f42500ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:48.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.513+0000 7f424fe00640 1 -- 172.21.15.28:0/810159691 shutdown_connections 2024-04-23T18:27:48.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.513+0000 7f424fe00640 1 -- 172.21.15.28:0/810159691 wait complete. 2024-04-23T18:27:48.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424fe00640 1 Processor -- start 2024-04-23T18:27:48.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424fe00640 1 -- start start 2024-04-23T18:27:48.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424fe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4250073a40 0x7f42501551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:48.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4250152ee0 0x7f42500cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:48.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4250158d40 0x7f42501f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:48.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424fe00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4250073520 con 0x7f4250073a40 2024-04-23T18:27:48.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4250073240 con 0x7f4250152ee0 2024-04-23T18:27:48.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f42501532c0 con 0x7f4250158d40 2024-04-23T18:27:48.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4250073a40 0x7f42501551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424ea00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4250073a40 0x7f42501551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50020/0 (socket says 172.21.15.28:50020) 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424ea00640 1 -- 172.21.15.28:0/3847067374 learned_addr learned my addr 172.21.15.28:0/3847067374 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424f400640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4250158d40 0x7f42501f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f4247e00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4250152ee0 0x7f42500cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424ea00640 1 -- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4250158d40 msgr2=0x7f42501f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424ea00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4250158d40 0x7f42501f4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424ea00640 1 -- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4250152ee0 msgr2=0x7f42500cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424ea00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4250152ee0 0x7f42500cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424ea00640 1 -- 172.21.15.28:0/3847067374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425006c070 con 0x7f4250073a40 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424f400640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4250158d40 0x7f42501f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f4247e00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4250152ee0 0x7f42500cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:27:48.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424ea00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4250073a40 0x7f42501551a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f424000c500 tx=0x7f424000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:48.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f4246a00640 1 -- 172.21.15.28:0/3847067374 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240016020 con 0x7f4250073a40 2024-04-23T18:27:48.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f4246a00640 1 -- 172.21.15.28:0/3847067374 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4240005220 con 0x7f4250073a40 2024-04-23T18:27:48.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f4246a00640 1 -- 172.21.15.28:0/3847067374 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240007030 con 0x7f4250073a40 2024-04-23T18:27:48.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424fe00640 1 -- 172.21.15.28:0/3847067374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4250155c90 con 0x7f4250073a40 2024-04-23T18:27:48.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424fe00640 1 -- 172.21.15.28:0/3847067374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4250156250 con 0x7f4250073a40 2024-04-23T18:27:48.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.517+0000 7f424fe00640 1 -- 172.21.15.28:0/3847067374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4250068cd0 con 0x7f4250073a40 2024-04-23T18:27:48.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.521+0000 7f4246a00640 1 -- 172.21.15.28:0/3847067374 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f42400071f0 con 0x7f4250073a40 2024-04-23T18:27:48.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.521+0000 7f4246a00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f422c0683b0 0x7f422c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:48.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.521+0000 7f4246a00640 1 -- 172.21.15.28:0/3847067374 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4240086740 con 0x7f4250073a40 2024-04-23T18:27:48.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.521+0000 7f4247e00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f422c0683b0 0x7f422c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:48.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.521+0000 7f4247e00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f422c0683b0 0x7f422c06a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f42380b2000 tx=0x7f42380aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:48.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.525+0000 7f4246a00640 1 -- 172.21.15.28:0/3847067374 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4240020020 con 0x7f4250073a40 2024-04-23T18:27:48.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.697+0000 7f424fe00640 1 -- 172.21.15.28:0/3847067374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f42500c68e0 con 0x7f4250073a40 2024-04-23T18:27:48.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f4246a00640 1 -- 172.21.15.28:0/3847067374 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f4240056910 con 0x7f4250073a40 2024-04-23T18:27:48.695 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2024-04-23T18:27:48.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 -- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f422c0683b0 msgr2=0x7f422c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f422c0683b0 0x7f422c06a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f42380b2000 tx=0x7f42380aa070 comp rx=0 tx=0).stop 2024-04-23T18:27:48.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 -- 172.21.15.28:0/3847067374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4250073a40 msgr2=0x7f42501551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:48.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4250073a40 0x7f42501551a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f424000c500 tx=0x7f424000c9c0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 -- 172.21.15.28:0/3847067374 shutdown_connections 2024-04-23T18:27:48.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f422c0683b0 0x7f422c06a870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4250158d40 0x7f42501f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4250152ee0 0x7f42500cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 --2- 172.21.15.28:0/3847067374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4250073a40 0x7f42501551a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 -- 172.21.15.28:0/3847067374 >> 172.21.15.28:0/3847067374 conn(0x7f42500ce5e0 msgr2=0x7f42500cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 -- 172.21.15.28:0/3847067374 shutdown_connections 2024-04-23T18:27:48.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:48.701+0000 7f424fe00640 1 -- 172.21.15.28:0/3847067374 wait complete. 2024-04-23T18:27:48.716 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-23T18:27:48.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:27:48.716 DEBUG:teuthology.orchestra.run.smithi028:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-23T18:27:48.846 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:27:48.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:27:48.846 DEBUG:teuthology.orchestra.run.smithi028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-23T18:27:48.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:27:48.856 DEBUG:teuthology.orchestra.run.smithi028:> ip netns list 2024-04-23T18:27:48.907 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-23T18:27:48.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:27:48.908 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T18:27:48.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T18:27:48.973 DEBUG:teuthology.orchestra.run.smithi028:> sudo ip link delete ceph-brx 2024-04-23T18:27:49.144 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-23T18:27:49.154 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T18:27:49.154 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:27:49.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00da800640 1 Processor -- start 2024-04-23T18:27:49.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00da800640 1 -- start start 2024-04-23T18:27:49.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00da800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f00d40c91e0 0x7f00d40710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00da800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00d406c3f0 0x7f00d415ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00da800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00d406c820 con 0x7f00d41444e0 2024-04-23T18:27:49.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00da800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f00d415b650 con 0x7f00d40c91e0 2024-04-23T18:27:49.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00da800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f00d415b930 con 0x7f00d406c3f0 2024-04-23T18:27:49.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00caa00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f00d40c91e0 0x7f00d40710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:49.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00caa00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f00d40c91e0 0x7f00d40710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33138/0 (socket says 172.21.15.28:33138) 2024-04-23T18:27:49.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00caa00640 1 -- 172.21.15.28:0/3408125201 learned_addr learned my addr 172.21.15.28:0/3408125201 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:49.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00d3e00640 1 --2- 172.21.15.28:0/3408125201 >> v2:172.21.15.137:3300/0 conn(0x7f00d406c3f0 0x7f00d415ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:49.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00caa00640 1 -- 172.21.15.28:0/3408125201 >> v2:172.21.15.137:3300/0 conn(0x7f00d406c3f0 msgr2=0x7f00d415ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:49.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00caa00640 1 --2- 172.21.15.28:0/3408125201 >> v2:172.21.15.137:3300/0 conn(0x7f00d406c3f0 0x7f00d415ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00caa00640 1 -- 172.21.15.28:0/3408125201 >> v1:172.21.15.137:6789/0 conn(0x7f00d41444e0 legacy=0x7f00d4072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00caa00640 1 -- 172.21.15.28:0/3408125201 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d415bc10 con 0x7f00d40c91e0 2024-04-23T18:27:49.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.301+0000 7f00d3e00640 1 --2- 172.21.15.28:0/3408125201 >> v2:172.21.15.137:3300/0 conn(0x7f00d406c3f0 0x7f00d415ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:49.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00caa00640 1 --2- 172.21.15.28:0/3408125201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d40c91e0 0x7f00d40710e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f00d406f9e0 tx=0x7f00bc01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af28fffb1cda306a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:49.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00d2a00640 1 -- 172.21.15.28:0/3408125201 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0b4070 con 0x7f00d40c91e0 2024-04-23T18:27:49.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00d2a00640 1 -- 172.21.15.28:0/3408125201 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00bc0af400 con 0x7f00d40c91e0 2024-04-23T18:27:49.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00d2a00640 1 -- 172.21.15.28:0/3408125201 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0af7d0 con 0x7f00d40c91e0 2024-04-23T18:27:49.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00da800640 1 -- 172.21.15.28:0/3408125201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d40c91e0 msgr2=0x7f00d40710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00da800640 1 --2- 172.21.15.28:0/3408125201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d40c91e0 0x7f00d40710e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f00d406f9e0 tx=0x7f00bc01f1e0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00da800640 1 -- 172.21.15.28:0/3408125201 shutdown_connections 2024-04-23T18:27:49.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00da800640 1 --2- 172.21.15.28:0/3408125201 >> v2:172.21.15.137:3300/0 conn(0x7f00d406c3f0 0x7f00d415ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00da800640 1 --2- 172.21.15.28:0/3408125201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d40c91e0 0x7f00d40710e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00da800640 1 -- 172.21.15.28:0/3408125201 >> 172.21.15.28:0/3408125201 conn(0x7f00d40676e0 msgr2=0x7f00d4067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:49.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00da800640 1 -- 172.21.15.28:0/3408125201 shutdown_connections 2024-04-23T18:27:49.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.305+0000 7f00da800640 1 -- 172.21.15.28:0/3408125201 wait complete. 2024-04-23T18:27:49.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00da800640 1 Processor -- start 2024-04-23T18:27:49.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00da800640 1 -- start start 2024-04-23T18:27:49.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00da800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d406c3f0 0x7f00d4141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00da800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00d40c91e0 0x7f00d41f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00da800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d41444e0 0x7f00d413ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00da800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f00d415b300 con 0x7f00d41444e0 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00da800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00d415c1d0 con 0x7f00d406c3f0 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00da800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f00d41448c0 con 0x7f00d40c91e0 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00d3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d41444e0 0x7f00d413ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00d3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d41444e0 0x7f00d413ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33144/0 (socket says 172.21.15.28:33144) 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00d3e00640 1 -- 172.21.15.28:0/678178377 learned_addr learned my addr 172.21.15.28:0/678178377 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00d3400640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d406c3f0 0x7f00d4141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00caa00640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00d40c91e0 0x7f00d41f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00d3e00640 1 -- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00d40c91e0 msgr2=0x7f00d41f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00d3e00640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00d40c91e0 0x7f00d41f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00d3e00640 1 -- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d406c3f0 msgr2=0x7f00d4141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00d3e00640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d406c3f0 0x7f00d4141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00d3e00640 1 -- 172.21.15.28:0/678178377 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d40cafe0 con 0x7f00d41444e0 2024-04-23T18:27:49.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00d3e00640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d41444e0 0x7f00d413ab00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e810 tx=0x7f00cc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:49.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00cbe00640 1 -- 172.21.15.28:0/678178377 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc017070 con 0x7f00d41444e0 2024-04-23T18:27:49.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00cbe00640 1 -- 172.21.15.28:0/678178377 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00cc00c6d0 con 0x7f00d41444e0 2024-04-23T18:27:49.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00cbe00640 1 -- 172.21.15.28:0/678178377 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00f040 con 0x7f00d41444e0 2024-04-23T18:27:49.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00da800640 1 -- 172.21.15.28:0/678178377 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d41f5250 con 0x7f00d41444e0 2024-04-23T18:27:49.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00da800640 1 -- 172.21.15.28:0/678178377 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d40cf4a0 con 0x7f00d41444e0 2024-04-23T18:27:49.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.309+0000 7f00da800640 1 -- 172.21.15.28:0/678178377 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d4068cd0 con 0x7f00d41444e0 2024-04-23T18:27:49.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.313+0000 7f00cbe00640 1 -- 172.21.15.28:0/678178377 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00cc01a070 con 0x7f00d41444e0 2024-04-23T18:27:49.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.313+0000 7f00cbe00640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f00b0068380 0x7f00b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.313+0000 7f00cbe00640 1 -- 172.21.15.28:0/678178377 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f00cc086aa0 con 0x7f00d41444e0 2024-04-23T18:27:49.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.313+0000 7f00d3400640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f00b0068380 0x7f00b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:49.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.313+0000 7f00d3400640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f00b0068380 0x7f00b006a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f00c40015b0 tx=0x7f00c4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:49.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.317+0000 7f00cbe00640 1 -- 172.21.15.28:0/678178377 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f00cc056b30 con 0x7f00d41444e0 2024-04-23T18:27:49.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.481+0000 7f00da800640 1 -- 172.21.15.28:0/678178377 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00d4070720 con 0x7f00b0068380 2024-04-23T18:27:49.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.505+0000 7f00cbe00640 1 -- 172.21.15.28:0/678178377 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334004 (secure 0 0 0) 0x7f00d4070720 con 0x7f00b0068380 2024-04-23T18:27:49.505 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:27:49.507 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:27:49.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 -- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f00b0068380 msgr2=0x7f00b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f00b0068380 0x7f00b006a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f00c40015b0 tx=0x7f00c4009040 comp rx=0 tx=0).stop 2024-04-23T18:27:49.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 -- 172.21.15.28:0/678178377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d41444e0 msgr2=0x7f00d413ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d41444e0 0x7f00d413ab00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e810 tx=0x7f00cc00ecd0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 -- 172.21.15.28:0/678178377 shutdown_connections 2024-04-23T18:27:49.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f00b0068380 0x7f00b006a840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00d40c91e0 0x7f00d41f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00d41444e0 0x7f00d413ab00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 --2- 172.21.15.28:0/678178377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00d406c3f0 0x7f00d4141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 -- 172.21.15.28:0/678178377 >> 172.21.15.28:0/678178377 conn(0x7f00d40676e0 msgr2=0x7f00d4159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:49.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 -- 172.21.15.28:0/678178377 shutdown_connections 2024-04-23T18:27:49.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.509+0000 7f00da800640 1 -- 172.21.15.28:0/678178377 wait complete. 2024-04-23T18:27:49.525 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-04-23T18:27:49.442543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4496657430,"num_objects":1134,"num_object_clones":0,"num_object_copies":4410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1134,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":10447,"num_write_kb":25172361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10892,"ondisk_log_size":10892,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":11744160,"kb_used_data":11236320,"kb_used_omap":12,"kb_used_meta":493427,"kb_avail":743230560,"statfs":{"total":773094113280,"available":761068093440,"internally_reserved":0,"allocated":11505991680,"data_stored":11504510802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":505269808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6245308358,"num_objects":-1489,"num_object_clones":0,"num_object_copies":-5956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1489,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1500,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003718"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405510+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:24:39.405510+0000","last_peered":"2024-04-23T18:24:39.405510+0000","last_clean":"2024-04-23T18:24:39.405510+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:24:39.405510+0000","last_undegraded":"2024-04-23T18:24:39.405510+0000","last_fullsized":"2024-04-23T18:24:39.405510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:14.421976+0000","last_change":"2024-04-23T18:23:14.723733+0000","last_active":"2024-04-23T18:25:14.421976+0000","last_peered":"2024-04-23T18:25:14.421976+0000","last_clean":"2024-04-23T18:25:14.421976+0000","last_became_active":"2024-04-23T18:23:14.723423+0000","last_became_peered":"2024-04-23T18:23:14.723423+0000","last_unstale":"2024-04-23T18:25:14.421976+0000","last_undegraded":"2024-04-23T18:25:14.421976+0000","last_fullsized":"2024-04-23T18:25:14.421976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:28:08.520812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"26'301","reported_seq":321,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.517469+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:27:44.517469+0000","last_peered":"2024-04-23T18:27:44.517469+0000","last_clean":"2024-04-23T18:27:44.517469+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:27:44.517469+0000","last_undegraded":"2024-04-23T18:27:44.517469+0000","last_fullsized":"2024-04-23T18:27:44.517469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.405371+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:24:34.405371+0000","last_peered":"2024-04-23T18:24:34.405371+0000","last_clean":"2024-04-23T18:24:34.405371+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:24:34.405371+0000","last_undegraded":"2024-04-23T18:24:34.405371+0000","last_fullsized":"2024-04-23T18:24:34.405371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405499+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:24:39.405499+0000","last_peered":"2024-04-23T18:24:39.405499+0000","last_clean":"2024-04-23T18:24:39.405499+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:24:39.405499+0000","last_undegraded":"2024-04-23T18:24:39.405499+0000","last_fullsized":"2024-04-23T18:24:39.405499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'313","reported_seq":333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.332874+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:27:44.332874+0000","last_peered":"2024-04-23T18:27:44.332874+0000","last_clean":"2024-04-23T18:27:44.332874+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:27:44.332874+0000","last_undegraded":"2024-04-23T18:27:44.332874+0000","last_fullsized":"2024-04-23T18:27:44.332874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430064+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:25:04.430064+0000","last_peered":"2024-04-23T18:25:04.430064+0000","last_clean":"2024-04-23T18:25:04.430064+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:25:04.430064+0000","last_undegraded":"2024-04-23T18:25:04.430064+0000","last_fullsized":"2024-04-23T18:25:04.430064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430562+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:25:04.430562+0000","last_peered":"2024-04-23T18:25:04.430562+0000","last_clean":"2024-04-23T18:25:04.430562+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:25:04.430562+0000","last_undegraded":"2024-04-23T18:25:04.430562+0000","last_fullsized":"2024-04-23T18:25:04.430562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'255","reported_seq":275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.364905+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:27:44.364905+0000","last_peered":"2024-04-23T18:27:44.364905+0000","last_clean":"2024-04-23T18:27:44.364905+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:27:44.364905+0000","last_undegraded":"2024-04-23T18:27:44.364905+0000","last_fullsized":"2024-04-23T18:27:44.364905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430032+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:25:04.430032+0000","last_peered":"2024-04-23T18:25:04.430032+0000","last_clean":"2024-04-23T18:25:04.430032+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:25:04.430032+0000","last_undegraded":"2024-04-23T18:25:04.430032+0000","last_fullsized":"2024-04-23T18:25:04.430032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430641+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:25:04.430641+0000","last_peered":"2024-04-23T18:25:04.430641+0000","last_clean":"2024-04-23T18:25:04.430641+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:25:04.430641+0000","last_undegraded":"2024-04-23T18:25:04.430641+0000","last_fullsized":"2024-04-23T18:25:04.430641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'241","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.277499+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:27:44.277499+0000","last_peered":"2024-04-23T18:27:44.277499+0000","last_clean":"2024-04-23T18:27:44.277499+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:27:44.277499+0000","last_undegraded":"2024-04-23T18:27:44.277499+0000","last_fullsized":"2024-04-23T18:27:44.277499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.444237+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:24:44.444237+0000","last_peered":"2024-04-23T18:24:44.444237+0000","last_clean":"2024-04-23T18:24:44.444237+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:24:44.444237+0000","last_undegraded":"2024-04-23T18:24:44.444237+0000","last_fullsized":"2024-04-23T18:24:44.444237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:51.515161+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:24:51.515161+0000","last_peered":"2024-04-23T18:24:51.515161+0000","last_clean":"2024-04-23T18:24:51.515161+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:24:51.515161+0000","last_undegraded":"2024-04-23T18:24:51.515161+0000","last_fullsized":"2024-04-23T18:24:51.515161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'299","reported_seq":319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.413866+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:27:44.413866+0000","last_peered":"2024-04-23T18:27:44.413866+0000","last_clean":"2024-04-23T18:27:44.413866+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:27:44.413866+0000","last_undegraded":"2024-04-23T18:27:44.413866+0000","last_fullsized":"2024-04-23T18:27:44.413866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.406830+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:24:49.406830+0000","last_peered":"2024-04-23T18:24:49.406830+0000","last_clean":"2024-04-23T18:24:49.406830+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:24:49.406830+0000","last_undegraded":"2024-04-23T18:24:49.406830+0000","last_fullsized":"2024-04-23T18:24:49.406830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.407650+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:24:44.407650+0000","last_peered":"2024-04-23T18:24:44.407650+0000","last_clean":"2024-04-23T18:24:44.407650+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:24:44.407650+0000","last_undegraded":"2024-04-23T18:24:44.407650+0000","last_fullsized":"2024-04-23T18:24:44.407650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'264","reported_seq":284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.429376+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:27:44.429376+0000","last_peered":"2024-04-23T18:27:44.429376+0000","last_clean":"2024-04-23T18:27:44.429376+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:27:44.429376+0000","last_undegraded":"2024-04-23T18:27:44.429376+0000","last_fullsized":"2024-04-23T18:27:44.429376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406308+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:24:44.406308+0000","last_peered":"2024-04-23T18:24:44.406308+0000","last_clean":"2024-04-23T18:24:44.406308+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:24:44.406308+0000","last_undegraded":"2024-04-23T18:24:44.406308+0000","last_fullsized":"2024-04-23T18:24:44.406308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.407620+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:24:44.407620+0000","last_peered":"2024-04-23T18:24:44.407620+0000","last_clean":"2024-04-23T18:24:44.407620+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:24:44.407620+0000","last_undegraded":"2024-04-23T18:24:44.407620+0000","last_fullsized":"2024-04-23T18:24:44.407620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'250","reported_seq":270,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.484987+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:27:44.484987+0000","last_peered":"2024-04-23T18:27:44.484987+0000","last_clean":"2024-04-23T18:27:44.484987+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:27:44.484987+0000","last_undegraded":"2024-04-23T18:27:44.484987+0000","last_fullsized":"2024-04-23T18:27:44.484987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.420863+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:24:44.420863+0000","last_peered":"2024-04-23T18:24:44.420863+0000","last_clean":"2024-04-23T18:24:44.420863+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:24:44.420863+0000","last_undegraded":"2024-04-23T18:24:44.420863+0000","last_fullsized":"2024-04-23T18:24:44.420863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.418867+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:24:44.418867+0000","last_peered":"2024-04-23T18:24:44.418867+0000","last_clean":"2024-04-23T18:24:44.418867+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:24:44.418867+0000","last_undegraded":"2024-04-23T18:24:44.418867+0000","last_fullsized":"2024-04-23T18:24:44.418867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'258","reported_seq":278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.391005+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:27:44.391005+0000","last_peered":"2024-04-23T18:27:44.391005+0000","last_clean":"2024-04-23T18:27:44.391005+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:27:44.391005+0000","last_undegraded":"2024-04-23T18:27:44.391005+0000","last_fullsized":"2024-04-23T18:27:44.391005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406022+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:24:44.406022+0000","last_peered":"2024-04-23T18:24:44.406022+0000","last_clean":"2024-04-23T18:24:44.406022+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:24:44.406022+0000","last_undegraded":"2024-04-23T18:24:44.406022+0000","last_fullsized":"2024-04-23T18:24:44.406022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.444485+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:24:44.444485+0000","last_peered":"2024-04-23T18:24:44.444485+0000","last_clean":"2024-04-23T18:24:44.444485+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:24:44.444485+0000","last_undegraded":"2024-04-23T18:24:44.444485+0000","last_fullsized":"2024-04-23T18:24:44.444485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'247","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.093506+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:27:44.093506+0000","last_peered":"2024-04-23T18:27:44.093506+0000","last_clean":"2024-04-23T18:27:44.093506+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:27:44.093506+0000","last_undegraded":"2024-04-23T18:27:44.093506+0000","last_fullsized":"2024-04-23T18:27:44.093506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406389+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:24:44.406389+0000","last_peered":"2024-04-23T18:24:44.406389+0000","last_clean":"2024-04-23T18:24:44.406389+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:24:44.406389+0000","last_undegraded":"2024-04-23T18:24:44.406389+0000","last_fullsized":"2024-04-23T18:24:44.406389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'23","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:42.449663+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:27:42.449663+0000","last_peered":"2024-04-23T18:27:42.449663+0000","last_clean":"2024-04-23T18:27:42.449663+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:27:42.449663+0000","last_undegraded":"2024-04-23T18:27:42.449663+0000","last_fullsized":"2024-04-23T18:27:42.449663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'247","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.358957+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:27:44.358957+0000","last_peered":"2024-04-23T18:27:44.358957+0000","last_clean":"2024-04-23T18:27:44.358957+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:27:44.358957+0000","last_undegraded":"2024-04-23T18:27:44.358957+0000","last_fullsized":"2024-04-23T18:27:44.358957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.407056+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:24:39.407056+0000","last_peered":"2024-04-23T18:24:39.407056+0000","last_clean":"2024-04-23T18:24:39.407056+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:24:39.407056+0000","last_undegraded":"2024-04-23T18:24:39.407056+0000","last_fullsized":"2024-04-23T18:24:39.407056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418044+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:24:39.418044+0000","last_peered":"2024-04-23T18:24:39.418044+0000","last_clean":"2024-04-23T18:24:39.418044+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:24:39.418044+0000","last_undegraded":"2024-04-23T18:24:39.418044+0000","last_fullsized":"2024-04-23T18:24:39.418044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'234","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.374568+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:27:44.374568+0000","last_peered":"2024-04-23T18:27:44.374568+0000","last_clean":"2024-04-23T18:27:44.374568+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:27:44.374568+0000","last_undegraded":"2024-04-23T18:27:44.374568+0000","last_fullsized":"2024-04-23T18:27:44.374568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.419062+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:24:39.419062+0000","last_peered":"2024-04-23T18:24:39.419062+0000","last_clean":"2024-04-23T18:24:39.419062+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:24:39.419062+0000","last_undegraded":"2024-04-23T18:24:39.419062+0000","last_fullsized":"2024-04-23T18:24:39.419062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.407076+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:24:39.407076+0000","last_peered":"2024-04-23T18:24:39.407076+0000","last_clean":"2024-04-23T18:24:39.407076+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:24:39.407076+0000","last_undegraded":"2024-04-23T18:24:39.407076+0000","last_fullsized":"2024-04-23T18:24:39.407076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'256","reported_seq":276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.474582+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:27:44.474582+0000","last_peered":"2024-04-23T18:27:44.474582+0000","last_clean":"2024-04-23T18:27:44.474582+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:27:44.474582+0000","last_undegraded":"2024-04-23T18:27:44.474582+0000","last_fullsized":"2024-04-23T18:27:44.474582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.420095+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:24:39.420095+0000","last_peered":"2024-04-23T18:24:39.420095+0000","last_clean":"2024-04-23T18:24:39.420095+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:24:39.420095+0000","last_undegraded":"2024-04-23T18:24:39.420095+0000","last_fullsized":"2024-04-23T18:24:39.420095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.419002+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:24:39.419002+0000","last_peered":"2024-04-23T18:24:39.419002+0000","last_clean":"2024-04-23T18:24:39.419002+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:24:39.419002+0000","last_undegraded":"2024-04-23T18:24:39.419002+0000","last_fullsized":"2024-04-23T18:24:39.419002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'242","reported_seq":262,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.287766+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:27:44.287766+0000","last_peered":"2024-04-23T18:27:44.287766+0000","last_clean":"2024-04-23T18:27:44.287766+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:27:44.287766+0000","last_undegraded":"2024-04-23T18:27:44.287766+0000","last_fullsized":"2024-04-23T18:27:44.287766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.406487+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:24:34.406487+0000","last_peered":"2024-04-23T18:24:34.406487+0000","last_clean":"2024-04-23T18:24:34.406487+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:24:34.406487+0000","last_undegraded":"2024-04-23T18:24:34.406487+0000","last_fullsized":"2024-04-23T18:24:34.406487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:42.653567+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:27:42.653567+0000","last_peered":"2024-04-23T18:27:42.653567+0000","last_clean":"2024-04-23T18:27:42.653567+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:27:42.653567+0000","last_undegraded":"2024-04-23T18:27:42.653567+0000","last_fullsized":"2024-04-23T18:27:42.653567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'249","reported_seq":263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.344008+0000","last_change":"2024-04-23T18:23:14.730523+0000","last_active":"2024-04-23T18:27:44.344008+0000","last_peered":"2024-04-23T18:27:44.344008+0000","last_clean":"2024-04-23T18:27:44.344008+0000","last_became_active":"2024-04-23T18:23:14.729941+0000","last_became_peered":"2024-04-23T18:23:14.729941+0000","last_unstale":"2024-04-23T18:27:44.344008+0000","last_undegraded":"2024-04-23T18:27:44.344008+0000","last_fullsized":"2024-04-23T18:27:44.344008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:54.938281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405431+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:24:39.405431+0000","last_peered":"2024-04-23T18:24:39.405431+0000","last_clean":"2024-04-23T18:24:39.405431+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:24:39.405431+0000","last_undegraded":"2024-04-23T18:24:39.405431+0000","last_fullsized":"2024-04-23T18:24:39.405431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.417125+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:24:34.417125+0000","last_peered":"2024-04-23T18:24:34.417125+0000","last_clean":"2024-04-23T18:24:34.417125+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:24:34.417125+0000","last_undegraded":"2024-04-23T18:24:34.417125+0000","last_fullsized":"2024-04-23T18:24:34.417125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'311","reported_seq":331,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.503782+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:27:44.503782+0000","last_peered":"2024-04-23T18:27:44.503782+0000","last_clean":"2024-04-23T18:27:44.503782+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:27:44.503782+0000","last_undegraded":"2024-04-23T18:27:44.503782+0000","last_fullsized":"2024-04-23T18:27:44.503782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405894+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:24:39.405894+0000","last_peered":"2024-04-23T18:24:39.405894+0000","last_clean":"2024-04-23T18:24:39.405894+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:24:39.405894+0000","last_undegraded":"2024-04-23T18:24:39.405894+0000","last_fullsized":"2024-04-23T18:24:39.405894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.419025+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:24:39.419025+0000","last_peered":"2024-04-23T18:24:39.419025+0000","last_clean":"2024-04-23T18:24:39.419025+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:24:39.419025+0000","last_undegraded":"2024-04-23T18:24:39.419025+0000","last_fullsized":"2024-04-23T18:24:39.419025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:24.415086+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:24:24.415086+0000","last_peered":"2024-04-23T18:24:24.415086+0000","last_clean":"2024-04-23T18:24:24.415086+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:24:24.415086+0000","last_undegraded":"2024-04-23T18:24:24.415086+0000","last_fullsized":"2024-04-23T18:24:24.415086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'260","reported_seq":280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.376095+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:27:44.376095+0000","last_peered":"2024-04-23T18:27:44.376095+0000","last_clean":"2024-04-23T18:27:44.376095+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:27:44.376095+0000","last_undegraded":"2024-04-23T18:27:44.376095+0000","last_fullsized":"2024-04-23T18:27:44.376095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419817+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:24:49.419817+0000","last_peered":"2024-04-23T18:24:49.419817+0000","last_clean":"2024-04-23T18:24:49.419817+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:24:49.419817+0000","last_undegraded":"2024-04-23T18:24:49.419817+0000","last_fullsized":"2024-04-23T18:24:49.419817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419330+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:24:49.419330+0000","last_peered":"2024-04-23T18:24:49.419330+0000","last_clean":"2024-04-23T18:24:49.419330+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:24:49.419330+0000","last_undegraded":"2024-04-23T18:24:49.419330+0000","last_fullsized":"2024-04-23T18:24:49.419330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'274","reported_seq":294,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.428361+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:27:44.428361+0000","last_peered":"2024-04-23T18:27:44.428361+0000","last_clean":"2024-04-23T18:27:44.428361+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:27:44.428361+0000","last_undegraded":"2024-04-23T18:27:44.428361+0000","last_fullsized":"2024-04-23T18:27:44.428361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.420674+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:24:49.420674+0000","last_peered":"2024-04-23T18:24:49.420674+0000","last_clean":"2024-04-23T18:24:49.420674+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:24:49.420674+0000","last_undegraded":"2024-04-23T18:24:49.420674+0000","last_fullsized":"2024-04-23T18:24:49.420674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.408151+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:24:49.408151+0000","last_peered":"2024-04-23T18:24:49.408151+0000","last_clean":"2024-04-23T18:24:49.408151+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:24:49.408151+0000","last_undegraded":"2024-04-23T18:24:49.408151+0000","last_fullsized":"2024-04-23T18:24:49.408151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'237","reported_seq":264,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.318209+0000","last_change":"2024-04-23T18:23:14.728059+0000","last_active":"2024-04-23T18:27:44.318209+0000","last_peered":"2024-04-23T18:27:44.318209+0000","last_clean":"2024-04-23T18:27:44.318209+0000","last_became_active":"2024-04-23T18:23:14.727676+0000","last_became_peered":"2024-04-23T18:23:14.727676+0000","last_unstale":"2024-04-23T18:27:44.318209+0000","last_undegraded":"2024-04-23T18:27:44.318209+0000","last_fullsized":"2024-04-23T18:27:44.318209+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:26.449657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419886+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:24:49.419886+0000","last_peered":"2024-04-23T18:24:49.419886+0000","last_clean":"2024-04-23T18:24:49.419886+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:24:49.419886+0000","last_undegraded":"2024-04-23T18:24:49.419886+0000","last_fullsized":"2024-04-23T18:24:49.419886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419350+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:24:49.419350+0000","last_peered":"2024-04-23T18:24:49.419350+0000","last_clean":"2024-04-23T18:24:49.419350+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:24:49.419350+0000","last_undegraded":"2024-04-23T18:24:49.419350+0000","last_fullsized":"2024-04-23T18:24:49.419350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'294","reported_seq":314,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.146178+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:27:44.146178+0000","last_peered":"2024-04-23T18:27:44.146178+0000","last_clean":"2024-04-23T18:27:44.146178+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:27:44.146178+0000","last_undegraded":"2024-04-23T18:27:44.146178+0000","last_fullsized":"2024-04-23T18:27:44.146178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419863+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:24:49.419863+0000","last_peered":"2024-04-23T18:24:49.419863+0000","last_clean":"2024-04-23T18:24:49.419863+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:24:49.419863+0000","last_undegraded":"2024-04-23T18:24:49.419863+0000","last_fullsized":"2024-04-23T18:24:49.419863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:38.665933+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:25:38.665933+0000","last_peered":"2024-04-23T18:25:38.665933+0000","last_clean":"2024-04-23T18:25:38.665933+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:25:38.665933+0000","last_undegraded":"2024-04-23T18:25:38.665933+0000","last_fullsized":"2024-04-23T18:25:38.665933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'248","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.345939+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:27:44.345939+0000","last_peered":"2024-04-23T18:27:44.345939+0000","last_clean":"2024-04-23T18:27:44.345939+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:27:44.345939+0000","last_undegraded":"2024-04-23T18:27:44.345939+0000","last_fullsized":"2024-04-23T18:27:44.345939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.724850+0000","last_change":"2024-04-23T18:23:14.723945+0000","last_active":"2024-04-23T18:23:14.724850+0000","last_peered":"2024-04-23T18:23:14.724850+0000","last_clean":"2024-04-23T18:23:14.724850+0000","last_became_active":"2024-04-23T18:23:14.723676+0000","last_became_peered":"2024-04-23T18:23:14.723676+0000","last_unstale":"2024-04-23T18:23:14.724850+0000","last_undegraded":"2024-04-23T18:23:14.724850+0000","last_fullsized":"2024-04-23T18:23:14.724850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:46.330533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'15","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.419797+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:24:54.419797+0000","last_peered":"2024-04-23T18:24:54.419797+0000","last_clean":"2024-04-23T18:24:54.419797+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:24:54.419797+0000","last_undegraded":"2024-04-23T18:24:54.419797+0000","last_fullsized":"2024-04-23T18:24:54.419797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'343","reported_seq":363,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.385996+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:27:44.385996+0000","last_peered":"2024-04-23T18:27:44.385996+0000","last_clean":"2024-04-23T18:27:44.385996+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:27:44.385996+0000","last_undegraded":"2024-04-23T18:27:44.385996+0000","last_fullsized":"2024-04-23T18:27:44.385996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.446645+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:24:54.446645+0000","last_peered":"2024-04-23T18:24:54.446645+0000","last_clean":"2024-04-23T18:24:54.446645+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:24:54.446645+0000","last_undegraded":"2024-04-23T18:24:54.446645+0000","last_fullsized":"2024-04-23T18:24:54.446645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"24'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.446755+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:24:54.446755+0000","last_peered":"2024-04-23T18:24:54.446755+0000","last_clean":"2024-04-23T18:24:54.446755+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:24:54.446755+0000","last_undegraded":"2024-04-23T18:24:54.446755+0000","last_fullsized":"2024-04-23T18:24:54.446755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'253","reported_seq":273,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.450009+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:27:44.450009+0000","last_peered":"2024-04-23T18:27:44.450009+0000","last_clean":"2024-04-23T18:27:44.450009+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:27:44.450009+0000","last_undegraded":"2024-04-23T18:27:44.450009+0000","last_fullsized":"2024-04-23T18:27:44.450009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.420817+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:24:54.420817+0000","last_peered":"2024-04-23T18:24:54.420817+0000","last_clean":"2024-04-23T18:24:54.420817+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:24:54.420817+0000","last_undegraded":"2024-04-23T18:24:54.420817+0000","last_fullsized":"2024-04-23T18:24:54.420817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.422660+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:24:54.422660+0000","last_peered":"2024-04-23T18:24:54.422660+0000","last_clean":"2024-04-23T18:24:54.422660+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:24:54.422660+0000","last_undegraded":"2024-04-23T18:24:54.422660+0000","last_fullsized":"2024-04-23T18:24:54.422660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'263","reported_seq":283,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.501456+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:27:44.501456+0000","last_peered":"2024-04-23T18:27:44.501456+0000","last_clean":"2024-04-23T18:27:44.501456+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:27:44.501456+0000","last_undegraded":"2024-04-23T18:27:44.501456+0000","last_fullsized":"2024-04-23T18:27:44.501456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.407062+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:24:54.407062+0000","last_peered":"2024-04-23T18:24:54.407062+0000","last_clean":"2024-04-23T18:24:54.407062+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:24:54.407062+0000","last_undegraded":"2024-04-23T18:24:54.407062+0000","last_fullsized":"2024-04-23T18:24:54.407062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'6","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.407101+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:24:54.407101+0000","last_peered":"2024-04-23T18:24:54.407101+0000","last_clean":"2024-04-23T18:24:54.407101+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:24:54.407101+0000","last_undegraded":"2024-04-23T18:24:54.407101+0000","last_fullsized":"2024-04-23T18:24:54.407101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'296","reported_seq":316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.458363+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:27:44.458363+0000","last_peered":"2024-04-23T18:27:44.458363+0000","last_clean":"2024-04-23T18:27:44.458363+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:27:44.458363+0000","last_undegraded":"2024-04-23T18:27:44.458363+0000","last_fullsized":"2024-04-23T18:27:44.458363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":285,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429156+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:24:59.429156+0000","last_peered":"2024-04-23T18:24:59.429156+0000","last_clean":"2024-04-23T18:24:59.429156+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:24:59.429156+0000","last_undegraded":"2024-04-23T18:24:59.429156+0000","last_fullsized":"2024-04-23T18:24:59.429156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'1978","reported_seq":2006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:38.322471+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:27:38.322471+0000","last_peered":"2024-04-23T18:27:38.322471+0000","last_clean":"2024-04-23T18:27:38.322471+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:27:38.322471+0000","last_undegraded":"2024-04-23T18:27:38.322471+0000","last_fullsized":"2024-04-23T18:27:38.322471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1978,"log_dups_size":0,"ondisk_log_size":1978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3963283,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1978,"num_write_kb":4064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'273","reported_seq":286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.447236+0000","last_change":"2024-04-23T18:23:14.730758+0000","last_active":"2024-04-23T18:27:44.447236+0000","last_peered":"2024-04-23T18:27:44.447236+0000","last_clean":"2024-04-23T18:27:44.447236+0000","last_became_active":"2024-04-23T18:23:14.729264+0000","last_became_peered":"2024-04-23T18:23:14.729264+0000","last_unstale":"2024-04-23T18:27:44.447236+0000","last_undegraded":"2024-04-23T18:27:44.447236+0000","last_fullsized":"2024-04-23T18:27:44.447236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:25:09.741395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.424986+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:24:54.424986+0000","last_peered":"2024-04-23T18:24:54.424986+0000","last_clean":"2024-04-23T18:24:54.424986+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:24:54.424986+0000","last_undegraded":"2024-04-23T18:24:54.424986+0000","last_fullsized":"2024-04-23T18:24:54.424986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'7","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:17.563123+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:25:17.563123+0000","last_peered":"2024-04-23T18:25:17.563123+0000","last_clean":"2024-04-23T18:25:17.563123+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:25:17.563123+0000","last_undegraded":"2024-04-23T18:25:17.563123+0000","last_fullsized":"2024-04-23T18:25:17.563123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'287","reported_seq":307,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.411127+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:27:44.411127+0000","last_peered":"2024-04-23T18:27:44.411127+0000","last_clean":"2024-04-23T18:27:44.411127+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:27:44.411127+0000","last_undegraded":"2024-04-23T18:27:44.411127+0000","last_fullsized":"2024-04-23T18:27:44.411127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.407567+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:24:59.407567+0000","last_peered":"2024-04-23T18:24:59.407567+0000","last_clean":"2024-04-23T18:24:59.407567+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:24:59.407567+0000","last_undegraded":"2024-04-23T18:24:59.407567+0000","last_fullsized":"2024-04-23T18:24:59.407567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429662+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:24:59.429662+0000","last_peered":"2024-04-23T18:24:59.429662+0000","last_clean":"2024-04-23T18:24:59.429662+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:24:59.429662+0000","last_undegraded":"2024-04-23T18:24:59.429662+0000","last_fullsized":"2024-04-23T18:24:59.429662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'292","reported_seq":312,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.376633+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:27:44.376633+0000","last_peered":"2024-04-23T18:27:44.376633+0000","last_clean":"2024-04-23T18:27:44.376633+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:27:44.376633+0000","last_undegraded":"2024-04-23T18:27:44.376633+0000","last_fullsized":"2024-04-23T18:27:44.376633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429648+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:24:59.429648+0000","last_peered":"2024-04-23T18:24:59.429648+0000","last_clean":"2024-04-23T18:24:59.429648+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:24:59.429648+0000","last_undegraded":"2024-04-23T18:24:59.429648+0000","last_fullsized":"2024-04-23T18:24:59.429648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.448017+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:24:59.448017+0000","last_peered":"2024-04-23T18:24:59.448017+0000","last_clean":"2024-04-23T18:24:59.448017+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:24:59.448017+0000","last_undegraded":"2024-04-23T18:24:59.448017+0000","last_fullsized":"2024-04-23T18:24:59.448017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'309","reported_seq":329,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.524017+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:27:44.524017+0000","last_peered":"2024-04-23T18:27:44.524017+0000","last_clean":"2024-04-23T18:27:44.524017+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:27:44.524017+0000","last_undegraded":"2024-04-23T18:27:44.524017+0000","last_fullsized":"2024-04-23T18:27:44.524017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'251","reported_seq":271,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.423077+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:27:44.423077+0000","last_peered":"2024-04-23T18:27:44.423077+0000","last_clean":"2024-04-23T18:27:44.423077+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:27:44.423077+0000","last_undegraded":"2024-04-23T18:27:44.423077+0000","last_fullsized":"2024-04-23T18:27:44.423077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:24.567862+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:27:24.567862+0000","last_peered":"2024-04-23T18:27:24.567862+0000","last_clean":"2024-04-23T18:27:24.567862+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:27:24.567862+0000","last_undegraded":"2024-04-23T18:27:24.567862+0000","last_fullsized":"2024-04-23T18:27:24.567862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429581+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:24:59.429581+0000","last_peered":"2024-04-23T18:24:59.429581+0000","last_clean":"2024-04-23T18:24:59.429581+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:24:59.429581+0000","last_undegraded":"2024-04-23T18:24:59.429581+0000","last_fullsized":"2024-04-23T18:24:59.429581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'245","reported_seq":265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.436308+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:27:44.436308+0000","last_peered":"2024-04-23T18:27:44.436308+0000","last_clean":"2024-04-23T18:27:44.436308+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:27:44.436308+0000","last_undegraded":"2024-04-23T18:27:44.436308+0000","last_fullsized":"2024-04-23T18:27:44.436308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.426807+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:24:59.426807+0000","last_peered":"2024-04-23T18:24:59.426807+0000","last_clean":"2024-04-23T18:24:59.426807+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:24:59.426807+0000","last_undegraded":"2024-04-23T18:24:59.426807+0000","last_fullsized":"2024-04-23T18:24:59.426807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.426852+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:24:59.426852+0000","last_peered":"2024-04-23T18:24:59.426852+0000","last_clean":"2024-04-23T18:24:59.426852+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:24:59.426852+0000","last_undegraded":"2024-04-23T18:24:59.426852+0000","last_fullsized":"2024-04-23T18:24:59.426852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.448866+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:25:04.448866+0000","last_peered":"2024-04-23T18:25:04.448866+0000","last_clean":"2024-04-23T18:25:04.448866+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:25:04.448866+0000","last_undegraded":"2024-04-23T18:25:04.448866+0000","last_fullsized":"2024-04-23T18:25:04.448866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.408050+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:25:04.408050+0000","last_peered":"2024-04-23T18:25:04.408050+0000","last_clean":"2024-04-23T18:25:04.408050+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:25:04.408050+0000","last_undegraded":"2024-04-23T18:25:04.408050+0000","last_fullsized":"2024-04-23T18:25:04.408050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'276","reported_seq":296,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.482439+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:27:44.482439+0000","last_peered":"2024-04-23T18:27:44.482439+0000","last_clean":"2024-04-23T18:27:44.482439+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:27:44.482439+0000","last_undegraded":"2024-04-23T18:27:44.482439+0000","last_fullsized":"2024-04-23T18:27:44.482439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.427467+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:25:04.427467+0000","last_peered":"2024-04-23T18:25:04.427467+0000","last_clean":"2024-04-23T18:25:04.427467+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:25:04.427467+0000","last_undegraded":"2024-04-23T18:25:04.427467+0000","last_fullsized":"2024-04-23T18:25:04.427467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.426743+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:25:04.426743+0000","last_peered":"2024-04-23T18:25:04.426743+0000","last_clean":"2024-04-23T18:25:04.426743+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:25:04.426743+0000","last_undegraded":"2024-04-23T18:25:04.426743+0000","last_fullsized":"2024-04-23T18:25:04.426743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'292","reported_seq":312,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.526792+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:27:44.526792+0000","last_peered":"2024-04-23T18:27:44.526792+0000","last_clean":"2024-04-23T18:27:44.526792+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:27:44.526792+0000","last_undegraded":"2024-04-23T18:27:44.526792+0000","last_fullsized":"2024-04-23T18:27:44.526792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.443391+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:24:39.443391+0000","last_peered":"2024-04-23T18:24:39.443391+0000","last_clean":"2024-04-23T18:24:39.443391+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:24:39.443391+0000","last_undegraded":"2024-04-23T18:24:39.443391+0000","last_fullsized":"2024-04-23T18:24:39.443391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418207+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:24:39.418207+0000","last_peered":"2024-04-23T18:24:39.418207+0000","last_clean":"2024-04-23T18:24:39.418207+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:24:39.418207+0000","last_undegraded":"2024-04-23T18:24:39.418207+0000","last_fullsized":"2024-04-23T18:24:39.418207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418960+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:24:39.418960+0000","last_peered":"2024-04-23T18:24:39.418960+0000","last_clean":"2024-04-23T18:24:39.418960+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:24:39.418960+0000","last_undegraded":"2024-04-23T18:24:39.418960+0000","last_fullsized":"2024-04-23T18:24:39.418960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405460+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:24:39.405460+0000","last_peered":"2024-04-23T18:24:39.405460+0000","last_clean":"2024-04-23T18:24:39.405460+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:24:39.405460+0000","last_undegraded":"2024-04-23T18:24:39.405460+0000","last_fullsized":"2024-04-23T18:24:39.405460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406352+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:24:44.406352+0000","last_peered":"2024-04-23T18:24:44.406352+0000","last_clean":"2024-04-23T18:24:44.406352+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:24:44.406352+0000","last_undegraded":"2024-04-23T18:24:44.406352+0000","last_fullsized":"2024-04-23T18:24:44.406352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.407689+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:24:44.407689+0000","last_peered":"2024-04-23T18:24:44.407689+0000","last_clean":"2024-04-23T18:24:44.407689+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:24:44.407689+0000","last_undegraded":"2024-04-23T18:24:44.407689+0000","last_fullsized":"2024-04-23T18:24:44.407689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.444383+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:24:44.444383+0000","last_peered":"2024-04-23T18:24:44.444383+0000","last_clean":"2024-04-23T18:24:44.444383+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:24:44.444383+0000","last_undegraded":"2024-04-23T18:24:44.444383+0000","last_fullsized":"2024-04-23T18:24:44.444383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406374+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:24:44.406374+0000","last_peered":"2024-04-23T18:24:44.406374+0000","last_clean":"2024-04-23T18:24:44.406374+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:24:44.406374+0000","last_undegraded":"2024-04-23T18:24:44.406374+0000","last_fullsized":"2024-04-23T18:24:44.406374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.419755+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:24:44.419755+0000","last_peered":"2024-04-23T18:24:44.419755+0000","last_clean":"2024-04-23T18:24:44.419755+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:24:44.419755+0000","last_undegraded":"2024-04-23T18:24:44.419755+0000","last_fullsized":"2024-04-23T18:24:44.419755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.406806+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:24:49.406806+0000","last_peered":"2024-04-23T18:24:49.406806+0000","last_clean":"2024-04-23T18:24:49.406806+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:24:49.406806+0000","last_undegraded":"2024-04-23T18:24:49.406806+0000","last_fullsized":"2024-04-23T18:24:49.406806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:29.426186+0000","last_change":"2024-04-23T18:23:14.787713+0000","last_active":"2024-04-23T18:25:29.426186+0000","last_peered":"2024-04-23T18:25:29.426186+0000","last_clean":"2024-04-23T18:25:29.426186+0000","last_became_active":"2024-04-23T18:23:14.787340+0000","last_became_peered":"2024-04-23T18:23:14.787340+0000","last_unstale":"2024-04-23T18:25:29.426186+0000","last_undegraded":"2024-04-23T18:25:29.426186+0000","last_fullsized":"2024-04-23T18:25:29.426186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:44:54.939264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.406496+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:24:49.406496+0000","last_peered":"2024-04-23T18:24:49.406496+0000","last_clean":"2024-04-23T18:24:49.406496+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:24:49.406496+0000","last_undegraded":"2024-04-23T18:24:49.406496+0000","last_fullsized":"2024-04-23T18:24:49.406496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.445374+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:24:49.445374+0000","last_peered":"2024-04-23T18:24:49.445374+0000","last_clean":"2024-04-23T18:24:49.445374+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:24:49.445374+0000","last_undegraded":"2024-04-23T18:24:49.445374+0000","last_fullsized":"2024-04-23T18:24:49.445374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419840+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:24:49.419840+0000","last_peered":"2024-04-23T18:24:49.419840+0000","last_clean":"2024-04-23T18:24:49.419840+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:24:49.419840+0000","last_undegraded":"2024-04-23T18:24:49.419840+0000","last_fullsized":"2024-04-23T18:24:49.419840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.419872+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:24:54.419872+0000","last_peered":"2024-04-23T18:24:54.419872+0000","last_clean":"2024-04-23T18:24:54.419872+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:24:54.419872+0000","last_undegraded":"2024-04-23T18:24:54.419872+0000","last_fullsized":"2024-04-23T18:24:54.419872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.422820+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:24:54.422820+0000","last_peered":"2024-04-23T18:24:54.422820+0000","last_clean":"2024-04-23T18:24:54.422820+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:24:54.422820+0000","last_undegraded":"2024-04-23T18:24:54.422820+0000","last_fullsized":"2024-04-23T18:24:54.422820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.422415+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:24:54.422415+0000","last_peered":"2024-04-23T18:24:54.422415+0000","last_clean":"2024-04-23T18:24:54.422415+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:24:54.422415+0000","last_undegraded":"2024-04-23T18:24:54.422415+0000","last_fullsized":"2024-04-23T18:24:54.422415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.408573+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:24:54.408573+0000","last_peered":"2024-04-23T18:24:54.408573+0000","last_clean":"2024-04-23T18:24:54.408573+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:24:54.408573+0000","last_undegraded":"2024-04-23T18:24:54.408573+0000","last_fullsized":"2024-04-23T18:24:54.408573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.407037+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:24:54.407037+0000","last_peered":"2024-04-23T18:24:54.407037+0000","last_clean":"2024-04-23T18:24:54.407037+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:24:54.407037+0000","last_undegraded":"2024-04-23T18:24:54.407037+0000","last_fullsized":"2024-04-23T18:24:54.407037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.426862+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:24:59.426862+0000","last_peered":"2024-04-23T18:24:59.426862+0000","last_clean":"2024-04-23T18:24:59.426862+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:24:59.426862+0000","last_undegraded":"2024-04-23T18:24:59.426862+0000","last_fullsized":"2024-04-23T18:24:59.426862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.425933+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:24:59.425933+0000","last_peered":"2024-04-23T18:24:59.425933+0000","last_clean":"2024-04-23T18:24:59.425933+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:24:59.425933+0000","last_undegraded":"2024-04-23T18:24:59.425933+0000","last_fullsized":"2024-04-23T18:24:59.425933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.447843+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:24:59.447843+0000","last_peered":"2024-04-23T18:24:59.447843+0000","last_clean":"2024-04-23T18:24:59.447843+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:24:59.447843+0000","last_undegraded":"2024-04-23T18:24:59.447843+0000","last_fullsized":"2024-04-23T18:24:59.447843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:16.546558+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:25:16.546558+0000","last_peered":"2024-04-23T18:25:16.546558+0000","last_clean":"2024-04-23T18:25:16.546558+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:25:16.546558+0000","last_undegraded":"2024-04-23T18:25:16.546558+0000","last_fullsized":"2024-04-23T18:25:16.546558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429208+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:24:59.429208+0000","last_peered":"2024-04-23T18:24:59.429208+0000","last_clean":"2024-04-23T18:24:59.429208+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:24:59.429208+0000","last_undegraded":"2024-04-23T18:24:59.429208+0000","last_fullsized":"2024-04-23T18:24:59.429208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.427357+0000","last_change":"2024-04-23T18:23:14.787765+0000","last_active":"2024-04-23T18:25:04.427357+0000","last_peered":"2024-04-23T18:25:04.427357+0000","last_clean":"2024-04-23T18:25:04.427357+0000","last_became_active":"2024-04-23T18:23:14.787444+0000","last_became_peered":"2024-04-23T18:23:14.787444+0000","last_unstale":"2024-04-23T18:25:04.427357+0000","last_undegraded":"2024-04-23T18:25:04.427357+0000","last_fullsized":"2024-04-23T18:25:04.427357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:12.714842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.429969+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:25:04.429969+0000","last_peered":"2024-04-23T18:25:04.429969+0000","last_clean":"2024-04-23T18:25:04.429969+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:25:04.429969+0000","last_undegraded":"2024-04-23T18:25:04.429969+0000","last_fullsized":"2024-04-23T18:25:04.429969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430478+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:25:04.430478+0000","last_peered":"2024-04-23T18:25:04.430478+0000","last_clean":"2024-04-23T18:25:04.430478+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:25:04.430478+0000","last_undegraded":"2024-04-23T18:25:04.430478+0000","last_fullsized":"2024-04-23T18:25:04.430478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430005+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:25:04.430005+0000","last_peered":"2024-04-23T18:25:04.430005+0000","last_clean":"2024-04-23T18:25:04.430005+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:25:04.430005+0000","last_undegraded":"2024-04-23T18:25:04.430005+0000","last_fullsized":"2024-04-23T18:25:04.430005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.418134+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:24:34.418134+0000","last_peered":"2024-04-23T18:24:34.418134+0000","last_clean":"2024-04-23T18:24:34.418134+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:24:34.418134+0000","last_undegraded":"2024-04-23T18:24:34.418134+0000","last_fullsized":"2024-04-23T18:24:34.418134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405476+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:24:39.405476+0000","last_peered":"2024-04-23T18:24:39.405476+0000","last_clean":"2024-04-23T18:24:39.405476+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:24:39.405476+0000","last_undegraded":"2024-04-23T18:24:39.405476+0000","last_fullsized":"2024-04-23T18:24:39.405476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.407088+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:24:39.407088+0000","last_peered":"2024-04-23T18:24:39.407088+0000","last_clean":"2024-04-23T18:24:39.407088+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:24:39.407088+0000","last_undegraded":"2024-04-23T18:24:39.407088+0000","last_fullsized":"2024-04-23T18:24:39.407088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418110+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:24:39.418110+0000","last_peered":"2024-04-23T18:24:39.418110+0000","last_clean":"2024-04-23T18:24:39.418110+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:24:39.418110+0000","last_undegraded":"2024-04-23T18:24:39.418110+0000","last_fullsized":"2024-04-23T18:24:39.418110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":4492099584,"num_objects":1071,"num_object_clones":0,"num_object_copies":4284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1071,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8145,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8984199168,"data_stored":8984199168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8660,"ondisk_log_size":8660,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3967478,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2143,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8093696,"data_stored":7934956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2112,"ondisk_log_size":2112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1293360,"kb_used_data":1233768,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":93078480,"statfs":{"total":96636764160,"available":95312363520,"internally_reserved":0,"allocated":1263378432,"data_stored":1263191549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1566468,"kb_used_data":1495100,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":92805372,"statfs":{"total":96636764160,"available":95032700928,"internally_reserved":0,"allocated":1530982400,"data_stored":1530800291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1343916,"kb_used_data":1290532,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":93027924,"statfs":{"total":96636764160,"available":95260594176,"internally_reserved":0,"allocated":1321504768,"data_stored":1321321499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1481192,"kb_used_data":1423648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":92890648,"statfs":{"total":96636764160,"available":95120023552,"internally_reserved":0,"allocated":1457815552,"data_stored":1457635973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693516,"kb_used_data":1617988,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":92678324,"statfs":{"total":96636764160,"available":94902603776,"internally_reserved":0,"allocated":1656819712,"data_stored":1656629514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77330887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1167792,"kb_used_data":1114408,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":93204048,"statfs":{"total":96636764160,"available":95440945152,"internally_reserved":0,"allocated":1141153792,"data_stored":1140966194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1660848,"kb_used_data":1589544,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":92710992,"statfs":{"total":96636764160,"available":94936055808,"internally_reserved":0,"allocated":1627693056,"data_stored":1627505257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1537068,"kb_used_data":1471332,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":92834772,"statfs":{"total":96636764160,"available":95062806528,"internally_reserved":0,"allocated":1506643968,"data_stored":1506460525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3989504,"data_stored":3964322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3981312,"data_stored":3964219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":966787072,"data_stored":966787072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1400897536,"data_stored":1400897536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":882900992,"data_stored":882900992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1468006400,"data_stored":1468006400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1119879168,"data_stored":1119879168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":950009856,"data_stored":950009856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1186988032,"data_stored":1186988032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1008730112,"data_stored":1008730112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:27:49.534 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:27:49.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f41a6800640 1 Processor -- start 2024-04-23T18:27:49.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f41a6800640 1 -- start start 2024-04-23T18:27:49.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f41a6800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41a01444d0 0x7f41a015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f41a6800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f41a00c8130 0x7f41a00cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f41a6800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a0071ea0 con 0x7f41a00cdc80 2024-04-23T18:27:49.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f41a6800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f41a0071c50 con 0x7f41a00c8130 2024-04-23T18:27:49.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f41a6800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f41a0072ab0 con 0x7f41a01444d0 2024-04-23T18:27:49.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f419ea00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f41a00c8130 0x7f41a00cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:49.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f419ea00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f41a00c8130 0x7f41a00cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33154/0 (socket says 172.21.15.28:33154) 2024-04-23T18:27:49.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f419ea00640 1 -- 172.21.15.28:0/296482471 learned_addr learned my addr 172.21.15.28:0/296482471 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:49.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f419f400640 1 --2- 172.21.15.28:0/296482471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41a01444d0 0x7f41a015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:49.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f419ea00640 1 -- 172.21.15.28:0/296482471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41a01444d0 msgr2=0x7f41a015bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:49.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f419ea00640 1 --2- 172.21.15.28:0/296482471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41a01444d0 0x7f41a015bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f419ea00640 1 -- 172.21.15.28:0/296482471 >> v1:172.21.15.137:6789/0 conn(0x7f41a00cdc80 legacy=0x7f41a015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.717+0000 7f419ea00640 1 -- 172.21.15.28:0/296482471 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a0072180 con 0x7f41a00c8130 2024-04-23T18:27:49.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f419ea00640 1 --2- 172.21.15.28:0/296482471 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a00c8130 0x7f41a00cd740 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f418c009870 tx=0x7f418c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172340b1ba4c22d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:49.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f419e000640 1 -- 172.21.15.28:0/296482471 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c0b5070 con 0x7f41a00c8130 2024-04-23T18:27:49.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f419e000640 1 -- 172.21.15.28:0/296482471 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c0a8a50 con 0x7f41a00c8130 2024-04-23T18:27:49.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f419e000640 1 -- 172.21.15.28:0/296482471 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c0a8e20 con 0x7f41a00c8130 2024-04-23T18:27:49.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f41a6800640 1 -- 172.21.15.28:0/296482471 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a00c8130 msgr2=0x7f41a00cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f41a6800640 1 --2- 172.21.15.28:0/296482471 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a00c8130 0x7f41a00cd740 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f418c009870 tx=0x7f418c01ed50 comp rx=0 tx=0).stop 2024-04-23T18:27:49.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f41a6800640 1 -- 172.21.15.28:0/296482471 shutdown_connections 2024-04-23T18:27:49.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f41a6800640 1 --2- 172.21.15.28:0/296482471 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a00c8130 0x7f41a00cd740 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f41a6800640 1 --2- 172.21.15.28:0/296482471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41a01444d0 0x7f41a015bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f41a6800640 1 -- 172.21.15.28:0/296482471 >> 172.21.15.28:0/296482471 conn(0x7f41a0075e30 msgr2=0x7f41a006b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:49.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f41a6800640 1 -- 172.21.15.28:0/296482471 shutdown_connections 2024-04-23T18:27:49.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f41a6800640 1 -- 172.21.15.28:0/296482471 wait complete. 2024-04-23T18:27:49.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.721+0000 7f41a6800640 1 Processor -- start 2024-04-23T18:27:49.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f41a6800640 1 -- start start 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f41a6800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a00c8130 0x7f41a0157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f41a6800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41a00cdc80 0x7f41a01559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f41a6800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41a01444d0 0x7f41a01f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f41a6800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f41a01448b0 con 0x7f41a00c8130 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f41a6800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41a0072740 con 0x7f41a01444d0 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f41a6800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f41a00c8550 con 0x7f41a00cdc80 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f419f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a00c8130 0x7f41a0157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f419f400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a00c8130 0x7f41a0157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33164/0 (socket says 172.21.15.28:33164) 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f419f400640 1 -- 172.21.15.28:0/1007344584 learned_addr learned my addr 172.21.15.28:0/1007344584 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f419fe00640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41a01444d0 0x7f41a01f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f419f400640 1 -- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41a00cdc80 msgr2=0x7f41a01559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f419f400640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41a00cdc80 0x7f41a01559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f419f400640 1 -- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41a01444d0 msgr2=0x7f41a01f40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f419f400640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41a01444d0 0x7f41a01f40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f419f400640 1 -- 172.21.15.28:0/1007344584 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a0157e70 con 0x7f41a00c8130 2024-04-23T18:27:49.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f419f400640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a00c8130 0x7f41a0157930 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f419000d620 tx=0x7f419000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:49.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f4197400640 1 -- 172.21.15.28:0/1007344584 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419000b620 con 0x7f41a00c8130 2024-04-23T18:27:49.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f4197400640 1 -- 172.21.15.28:0/1007344584 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4190019070 con 0x7f41a00c8130 2024-04-23T18:27:49.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f41a6800640 1 -- 172.21.15.28:0/1007344584 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a01f4bd0 con 0x7f41a00c8130 2024-04-23T18:27:49.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f4197400640 1 -- 172.21.15.28:0/1007344584 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419000b9e0 con 0x7f41a00c8130 2024-04-23T18:27:49.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f41a6800640 1 -- 172.21.15.28:0/1007344584 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a0158910 con 0x7f41a00c8130 2024-04-23T18:27:49.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.725+0000 7f41a6800640 1 -- 172.21.15.28:0/1007344584 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a0068cd0 con 0x7f41a00c8130 2024-04-23T18:27:49.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.729+0000 7f4197400640 1 -- 172.21.15.28:0/1007344584 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f419000bb80 con 0x7f41a00c8130 2024-04-23T18:27:49.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.729+0000 7f4197400640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4180068380 0x7f418006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:49.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.729+0000 7f4197400640 1 -- 172.21.15.28:0/1007344584 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4190087270 con 0x7f41a00c8130 2024-04-23T18:27:49.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.729+0000 7f419ea00640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4180068380 0x7f418006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:49.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.729+0000 7f419ea00640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4180068380 0x7f418006a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f418c0b2000 tx=0x7f418c004740 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:49.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.733+0000 7f4197400640 1 -- 172.21.15.28:0/1007344584 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4190057420 con 0x7f41a00c8130 2024-04-23T18:27:49.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.897+0000 7f41a6800640 1 -- 172.21.15.28:0/1007344584 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41a00684f0 con 0x7f4180068380 2024-04-23T18:27:49.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.921+0000 7f4197400640 1 -- 172.21.15.28:0/1007344584 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334004 (secure 0 0 0) 0x7f418c1108d0 con 0x7f4180068380 2024-04-23T18:27:49.919 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:27:49.921 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:27:49.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 -- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4180068380 msgr2=0x7f418006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4180068380 0x7f418006a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f418c0b2000 tx=0x7f418c004740 comp rx=0 tx=0).stop 2024-04-23T18:27:49.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 -- 172.21.15.28:0/1007344584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a00c8130 msgr2=0x7f41a0157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:49.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a00c8130 0x7f41a0157930 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f419000d620 tx=0x7f419000dae0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 -- 172.21.15.28:0/1007344584 shutdown_connections 2024-04-23T18:27:49.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f4180068380 0x7f418006a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f41a00cdc80 0x7f41a01559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41a01444d0 0x7f41a01f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 --2- 172.21.15.28:0/1007344584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a00c8130 0x7f41a0157930 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:49.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 -- 172.21.15.28:0/1007344584 >> 172.21.15.28:0/1007344584 conn(0x7f41a0075e30 msgr2=0x7f41a0142780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:49.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 -- 172.21.15.28:0/1007344584 shutdown_connections 2024-04-23T18:27:49.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:49.925+0000 7f41a6800640 1 -- 172.21.15.28:0/1007344584 wait complete. 2024-04-23T18:27:49.938 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-04-23T18:27:49.442543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4496657430,"num_objects":1134,"num_object_clones":0,"num_object_copies":4410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1134,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":10447,"num_write_kb":25172361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10892,"ondisk_log_size":10892,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":11744160,"kb_used_data":11236320,"kb_used_omap":12,"kb_used_meta":493427,"kb_avail":743230560,"statfs":{"total":773094113280,"available":761068093440,"internally_reserved":0,"allocated":11505991680,"data_stored":11504510802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":505269808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6245308358,"num_objects":-1489,"num_object_clones":0,"num_object_copies":-5956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1489,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1500,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003718"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405510+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:24:39.405510+0000","last_peered":"2024-04-23T18:24:39.405510+0000","last_clean":"2024-04-23T18:24:39.405510+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:24:39.405510+0000","last_undegraded":"2024-04-23T18:24:39.405510+0000","last_fullsized":"2024-04-23T18:24:39.405510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:14.421976+0000","last_change":"2024-04-23T18:23:14.723733+0000","last_active":"2024-04-23T18:25:14.421976+0000","last_peered":"2024-04-23T18:25:14.421976+0000","last_clean":"2024-04-23T18:25:14.421976+0000","last_became_active":"2024-04-23T18:23:14.723423+0000","last_became_peered":"2024-04-23T18:23:14.723423+0000","last_unstale":"2024-04-23T18:25:14.421976+0000","last_undegraded":"2024-04-23T18:25:14.421976+0000","last_fullsized":"2024-04-23T18:25:14.421976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:28:08.520812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"26'301","reported_seq":321,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.517469+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:27:44.517469+0000","last_peered":"2024-04-23T18:27:44.517469+0000","last_clean":"2024-04-23T18:27:44.517469+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:27:44.517469+0000","last_undegraded":"2024-04-23T18:27:44.517469+0000","last_fullsized":"2024-04-23T18:27:44.517469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.405371+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:24:34.405371+0000","last_peered":"2024-04-23T18:24:34.405371+0000","last_clean":"2024-04-23T18:24:34.405371+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:24:34.405371+0000","last_undegraded":"2024-04-23T18:24:34.405371+0000","last_fullsized":"2024-04-23T18:24:34.405371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405499+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:24:39.405499+0000","last_peered":"2024-04-23T18:24:39.405499+0000","last_clean":"2024-04-23T18:24:39.405499+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:24:39.405499+0000","last_undegraded":"2024-04-23T18:24:39.405499+0000","last_fullsized":"2024-04-23T18:24:39.405499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'313","reported_seq":333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.332874+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:27:44.332874+0000","last_peered":"2024-04-23T18:27:44.332874+0000","last_clean":"2024-04-23T18:27:44.332874+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:27:44.332874+0000","last_undegraded":"2024-04-23T18:27:44.332874+0000","last_fullsized":"2024-04-23T18:27:44.332874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430064+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:25:04.430064+0000","last_peered":"2024-04-23T18:25:04.430064+0000","last_clean":"2024-04-23T18:25:04.430064+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:25:04.430064+0000","last_undegraded":"2024-04-23T18:25:04.430064+0000","last_fullsized":"2024-04-23T18:25:04.430064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430562+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:25:04.430562+0000","last_peered":"2024-04-23T18:25:04.430562+0000","last_clean":"2024-04-23T18:25:04.430562+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:25:04.430562+0000","last_undegraded":"2024-04-23T18:25:04.430562+0000","last_fullsized":"2024-04-23T18:25:04.430562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'255","reported_seq":275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.364905+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:27:44.364905+0000","last_peered":"2024-04-23T18:27:44.364905+0000","last_clean":"2024-04-23T18:27:44.364905+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:27:44.364905+0000","last_undegraded":"2024-04-23T18:27:44.364905+0000","last_fullsized":"2024-04-23T18:27:44.364905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430032+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:25:04.430032+0000","last_peered":"2024-04-23T18:25:04.430032+0000","last_clean":"2024-04-23T18:25:04.430032+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:25:04.430032+0000","last_undegraded":"2024-04-23T18:25:04.430032+0000","last_fullsized":"2024-04-23T18:25:04.430032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430641+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:25:04.430641+0000","last_peered":"2024-04-23T18:25:04.430641+0000","last_clean":"2024-04-23T18:25:04.430641+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:25:04.430641+0000","last_undegraded":"2024-04-23T18:25:04.430641+0000","last_fullsized":"2024-04-23T18:25:04.430641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'241","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.277499+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:27:44.277499+0000","last_peered":"2024-04-23T18:27:44.277499+0000","last_clean":"2024-04-23T18:27:44.277499+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:27:44.277499+0000","last_undegraded":"2024-04-23T18:27:44.277499+0000","last_fullsized":"2024-04-23T18:27:44.277499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.444237+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:24:44.444237+0000","last_peered":"2024-04-23T18:24:44.444237+0000","last_clean":"2024-04-23T18:24:44.444237+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:24:44.444237+0000","last_undegraded":"2024-04-23T18:24:44.444237+0000","last_fullsized":"2024-04-23T18:24:44.444237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:51.515161+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:24:51.515161+0000","last_peered":"2024-04-23T18:24:51.515161+0000","last_clean":"2024-04-23T18:24:51.515161+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:24:51.515161+0000","last_undegraded":"2024-04-23T18:24:51.515161+0000","last_fullsized":"2024-04-23T18:24:51.515161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'299","reported_seq":319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.413866+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:27:44.413866+0000","last_peered":"2024-04-23T18:27:44.413866+0000","last_clean":"2024-04-23T18:27:44.413866+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:27:44.413866+0000","last_undegraded":"2024-04-23T18:27:44.413866+0000","last_fullsized":"2024-04-23T18:27:44.413866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.406830+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:24:49.406830+0000","last_peered":"2024-04-23T18:24:49.406830+0000","last_clean":"2024-04-23T18:24:49.406830+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:24:49.406830+0000","last_undegraded":"2024-04-23T18:24:49.406830+0000","last_fullsized":"2024-04-23T18:24:49.406830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.407650+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:24:44.407650+0000","last_peered":"2024-04-23T18:24:44.407650+0000","last_clean":"2024-04-23T18:24:44.407650+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:24:44.407650+0000","last_undegraded":"2024-04-23T18:24:44.407650+0000","last_fullsized":"2024-04-23T18:24:44.407650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'264","reported_seq":284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.429376+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:27:44.429376+0000","last_peered":"2024-04-23T18:27:44.429376+0000","last_clean":"2024-04-23T18:27:44.429376+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:27:44.429376+0000","last_undegraded":"2024-04-23T18:27:44.429376+0000","last_fullsized":"2024-04-23T18:27:44.429376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406308+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:24:44.406308+0000","last_peered":"2024-04-23T18:24:44.406308+0000","last_clean":"2024-04-23T18:24:44.406308+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:24:44.406308+0000","last_undegraded":"2024-04-23T18:24:44.406308+0000","last_fullsized":"2024-04-23T18:24:44.406308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.407620+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:24:44.407620+0000","last_peered":"2024-04-23T18:24:44.407620+0000","last_clean":"2024-04-23T18:24:44.407620+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:24:44.407620+0000","last_undegraded":"2024-04-23T18:24:44.407620+0000","last_fullsized":"2024-04-23T18:24:44.407620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'250","reported_seq":270,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.484987+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:27:44.484987+0000","last_peered":"2024-04-23T18:27:44.484987+0000","last_clean":"2024-04-23T18:27:44.484987+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:27:44.484987+0000","last_undegraded":"2024-04-23T18:27:44.484987+0000","last_fullsized":"2024-04-23T18:27:44.484987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.420863+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:24:44.420863+0000","last_peered":"2024-04-23T18:24:44.420863+0000","last_clean":"2024-04-23T18:24:44.420863+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:24:44.420863+0000","last_undegraded":"2024-04-23T18:24:44.420863+0000","last_fullsized":"2024-04-23T18:24:44.420863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.418867+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:24:44.418867+0000","last_peered":"2024-04-23T18:24:44.418867+0000","last_clean":"2024-04-23T18:24:44.418867+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:24:44.418867+0000","last_undegraded":"2024-04-23T18:24:44.418867+0000","last_fullsized":"2024-04-23T18:24:44.418867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'258","reported_seq":278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.391005+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:27:44.391005+0000","last_peered":"2024-04-23T18:27:44.391005+0000","last_clean":"2024-04-23T18:27:44.391005+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:27:44.391005+0000","last_undegraded":"2024-04-23T18:27:44.391005+0000","last_fullsized":"2024-04-23T18:27:44.391005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406022+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:24:44.406022+0000","last_peered":"2024-04-23T18:24:44.406022+0000","last_clean":"2024-04-23T18:24:44.406022+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:24:44.406022+0000","last_undegraded":"2024-04-23T18:24:44.406022+0000","last_fullsized":"2024-04-23T18:24:44.406022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.444485+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:24:44.444485+0000","last_peered":"2024-04-23T18:24:44.444485+0000","last_clean":"2024-04-23T18:24:44.444485+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:24:44.444485+0000","last_undegraded":"2024-04-23T18:24:44.444485+0000","last_fullsized":"2024-04-23T18:24:44.444485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'247","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.093506+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:27:44.093506+0000","last_peered":"2024-04-23T18:27:44.093506+0000","last_clean":"2024-04-23T18:27:44.093506+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:27:44.093506+0000","last_undegraded":"2024-04-23T18:27:44.093506+0000","last_fullsized":"2024-04-23T18:27:44.093506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406389+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:24:44.406389+0000","last_peered":"2024-04-23T18:24:44.406389+0000","last_clean":"2024-04-23T18:24:44.406389+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:24:44.406389+0000","last_undegraded":"2024-04-23T18:24:44.406389+0000","last_fullsized":"2024-04-23T18:24:44.406389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'23","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:42.449663+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:27:42.449663+0000","last_peered":"2024-04-23T18:27:42.449663+0000","last_clean":"2024-04-23T18:27:42.449663+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:27:42.449663+0000","last_undegraded":"2024-04-23T18:27:42.449663+0000","last_fullsized":"2024-04-23T18:27:42.449663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'247","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.358957+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:27:44.358957+0000","last_peered":"2024-04-23T18:27:44.358957+0000","last_clean":"2024-04-23T18:27:44.358957+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:27:44.358957+0000","last_undegraded":"2024-04-23T18:27:44.358957+0000","last_fullsized":"2024-04-23T18:27:44.358957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.407056+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:24:39.407056+0000","last_peered":"2024-04-23T18:24:39.407056+0000","last_clean":"2024-04-23T18:24:39.407056+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:24:39.407056+0000","last_undegraded":"2024-04-23T18:24:39.407056+0000","last_fullsized":"2024-04-23T18:24:39.407056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418044+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:24:39.418044+0000","last_peered":"2024-04-23T18:24:39.418044+0000","last_clean":"2024-04-23T18:24:39.418044+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:24:39.418044+0000","last_undegraded":"2024-04-23T18:24:39.418044+0000","last_fullsized":"2024-04-23T18:24:39.418044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'234","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.374568+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:27:44.374568+0000","last_peered":"2024-04-23T18:27:44.374568+0000","last_clean":"2024-04-23T18:27:44.374568+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:27:44.374568+0000","last_undegraded":"2024-04-23T18:27:44.374568+0000","last_fullsized":"2024-04-23T18:27:44.374568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.419062+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:24:39.419062+0000","last_peered":"2024-04-23T18:24:39.419062+0000","last_clean":"2024-04-23T18:24:39.419062+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:24:39.419062+0000","last_undegraded":"2024-04-23T18:24:39.419062+0000","last_fullsized":"2024-04-23T18:24:39.419062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.407076+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:24:39.407076+0000","last_peered":"2024-04-23T18:24:39.407076+0000","last_clean":"2024-04-23T18:24:39.407076+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:24:39.407076+0000","last_undegraded":"2024-04-23T18:24:39.407076+0000","last_fullsized":"2024-04-23T18:24:39.407076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'256","reported_seq":276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.474582+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:27:44.474582+0000","last_peered":"2024-04-23T18:27:44.474582+0000","last_clean":"2024-04-23T18:27:44.474582+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:27:44.474582+0000","last_undegraded":"2024-04-23T18:27:44.474582+0000","last_fullsized":"2024-04-23T18:27:44.474582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.420095+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:24:39.420095+0000","last_peered":"2024-04-23T18:24:39.420095+0000","last_clean":"2024-04-23T18:24:39.420095+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:24:39.420095+0000","last_undegraded":"2024-04-23T18:24:39.420095+0000","last_fullsized":"2024-04-23T18:24:39.420095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.419002+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:24:39.419002+0000","last_peered":"2024-04-23T18:24:39.419002+0000","last_clean":"2024-04-23T18:24:39.419002+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:24:39.419002+0000","last_undegraded":"2024-04-23T18:24:39.419002+0000","last_fullsized":"2024-04-23T18:24:39.419002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'242","reported_seq":262,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.287766+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:27:44.287766+0000","last_peered":"2024-04-23T18:27:44.287766+0000","last_clean":"2024-04-23T18:27:44.287766+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:27:44.287766+0000","last_undegraded":"2024-04-23T18:27:44.287766+0000","last_fullsized":"2024-04-23T18:27:44.287766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.406487+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:24:34.406487+0000","last_peered":"2024-04-23T18:24:34.406487+0000","last_clean":"2024-04-23T18:24:34.406487+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:24:34.406487+0000","last_undegraded":"2024-04-23T18:24:34.406487+0000","last_fullsized":"2024-04-23T18:24:34.406487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:42.653567+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:27:42.653567+0000","last_peered":"2024-04-23T18:27:42.653567+0000","last_clean":"2024-04-23T18:27:42.653567+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:27:42.653567+0000","last_undegraded":"2024-04-23T18:27:42.653567+0000","last_fullsized":"2024-04-23T18:27:42.653567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'249","reported_seq":263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.344008+0000","last_change":"2024-04-23T18:23:14.730523+0000","last_active":"2024-04-23T18:27:44.344008+0000","last_peered":"2024-04-23T18:27:44.344008+0000","last_clean":"2024-04-23T18:27:44.344008+0000","last_became_active":"2024-04-23T18:23:14.729941+0000","last_became_peered":"2024-04-23T18:23:14.729941+0000","last_unstale":"2024-04-23T18:27:44.344008+0000","last_undegraded":"2024-04-23T18:27:44.344008+0000","last_fullsized":"2024-04-23T18:27:44.344008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:54.938281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405431+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:24:39.405431+0000","last_peered":"2024-04-23T18:24:39.405431+0000","last_clean":"2024-04-23T18:24:39.405431+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:24:39.405431+0000","last_undegraded":"2024-04-23T18:24:39.405431+0000","last_fullsized":"2024-04-23T18:24:39.405431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.417125+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:24:34.417125+0000","last_peered":"2024-04-23T18:24:34.417125+0000","last_clean":"2024-04-23T18:24:34.417125+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:24:34.417125+0000","last_undegraded":"2024-04-23T18:24:34.417125+0000","last_fullsized":"2024-04-23T18:24:34.417125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'311","reported_seq":331,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.503782+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:27:44.503782+0000","last_peered":"2024-04-23T18:27:44.503782+0000","last_clean":"2024-04-23T18:27:44.503782+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:27:44.503782+0000","last_undegraded":"2024-04-23T18:27:44.503782+0000","last_fullsized":"2024-04-23T18:27:44.503782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405894+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:24:39.405894+0000","last_peered":"2024-04-23T18:24:39.405894+0000","last_clean":"2024-04-23T18:24:39.405894+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:24:39.405894+0000","last_undegraded":"2024-04-23T18:24:39.405894+0000","last_fullsized":"2024-04-23T18:24:39.405894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.419025+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:24:39.419025+0000","last_peered":"2024-04-23T18:24:39.419025+0000","last_clean":"2024-04-23T18:24:39.419025+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:24:39.419025+0000","last_undegraded":"2024-04-23T18:24:39.419025+0000","last_fullsized":"2024-04-23T18:24:39.419025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:24.415086+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:24:24.415086+0000","last_peered":"2024-04-23T18:24:24.415086+0000","last_clean":"2024-04-23T18:24:24.415086+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:24:24.415086+0000","last_undegraded":"2024-04-23T18:24:24.415086+0000","last_fullsized":"2024-04-23T18:24:24.415086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'260","reported_seq":280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.376095+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:27:44.376095+0000","last_peered":"2024-04-23T18:27:44.376095+0000","last_clean":"2024-04-23T18:27:44.376095+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:27:44.376095+0000","last_undegraded":"2024-04-23T18:27:44.376095+0000","last_fullsized":"2024-04-23T18:27:44.376095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419817+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:24:49.419817+0000","last_peered":"2024-04-23T18:24:49.419817+0000","last_clean":"2024-04-23T18:24:49.419817+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:24:49.419817+0000","last_undegraded":"2024-04-23T18:24:49.419817+0000","last_fullsized":"2024-04-23T18:24:49.419817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419330+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:24:49.419330+0000","last_peered":"2024-04-23T18:24:49.419330+0000","last_clean":"2024-04-23T18:24:49.419330+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:24:49.419330+0000","last_undegraded":"2024-04-23T18:24:49.419330+0000","last_fullsized":"2024-04-23T18:24:49.419330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'274","reported_seq":294,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.428361+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:27:44.428361+0000","last_peered":"2024-04-23T18:27:44.428361+0000","last_clean":"2024-04-23T18:27:44.428361+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:27:44.428361+0000","last_undegraded":"2024-04-23T18:27:44.428361+0000","last_fullsized":"2024-04-23T18:27:44.428361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.420674+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:24:49.420674+0000","last_peered":"2024-04-23T18:24:49.420674+0000","last_clean":"2024-04-23T18:24:49.420674+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:24:49.420674+0000","last_undegraded":"2024-04-23T18:24:49.420674+0000","last_fullsized":"2024-04-23T18:24:49.420674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.408151+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:24:49.408151+0000","last_peered":"2024-04-23T18:24:49.408151+0000","last_clean":"2024-04-23T18:24:49.408151+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:24:49.408151+0000","last_undegraded":"2024-04-23T18:24:49.408151+0000","last_fullsized":"2024-04-23T18:24:49.408151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'237","reported_seq":264,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.318209+0000","last_change":"2024-04-23T18:23:14.728059+0000","last_active":"2024-04-23T18:27:44.318209+0000","last_peered":"2024-04-23T18:27:44.318209+0000","last_clean":"2024-04-23T18:27:44.318209+0000","last_became_active":"2024-04-23T18:23:14.727676+0000","last_became_peered":"2024-04-23T18:23:14.727676+0000","last_unstale":"2024-04-23T18:27:44.318209+0000","last_undegraded":"2024-04-23T18:27:44.318209+0000","last_fullsized":"2024-04-23T18:27:44.318209+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:26.449657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419886+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:24:49.419886+0000","last_peered":"2024-04-23T18:24:49.419886+0000","last_clean":"2024-04-23T18:24:49.419886+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:24:49.419886+0000","last_undegraded":"2024-04-23T18:24:49.419886+0000","last_fullsized":"2024-04-23T18:24:49.419886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419350+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:24:49.419350+0000","last_peered":"2024-04-23T18:24:49.419350+0000","last_clean":"2024-04-23T18:24:49.419350+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:24:49.419350+0000","last_undegraded":"2024-04-23T18:24:49.419350+0000","last_fullsized":"2024-04-23T18:24:49.419350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'294","reported_seq":314,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.146178+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:27:44.146178+0000","last_peered":"2024-04-23T18:27:44.146178+0000","last_clean":"2024-04-23T18:27:44.146178+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:27:44.146178+0000","last_undegraded":"2024-04-23T18:27:44.146178+0000","last_fullsized":"2024-04-23T18:27:44.146178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419863+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:24:49.419863+0000","last_peered":"2024-04-23T18:24:49.419863+0000","last_clean":"2024-04-23T18:24:49.419863+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:24:49.419863+0000","last_undegraded":"2024-04-23T18:24:49.419863+0000","last_fullsized":"2024-04-23T18:24:49.419863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:38.665933+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:25:38.665933+0000","last_peered":"2024-04-23T18:25:38.665933+0000","last_clean":"2024-04-23T18:25:38.665933+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:25:38.665933+0000","last_undegraded":"2024-04-23T18:25:38.665933+0000","last_fullsized":"2024-04-23T18:25:38.665933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'248","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.345939+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:27:44.345939+0000","last_peered":"2024-04-23T18:27:44.345939+0000","last_clean":"2024-04-23T18:27:44.345939+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:27:44.345939+0000","last_undegraded":"2024-04-23T18:27:44.345939+0000","last_fullsized":"2024-04-23T18:27:44.345939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.724850+0000","last_change":"2024-04-23T18:23:14.723945+0000","last_active":"2024-04-23T18:23:14.724850+0000","last_peered":"2024-04-23T18:23:14.724850+0000","last_clean":"2024-04-23T18:23:14.724850+0000","last_became_active":"2024-04-23T18:23:14.723676+0000","last_became_peered":"2024-04-23T18:23:14.723676+0000","last_unstale":"2024-04-23T18:23:14.724850+0000","last_undegraded":"2024-04-23T18:23:14.724850+0000","last_fullsized":"2024-04-23T18:23:14.724850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:46.330533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'15","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.419797+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:24:54.419797+0000","last_peered":"2024-04-23T18:24:54.419797+0000","last_clean":"2024-04-23T18:24:54.419797+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:24:54.419797+0000","last_undegraded":"2024-04-23T18:24:54.419797+0000","last_fullsized":"2024-04-23T18:24:54.419797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'343","reported_seq":363,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.385996+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:27:44.385996+0000","last_peered":"2024-04-23T18:27:44.385996+0000","last_clean":"2024-04-23T18:27:44.385996+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:27:44.385996+0000","last_undegraded":"2024-04-23T18:27:44.385996+0000","last_fullsized":"2024-04-23T18:27:44.385996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.446645+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:24:54.446645+0000","last_peered":"2024-04-23T18:24:54.446645+0000","last_clean":"2024-04-23T18:24:54.446645+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:24:54.446645+0000","last_undegraded":"2024-04-23T18:24:54.446645+0000","last_fullsized":"2024-04-23T18:24:54.446645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"24'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.446755+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:24:54.446755+0000","last_peered":"2024-04-23T18:24:54.446755+0000","last_clean":"2024-04-23T18:24:54.446755+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:24:54.446755+0000","last_undegraded":"2024-04-23T18:24:54.446755+0000","last_fullsized":"2024-04-23T18:24:54.446755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'253","reported_seq":273,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.450009+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:27:44.450009+0000","last_peered":"2024-04-23T18:27:44.450009+0000","last_clean":"2024-04-23T18:27:44.450009+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:27:44.450009+0000","last_undegraded":"2024-04-23T18:27:44.450009+0000","last_fullsized":"2024-04-23T18:27:44.450009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.420817+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:24:54.420817+0000","last_peered":"2024-04-23T18:24:54.420817+0000","last_clean":"2024-04-23T18:24:54.420817+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:24:54.420817+0000","last_undegraded":"2024-04-23T18:24:54.420817+0000","last_fullsized":"2024-04-23T18:24:54.420817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.422660+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:24:54.422660+0000","last_peered":"2024-04-23T18:24:54.422660+0000","last_clean":"2024-04-23T18:24:54.422660+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:24:54.422660+0000","last_undegraded":"2024-04-23T18:24:54.422660+0000","last_fullsized":"2024-04-23T18:24:54.422660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'263","reported_seq":283,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.501456+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:27:44.501456+0000","last_peered":"2024-04-23T18:27:44.501456+0000","last_clean":"2024-04-23T18:27:44.501456+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:27:44.501456+0000","last_undegraded":"2024-04-23T18:27:44.501456+0000","last_fullsized":"2024-04-23T18:27:44.501456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.407062+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:24:54.407062+0000","last_peered":"2024-04-23T18:24:54.407062+0000","last_clean":"2024-04-23T18:24:54.407062+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:24:54.407062+0000","last_undegraded":"2024-04-23T18:24:54.407062+0000","last_fullsized":"2024-04-23T18:24:54.407062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'6","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.407101+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:24:54.407101+0000","last_peered":"2024-04-23T18:24:54.407101+0000","last_clean":"2024-04-23T18:24:54.407101+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:24:54.407101+0000","last_undegraded":"2024-04-23T18:24:54.407101+0000","last_fullsized":"2024-04-23T18:24:54.407101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'296","reported_seq":316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.458363+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:27:44.458363+0000","last_peered":"2024-04-23T18:27:44.458363+0000","last_clean":"2024-04-23T18:27:44.458363+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:27:44.458363+0000","last_undegraded":"2024-04-23T18:27:44.458363+0000","last_fullsized":"2024-04-23T18:27:44.458363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":285,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429156+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:24:59.429156+0000","last_peered":"2024-04-23T18:24:59.429156+0000","last_clean":"2024-04-23T18:24:59.429156+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:24:59.429156+0000","last_undegraded":"2024-04-23T18:24:59.429156+0000","last_fullsized":"2024-04-23T18:24:59.429156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'1978","reported_seq":2006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:38.322471+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:27:38.322471+0000","last_peered":"2024-04-23T18:27:38.322471+0000","last_clean":"2024-04-23T18:27:38.322471+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:27:38.322471+0000","last_undegraded":"2024-04-23T18:27:38.322471+0000","last_fullsized":"2024-04-23T18:27:38.322471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1978,"log_dups_size":0,"ondisk_log_size":1978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3963283,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1978,"num_write_kb":4064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'273","reported_seq":286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.447236+0000","last_change":"2024-04-23T18:23:14.730758+0000","last_active":"2024-04-23T18:27:44.447236+0000","last_peered":"2024-04-23T18:27:44.447236+0000","last_clean":"2024-04-23T18:27:44.447236+0000","last_became_active":"2024-04-23T18:23:14.729264+0000","last_became_peered":"2024-04-23T18:23:14.729264+0000","last_unstale":"2024-04-23T18:27:44.447236+0000","last_undegraded":"2024-04-23T18:27:44.447236+0000","last_fullsized":"2024-04-23T18:27:44.447236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:25:09.741395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.424986+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:24:54.424986+0000","last_peered":"2024-04-23T18:24:54.424986+0000","last_clean":"2024-04-23T18:24:54.424986+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:24:54.424986+0000","last_undegraded":"2024-04-23T18:24:54.424986+0000","last_fullsized":"2024-04-23T18:24:54.424986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'7","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:17.563123+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:25:17.563123+0000","last_peered":"2024-04-23T18:25:17.563123+0000","last_clean":"2024-04-23T18:25:17.563123+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:25:17.563123+0000","last_undegraded":"2024-04-23T18:25:17.563123+0000","last_fullsized":"2024-04-23T18:25:17.563123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'287","reported_seq":307,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.411127+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:27:44.411127+0000","last_peered":"2024-04-23T18:27:44.411127+0000","last_clean":"2024-04-23T18:27:44.411127+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:27:44.411127+0000","last_undegraded":"2024-04-23T18:27:44.411127+0000","last_fullsized":"2024-04-23T18:27:44.411127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.407567+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:24:59.407567+0000","last_peered":"2024-04-23T18:24:59.407567+0000","last_clean":"2024-04-23T18:24:59.407567+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:24:59.407567+0000","last_undegraded":"2024-04-23T18:24:59.407567+0000","last_fullsized":"2024-04-23T18:24:59.407567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429662+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:24:59.429662+0000","last_peered":"2024-04-23T18:24:59.429662+0000","last_clean":"2024-04-23T18:24:59.429662+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:24:59.429662+0000","last_undegraded":"2024-04-23T18:24:59.429662+0000","last_fullsized":"2024-04-23T18:24:59.429662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'292","reported_seq":312,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.376633+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:27:44.376633+0000","last_peered":"2024-04-23T18:27:44.376633+0000","last_clean":"2024-04-23T18:27:44.376633+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:27:44.376633+0000","last_undegraded":"2024-04-23T18:27:44.376633+0000","last_fullsized":"2024-04-23T18:27:44.376633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429648+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:24:59.429648+0000","last_peered":"2024-04-23T18:24:59.429648+0000","last_clean":"2024-04-23T18:24:59.429648+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:24:59.429648+0000","last_undegraded":"2024-04-23T18:24:59.429648+0000","last_fullsized":"2024-04-23T18:24:59.429648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.448017+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:24:59.448017+0000","last_peered":"2024-04-23T18:24:59.448017+0000","last_clean":"2024-04-23T18:24:59.448017+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:24:59.448017+0000","last_undegraded":"2024-04-23T18:24:59.448017+0000","last_fullsized":"2024-04-23T18:24:59.448017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'309","reported_seq":329,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.524017+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:27:44.524017+0000","last_peered":"2024-04-23T18:27:44.524017+0000","last_clean":"2024-04-23T18:27:44.524017+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:27:44.524017+0000","last_undegraded":"2024-04-23T18:27:44.524017+0000","last_fullsized":"2024-04-23T18:27:44.524017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'251","reported_seq":271,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.423077+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:27:44.423077+0000","last_peered":"2024-04-23T18:27:44.423077+0000","last_clean":"2024-04-23T18:27:44.423077+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:27:44.423077+0000","last_undegraded":"2024-04-23T18:27:44.423077+0000","last_fullsized":"2024-04-23T18:27:44.423077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:24.567862+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:27:24.567862+0000","last_peered":"2024-04-23T18:27:24.567862+0000","last_clean":"2024-04-23T18:27:24.567862+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:27:24.567862+0000","last_undegraded":"2024-04-23T18:27:24.567862+0000","last_fullsized":"2024-04-23T18:27:24.567862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429581+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:24:59.429581+0000","last_peered":"2024-04-23T18:24:59.429581+0000","last_clean":"2024-04-23T18:24:59.429581+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:24:59.429581+0000","last_undegraded":"2024-04-23T18:24:59.429581+0000","last_fullsized":"2024-04-23T18:24:59.429581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'245","reported_seq":265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.436308+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:27:44.436308+0000","last_peered":"2024-04-23T18:27:44.436308+0000","last_clean":"2024-04-23T18:27:44.436308+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:27:44.436308+0000","last_undegraded":"2024-04-23T18:27:44.436308+0000","last_fullsized":"2024-04-23T18:27:44.436308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.426807+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:24:59.426807+0000","last_peered":"2024-04-23T18:24:59.426807+0000","last_clean":"2024-04-23T18:24:59.426807+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:24:59.426807+0000","last_undegraded":"2024-04-23T18:24:59.426807+0000","last_fullsized":"2024-04-23T18:24:59.426807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.426852+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:24:59.426852+0000","last_peered":"2024-04-23T18:24:59.426852+0000","last_clean":"2024-04-23T18:24:59.426852+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:24:59.426852+0000","last_undegraded":"2024-04-23T18:24:59.426852+0000","last_fullsized":"2024-04-23T18:24:59.426852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.448866+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:25:04.448866+0000","last_peered":"2024-04-23T18:25:04.448866+0000","last_clean":"2024-04-23T18:25:04.448866+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:25:04.448866+0000","last_undegraded":"2024-04-23T18:25:04.448866+0000","last_fullsized":"2024-04-23T18:25:04.448866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.408050+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:25:04.408050+0000","last_peered":"2024-04-23T18:25:04.408050+0000","last_clean":"2024-04-23T18:25:04.408050+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:25:04.408050+0000","last_undegraded":"2024-04-23T18:25:04.408050+0000","last_fullsized":"2024-04-23T18:25:04.408050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'276","reported_seq":296,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.482439+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:27:44.482439+0000","last_peered":"2024-04-23T18:27:44.482439+0000","last_clean":"2024-04-23T18:27:44.482439+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:27:44.482439+0000","last_undegraded":"2024-04-23T18:27:44.482439+0000","last_fullsized":"2024-04-23T18:27:44.482439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.427467+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:25:04.427467+0000","last_peered":"2024-04-23T18:25:04.427467+0000","last_clean":"2024-04-23T18:25:04.427467+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:25:04.427467+0000","last_undegraded":"2024-04-23T18:25:04.427467+0000","last_fullsized":"2024-04-23T18:25:04.427467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.426743+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:25:04.426743+0000","last_peered":"2024-04-23T18:25:04.426743+0000","last_clean":"2024-04-23T18:25:04.426743+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:25:04.426743+0000","last_undegraded":"2024-04-23T18:25:04.426743+0000","last_fullsized":"2024-04-23T18:25:04.426743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'292","reported_seq":312,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.526792+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:27:44.526792+0000","last_peered":"2024-04-23T18:27:44.526792+0000","last_clean":"2024-04-23T18:27:44.526792+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:27:44.526792+0000","last_undegraded":"2024-04-23T18:27:44.526792+0000","last_fullsized":"2024-04-23T18:27:44.526792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.443391+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:24:39.443391+0000","last_peered":"2024-04-23T18:24:39.443391+0000","last_clean":"2024-04-23T18:24:39.443391+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:24:39.443391+0000","last_undegraded":"2024-04-23T18:24:39.443391+0000","last_fullsized":"2024-04-23T18:24:39.443391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418207+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:24:39.418207+0000","last_peered":"2024-04-23T18:24:39.418207+0000","last_clean":"2024-04-23T18:24:39.418207+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:24:39.418207+0000","last_undegraded":"2024-04-23T18:24:39.418207+0000","last_fullsized":"2024-04-23T18:24:39.418207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418960+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:24:39.418960+0000","last_peered":"2024-04-23T18:24:39.418960+0000","last_clean":"2024-04-23T18:24:39.418960+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:24:39.418960+0000","last_undegraded":"2024-04-23T18:24:39.418960+0000","last_fullsized":"2024-04-23T18:24:39.418960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405460+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:24:39.405460+0000","last_peered":"2024-04-23T18:24:39.405460+0000","last_clean":"2024-04-23T18:24:39.405460+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:24:39.405460+0000","last_undegraded":"2024-04-23T18:24:39.405460+0000","last_fullsized":"2024-04-23T18:24:39.405460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406352+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:24:44.406352+0000","last_peered":"2024-04-23T18:24:44.406352+0000","last_clean":"2024-04-23T18:24:44.406352+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:24:44.406352+0000","last_undegraded":"2024-04-23T18:24:44.406352+0000","last_fullsized":"2024-04-23T18:24:44.406352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.407689+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:24:44.407689+0000","last_peered":"2024-04-23T18:24:44.407689+0000","last_clean":"2024-04-23T18:24:44.407689+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:24:44.407689+0000","last_undegraded":"2024-04-23T18:24:44.407689+0000","last_fullsized":"2024-04-23T18:24:44.407689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.444383+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:24:44.444383+0000","last_peered":"2024-04-23T18:24:44.444383+0000","last_clean":"2024-04-23T18:24:44.444383+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:24:44.444383+0000","last_undegraded":"2024-04-23T18:24:44.444383+0000","last_fullsized":"2024-04-23T18:24:44.444383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406374+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:24:44.406374+0000","last_peered":"2024-04-23T18:24:44.406374+0000","last_clean":"2024-04-23T18:24:44.406374+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:24:44.406374+0000","last_undegraded":"2024-04-23T18:24:44.406374+0000","last_fullsized":"2024-04-23T18:24:44.406374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.419755+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:24:44.419755+0000","last_peered":"2024-04-23T18:24:44.419755+0000","last_clean":"2024-04-23T18:24:44.419755+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:24:44.419755+0000","last_undegraded":"2024-04-23T18:24:44.419755+0000","last_fullsized":"2024-04-23T18:24:44.419755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.406806+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:24:49.406806+0000","last_peered":"2024-04-23T18:24:49.406806+0000","last_clean":"2024-04-23T18:24:49.406806+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:24:49.406806+0000","last_undegraded":"2024-04-23T18:24:49.406806+0000","last_fullsized":"2024-04-23T18:24:49.406806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:29.426186+0000","last_change":"2024-04-23T18:23:14.787713+0000","last_active":"2024-04-23T18:25:29.426186+0000","last_peered":"2024-04-23T18:25:29.426186+0000","last_clean":"2024-04-23T18:25:29.426186+0000","last_became_active":"2024-04-23T18:23:14.787340+0000","last_became_peered":"2024-04-23T18:23:14.787340+0000","last_unstale":"2024-04-23T18:25:29.426186+0000","last_undegraded":"2024-04-23T18:25:29.426186+0000","last_fullsized":"2024-04-23T18:25:29.426186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:44:54.939264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.406496+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:24:49.406496+0000","last_peered":"2024-04-23T18:24:49.406496+0000","last_clean":"2024-04-23T18:24:49.406496+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:24:49.406496+0000","last_undegraded":"2024-04-23T18:24:49.406496+0000","last_fullsized":"2024-04-23T18:24:49.406496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.445374+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:24:49.445374+0000","last_peered":"2024-04-23T18:24:49.445374+0000","last_clean":"2024-04-23T18:24:49.445374+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:24:49.445374+0000","last_undegraded":"2024-04-23T18:24:49.445374+0000","last_fullsized":"2024-04-23T18:24:49.445374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419840+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:24:49.419840+0000","last_peered":"2024-04-23T18:24:49.419840+0000","last_clean":"2024-04-23T18:24:49.419840+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:24:49.419840+0000","last_undegraded":"2024-04-23T18:24:49.419840+0000","last_fullsized":"2024-04-23T18:24:49.419840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.419872+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:24:54.419872+0000","last_peered":"2024-04-23T18:24:54.419872+0000","last_clean":"2024-04-23T18:24:54.419872+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:24:54.419872+0000","last_undegraded":"2024-04-23T18:24:54.419872+0000","last_fullsized":"2024-04-23T18:24:54.419872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.422820+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:24:54.422820+0000","last_peered":"2024-04-23T18:24:54.422820+0000","last_clean":"2024-04-23T18:24:54.422820+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:24:54.422820+0000","last_undegraded":"2024-04-23T18:24:54.422820+0000","last_fullsized":"2024-04-23T18:24:54.422820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.422415+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:24:54.422415+0000","last_peered":"2024-04-23T18:24:54.422415+0000","last_clean":"2024-04-23T18:24:54.422415+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:24:54.422415+0000","last_undegraded":"2024-04-23T18:24:54.422415+0000","last_fullsized":"2024-04-23T18:24:54.422415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.408573+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:24:54.408573+0000","last_peered":"2024-04-23T18:24:54.408573+0000","last_clean":"2024-04-23T18:24:54.408573+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:24:54.408573+0000","last_undegraded":"2024-04-23T18:24:54.408573+0000","last_fullsized":"2024-04-23T18:24:54.408573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.407037+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:24:54.407037+0000","last_peered":"2024-04-23T18:24:54.407037+0000","last_clean":"2024-04-23T18:24:54.407037+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:24:54.407037+0000","last_undegraded":"2024-04-23T18:24:54.407037+0000","last_fullsized":"2024-04-23T18:24:54.407037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.426862+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:24:59.426862+0000","last_peered":"2024-04-23T18:24:59.426862+0000","last_clean":"2024-04-23T18:24:59.426862+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:24:59.426862+0000","last_undegraded":"2024-04-23T18:24:59.426862+0000","last_fullsized":"2024-04-23T18:24:59.426862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.425933+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:24:59.425933+0000","last_peered":"2024-04-23T18:24:59.425933+0000","last_clean":"2024-04-23T18:24:59.425933+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:24:59.425933+0000","last_undegraded":"2024-04-23T18:24:59.425933+0000","last_fullsized":"2024-04-23T18:24:59.425933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.447843+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:24:59.447843+0000","last_peered":"2024-04-23T18:24:59.447843+0000","last_clean":"2024-04-23T18:24:59.447843+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:24:59.447843+0000","last_undegraded":"2024-04-23T18:24:59.447843+0000","last_fullsized":"2024-04-23T18:24:59.447843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:16.546558+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:25:16.546558+0000","last_peered":"2024-04-23T18:25:16.546558+0000","last_clean":"2024-04-23T18:25:16.546558+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:25:16.546558+0000","last_undegraded":"2024-04-23T18:25:16.546558+0000","last_fullsized":"2024-04-23T18:25:16.546558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429208+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:24:59.429208+0000","last_peered":"2024-04-23T18:24:59.429208+0000","last_clean":"2024-04-23T18:24:59.429208+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:24:59.429208+0000","last_undegraded":"2024-04-23T18:24:59.429208+0000","last_fullsized":"2024-04-23T18:24:59.429208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.427357+0000","last_change":"2024-04-23T18:23:14.787765+0000","last_active":"2024-04-23T18:25:04.427357+0000","last_peered":"2024-04-23T18:25:04.427357+0000","last_clean":"2024-04-23T18:25:04.427357+0000","last_became_active":"2024-04-23T18:23:14.787444+0000","last_became_peered":"2024-04-23T18:23:14.787444+0000","last_unstale":"2024-04-23T18:25:04.427357+0000","last_undegraded":"2024-04-23T18:25:04.427357+0000","last_fullsized":"2024-04-23T18:25:04.427357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:12.714842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.429969+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:25:04.429969+0000","last_peered":"2024-04-23T18:25:04.429969+0000","last_clean":"2024-04-23T18:25:04.429969+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:25:04.429969+0000","last_undegraded":"2024-04-23T18:25:04.429969+0000","last_fullsized":"2024-04-23T18:25:04.429969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430478+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:25:04.430478+0000","last_peered":"2024-04-23T18:25:04.430478+0000","last_clean":"2024-04-23T18:25:04.430478+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:25:04.430478+0000","last_undegraded":"2024-04-23T18:25:04.430478+0000","last_fullsized":"2024-04-23T18:25:04.430478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430005+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:25:04.430005+0000","last_peered":"2024-04-23T18:25:04.430005+0000","last_clean":"2024-04-23T18:25:04.430005+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:25:04.430005+0000","last_undegraded":"2024-04-23T18:25:04.430005+0000","last_fullsized":"2024-04-23T18:25:04.430005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.418134+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:24:34.418134+0000","last_peered":"2024-04-23T18:24:34.418134+0000","last_clean":"2024-04-23T18:24:34.418134+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:24:34.418134+0000","last_undegraded":"2024-04-23T18:24:34.418134+0000","last_fullsized":"2024-04-23T18:24:34.418134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405476+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:24:39.405476+0000","last_peered":"2024-04-23T18:24:39.405476+0000","last_clean":"2024-04-23T18:24:39.405476+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:24:39.405476+0000","last_undegraded":"2024-04-23T18:24:39.405476+0000","last_fullsized":"2024-04-23T18:24:39.405476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.407088+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:24:39.407088+0000","last_peered":"2024-04-23T18:24:39.407088+0000","last_clean":"2024-04-23T18:24:39.407088+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:24:39.407088+0000","last_undegraded":"2024-04-23T18:24:39.407088+0000","last_fullsized":"2024-04-23T18:24:39.407088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418110+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:24:39.418110+0000","last_peered":"2024-04-23T18:24:39.418110+0000","last_clean":"2024-04-23T18:24:39.418110+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:24:39.418110+0000","last_undegraded":"2024-04-23T18:24:39.418110+0000","last_fullsized":"2024-04-23T18:24:39.418110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":4492099584,"num_objects":1071,"num_object_clones":0,"num_object_copies":4284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1071,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8145,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8984199168,"data_stored":8984199168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8660,"ondisk_log_size":8660,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3967478,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2143,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8093696,"data_stored":7934956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2112,"ondisk_log_size":2112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1293360,"kb_used_data":1233768,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":93078480,"statfs":{"total":96636764160,"available":95312363520,"internally_reserved":0,"allocated":1263378432,"data_stored":1263191549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1566468,"kb_used_data":1495100,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":92805372,"statfs":{"total":96636764160,"available":95032700928,"internally_reserved":0,"allocated":1530982400,"data_stored":1530800291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1343916,"kb_used_data":1290532,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":93027924,"statfs":{"total":96636764160,"available":95260594176,"internally_reserved":0,"allocated":1321504768,"data_stored":1321321499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1481192,"kb_used_data":1423648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":92890648,"statfs":{"total":96636764160,"available":95120023552,"internally_reserved":0,"allocated":1457815552,"data_stored":1457635973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693516,"kb_used_data":1617988,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":92678324,"statfs":{"total":96636764160,"available":94902603776,"internally_reserved":0,"allocated":1656819712,"data_stored":1656629514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77330887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1167792,"kb_used_data":1114408,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":93204048,"statfs":{"total":96636764160,"available":95440945152,"internally_reserved":0,"allocated":1141153792,"data_stored":1140966194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1660848,"kb_used_data":1589544,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":92710992,"statfs":{"total":96636764160,"available":94936055808,"internally_reserved":0,"allocated":1627693056,"data_stored":1627505257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1537068,"kb_used_data":1471332,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":92834772,"statfs":{"total":96636764160,"available":95062806528,"internally_reserved":0,"allocated":1506643968,"data_stored":1506460525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3989504,"data_stored":3964322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3981312,"data_stored":3964219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":966787072,"data_stored":966787072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1400897536,"data_stored":1400897536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":882900992,"data_stored":882900992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1468006400,"data_stored":1468006400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1119879168,"data_stored":1119879168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":950009856,"data_stored":950009856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1186988032,"data_stored":1186988032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1008730112,"data_stored":1008730112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:27:49.943 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T18:27:49.944 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:27:50.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f5342400640 1 Processor -- start 2024-04-23T18:27:50.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f5342400640 1 -- start start 2024-04-23T18:27:50.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f5342400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c1444e0 0x7f533c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:50.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f5342400640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c15b650 con 0x7f533c0c91e0 2024-04-23T18:27:50.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f5342400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c15b930 con 0x7f533c06c3f0 2024-04-23T18:27:50.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f5342400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f533c15bc10 con 0x7f533c1444e0 2024-04-23T18:27:50.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f5332a00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f533c0c91e0 0x7f533c072dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33596/0 (socket says 172.21.15.28:33596) 2024-04-23T18:27:50.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f5332a00640 1 -- 172.21.15.28:0/2532459742 learned_addr learned my addr 172.21.15.28:0/2532459742 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:50.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f533b400640 1 --2- 172.21.15.28:0/2532459742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c1444e0 0x7f533c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:50.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f533aa00640 1 -- 172.21.15.28:0/2532459742 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3060751721 0 0) 0x7f533c15b650 con 0x7f533c0c91e0 2024-04-23T18:27:50.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f533aa00640 1 -- 172.21.15.28:0/2532459742 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5320003530 con 0x7f533c0c91e0 2024-04-23T18:27:50.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f533b400640 1 -- 172.21.15.28:0/2532459742 >> v1:172.21.15.137:6789/0 conn(0x7f533c06c3f0 legacy=0x7f533c15ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f533b400640 1 -- 172.21.15.28:0/2532459742 >> v1:172.21.15.28:6789/0 conn(0x7f533c0c91e0 legacy=0x7f533c072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.133+0000 7f533b400640 1 -- 172.21.15.28:0/2532459742 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c15bef0 con 0x7f533c1444e0 2024-04-23T18:27:50.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.137+0000 7f533b400640 1 --2- 172.21.15.28:0/2532459742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c1444e0 0x7f533c0710e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f532c0097f0 tx=0x7f532c01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d660b0f9744641 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:50.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.137+0000 7f533aa00640 1 -- 172.21.15.28:0/2532459742 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c0b5070 con 0x7f533c1444e0 2024-04-23T18:27:50.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.137+0000 7f533aa00640 1 -- 172.21.15.28:0/2532459742 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c0a89d0 con 0x7f533c1444e0 2024-04-23T18:27:50.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.137+0000 7f533aa00640 1 -- 172.21.15.28:0/2532459742 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c0a8d80 con 0x7f533c1444e0 2024-04-23T18:27:50.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.137+0000 7f5342400640 1 -- 172.21.15.28:0/2532459742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c1444e0 msgr2=0x7f533c0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.137+0000 7f5342400640 1 --2- 172.21.15.28:0/2532459742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c1444e0 0x7f533c0710e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f532c0097f0 tx=0x7f532c01ecd0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.137+0000 7f5342400640 1 -- 172.21.15.28:0/2532459742 shutdown_connections 2024-04-23T18:27:50.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.137+0000 7f5342400640 1 --2- 172.21.15.28:0/2532459742 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c1444e0 0x7f533c0710e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.137+0000 7f5342400640 1 -- 172.21.15.28:0/2532459742 >> 172.21.15.28:0/2532459742 conn(0x7f533c0676e0 msgr2=0x7f533c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:50.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.137+0000 7f5342400640 1 -- 172.21.15.28:0/2532459742 shutdown_connections 2024-04-23T18:27:50.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.137+0000 7f5342400640 1 -- 172.21.15.28:0/2532459742 wait complete. 2024-04-23T18:27:50.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5342400640 1 Processor -- start 2024-04-23T18:27:50.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5342400640 1 -- start start 2024-04-23T18:27:50.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5342400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c06c3f0 0x7f533c13b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:50.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5342400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f533c0c91e0 0x7f533c0c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:50.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5342400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c1444e0 0x7f533c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:50.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5342400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f533c1448c0 con 0x7f533c0c91e0 2024-04-23T18:27:50.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5342400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f533c15b300 con 0x7f533c06c3f0 2024-04-23T18:27:50.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5342400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f533c144a40 con 0x7f533c1444e0 2024-04-23T18:27:50.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5332a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f533c0c91e0 0x7f533c0c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5332a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f533c0c91e0 0x7f533c0c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33174/0 (socket says 172.21.15.28:33174) 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5332a00640 1 -- 172.21.15.28:0/3792947452 learned_addr learned my addr 172.21.15.28:0/3792947452 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f533be00640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c1444e0 0x7f533c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f533b400640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c06c3f0 0x7f533c13b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5332a00640 1 -- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c1444e0 msgr2=0x7f533c159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5332a00640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c1444e0 0x7f533c159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5332a00640 1 -- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c06c3f0 msgr2=0x7f533c13b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5332a00640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c06c3f0 0x7f533c13b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5332a00640 1 -- 172.21.15.28:0/3792947452 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c1f0f20 con 0x7f533c0c91e0 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5332a00640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f533c0c91e0 0x7f533c0c6e50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5324001ec0 tx=0x7f532400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5333e00640 1 -- 172.21.15.28:0/3792947452 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324017070 con 0x7f533c0c91e0 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5333e00640 1 -- 172.21.15.28:0/3792947452 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5324005d50 con 0x7f533c0c91e0 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5342400640 1 -- 172.21.15.28:0/3792947452 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533c1f1200 con 0x7f533c0c91e0 2024-04-23T18:27:50.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5333e00640 1 -- 172.21.15.28:0/3792947452 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324007270 con 0x7f533c0c91e0 2024-04-23T18:27:50.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.141+0000 7f5342400640 1 -- 172.21.15.28:0/3792947452 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533c0c8bb0 con 0x7f533c0c91e0 2024-04-23T18:27:50.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.145+0000 7f5342400640 1 -- 172.21.15.28:0/3792947452 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533c068cd0 con 0x7f533c0c91e0 2024-04-23T18:27:50.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.145+0000 7f5333e00640 1 -- 172.21.15.28:0/3792947452 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f532401a070 con 0x7f533c0c91e0 2024-04-23T18:27:50.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.145+0000 7f5333e00640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5318068380 0x7f531806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:50.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.145+0000 7f5333e00640 1 -- 172.21.15.28:0/3792947452 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f53240860d0 con 0x7f533c0c91e0 2024-04-23T18:27:50.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.145+0000 7f533b400640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5318068380 0x7f531806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:50.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.145+0000 7f533b400640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5318068380 0x7f531806a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f532c0b2000 tx=0x7f532c0aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:50.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.149+0000 7f5333e00640 1 -- 172.21.15.28:0/3792947452 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5324055cf0 con 0x7f533c0c91e0 2024-04-23T18:27:50.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.309+0000 7f5342400640 1 -- 172.21.15.28:0/3792947452 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f533c0ccab0 con 0x7f5318068380 2024-04-23T18:27:50.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.333+0000 7f5333e00640 1 -- 172.21.15.28:0/3792947452 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334004 (secure 0 0 0) 0x7f533c0ccab0 con 0x7f5318068380 2024-04-23T18:27:50.332 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:27:50.335 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 -- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5318068380 msgr2=0x7f531806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5318068380 0x7f531806a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f532c0b2000 tx=0x7f532c0aa070 comp rx=0 tx=0).stop 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 -- 172.21.15.28:0/3792947452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f533c0c91e0 msgr2=0x7f533c0c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f533c0c91e0 0x7f533c0c6e50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5324001ec0 tx=0x7f532400c960 comp rx=0 tx=0).stop 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 -- 172.21.15.28:0/3792947452 shutdown_connections 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5318068380 0x7f531806a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c1444e0 0x7f533c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f533c0c91e0 0x7f533c0c6e50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 --2- 172.21.15.28:0/3792947452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c06c3f0 0x7f533c13b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 -- 172.21.15.28:0/3792947452 >> 172.21.15.28:0/3792947452 conn(0x7f533c0676e0 msgr2=0x7f533c072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 -- 172.21.15.28:0/3792947452 shutdown_connections 2024-04-23T18:27:50.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.337+0000 7f5342400640 1 -- 172.21.15.28:0/3792947452 wait complete. 2024-04-23T18:27:50.352 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-04-23T18:27:49.442543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4496657430,"num_objects":1134,"num_object_clones":0,"num_object_copies":4410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1134,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":10447,"num_write_kb":25172361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10892,"ondisk_log_size":10892,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":11744160,"kb_used_data":11236320,"kb_used_omap":12,"kb_used_meta":493427,"kb_avail":743230560,"statfs":{"total":773094113280,"available":761068093440,"internally_reserved":0,"allocated":11505991680,"data_stored":11504510802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":505269808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6245308358,"num_objects":-1489,"num_object_clones":0,"num_object_copies":-5956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1489,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1500,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003718"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405510+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:24:39.405510+0000","last_peered":"2024-04-23T18:24:39.405510+0000","last_clean":"2024-04-23T18:24:39.405510+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:24:39.405510+0000","last_undegraded":"2024-04-23T18:24:39.405510+0000","last_fullsized":"2024-04-23T18:24:39.405510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:14.404517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:14.421976+0000","last_change":"2024-04-23T18:23:14.723733+0000","last_active":"2024-04-23T18:25:14.421976+0000","last_peered":"2024-04-23T18:25:14.421976+0000","last_clean":"2024-04-23T18:25:14.421976+0000","last_became_active":"2024-04-23T18:23:14.723423+0000","last_became_peered":"2024-04-23T18:23:14.723423+0000","last_unstale":"2024-04-23T18:25:14.421976+0000","last_undegraded":"2024-04-23T18:25:14.421976+0000","last_fullsized":"2024-04-23T18:25:14.421976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:28:08.520812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"26'301","reported_seq":321,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.517469+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:27:44.517469+0000","last_peered":"2024-04-23T18:27:44.517469+0000","last_clean":"2024-04-23T18:27:44.517469+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:27:44.517469+0000","last_undegraded":"2024-04-23T18:27:44.517469+0000","last_fullsized":"2024-04-23T18:27:44.517469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:42.882797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.405371+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:24:34.405371+0000","last_peered":"2024-04-23T18:24:34.405371+0000","last_clean":"2024-04-23T18:24:34.405371+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:24:34.405371+0000","last_undegraded":"2024-04-23T18:24:34.405371+0000","last_fullsized":"2024-04-23T18:24:34.405371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:43.882822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405499+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:24:39.405499+0000","last_peered":"2024-04-23T18:24:39.405499+0000","last_clean":"2024-04-23T18:24:39.405499+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:24:39.405499+0000","last_undegraded":"2024-04-23T18:24:39.405499+0000","last_fullsized":"2024-04-23T18:24:39.405499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:49.808162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'313","reported_seq":333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.332874+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:27:44.332874+0000","last_peered":"2024-04-23T18:27:44.332874+0000","last_clean":"2024-04-23T18:27:44.332874+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:27:44.332874+0000","last_undegraded":"2024-04-23T18:27:44.332874+0000","last_fullsized":"2024-04-23T18:27:44.332874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430064+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:25:04.430064+0000","last_peered":"2024-04-23T18:25:04.430064+0000","last_clean":"2024-04-23T18:25:04.430064+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:25:04.430064+0000","last_undegraded":"2024-04-23T18:25:04.430064+0000","last_fullsized":"2024-04-23T18:25:04.430064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430562+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:25:04.430562+0000","last_peered":"2024-04-23T18:25:04.430562+0000","last_clean":"2024-04-23T18:25:04.430562+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:25:04.430562+0000","last_undegraded":"2024-04-23T18:25:04.430562+0000","last_fullsized":"2024-04-23T18:25:04.430562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'255","reported_seq":275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.364905+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:27:44.364905+0000","last_peered":"2024-04-23T18:27:44.364905+0000","last_clean":"2024-04-23T18:27:44.364905+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:27:44.364905+0000","last_undegraded":"2024-04-23T18:27:44.364905+0000","last_fullsized":"2024-04-23T18:27:44.364905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430032+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:25:04.430032+0000","last_peered":"2024-04-23T18:25:04.430032+0000","last_clean":"2024-04-23T18:25:04.430032+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:25:04.430032+0000","last_undegraded":"2024-04-23T18:25:04.430032+0000","last_fullsized":"2024-04-23T18:25:04.430032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430641+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:25:04.430641+0000","last_peered":"2024-04-23T18:25:04.430641+0000","last_clean":"2024-04-23T18:25:04.430641+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:25:04.430641+0000","last_undegraded":"2024-04-23T18:25:04.430641+0000","last_fullsized":"2024-04-23T18:25:04.430641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'241","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.277499+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:27:44.277499+0000","last_peered":"2024-04-23T18:27:44.277499+0000","last_clean":"2024-04-23T18:27:44.277499+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:27:44.277499+0000","last_undegraded":"2024-04-23T18:27:44.277499+0000","last_fullsized":"2024-04-23T18:27:44.277499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.444237+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:24:44.444237+0000","last_peered":"2024-04-23T18:24:44.444237+0000","last_clean":"2024-04-23T18:24:44.444237+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:24:44.444237+0000","last_undegraded":"2024-04-23T18:24:44.444237+0000","last_fullsized":"2024-04-23T18:24:44.444237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:51.515161+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:24:51.515161+0000","last_peered":"2024-04-23T18:24:51.515161+0000","last_clean":"2024-04-23T18:24:51.515161+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:24:51.515161+0000","last_undegraded":"2024-04-23T18:24:51.515161+0000","last_fullsized":"2024-04-23T18:24:51.515161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'299","reported_seq":319,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.413866+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:27:44.413866+0000","last_peered":"2024-04-23T18:27:44.413866+0000","last_clean":"2024-04-23T18:27:44.413866+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:27:44.413866+0000","last_undegraded":"2024-04-23T18:27:44.413866+0000","last_fullsized":"2024-04-23T18:27:44.413866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.406830+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:24:49.406830+0000","last_peered":"2024-04-23T18:24:49.406830+0000","last_clean":"2024-04-23T18:24:49.406830+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:24:49.406830+0000","last_undegraded":"2024-04-23T18:24:49.406830+0000","last_fullsized":"2024-04-23T18:24:49.406830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:53.410798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.407650+0000","last_change":"2024-04-23T18:22:32.370983+0000","last_active":"2024-04-23T18:24:44.407650+0000","last_peered":"2024-04-23T18:24:44.407650+0000","last_clean":"2024-04-23T18:24:44.407650+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:24:44.407650+0000","last_undegraded":"2024-04-23T18:24:44.407650+0000","last_fullsized":"2024-04-23T18:24:44.407650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:56:41.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'264","reported_seq":284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.429376+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:27:44.429376+0000","last_peered":"2024-04-23T18:27:44.429376+0000","last_clean":"2024-04-23T18:27:44.429376+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:27:44.429376+0000","last_undegraded":"2024-04-23T18:27:44.429376+0000","last_fullsized":"2024-04-23T18:27:44.429376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406308+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:24:44.406308+0000","last_peered":"2024-04-23T18:24:44.406308+0000","last_clean":"2024-04-23T18:24:44.406308+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:24:44.406308+0000","last_undegraded":"2024-04-23T18:24:44.406308+0000","last_fullsized":"2024-04-23T18:24:44.406308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:23.883659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.407620+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:24:44.407620+0000","last_peered":"2024-04-23T18:24:44.407620+0000","last_clean":"2024-04-23T18:24:44.407620+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:24:44.407620+0000","last_undegraded":"2024-04-23T18:24:44.407620+0000","last_fullsized":"2024-04-23T18:24:44.407620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:55.698581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'250","reported_seq":270,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.484987+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:27:44.484987+0000","last_peered":"2024-04-23T18:27:44.484987+0000","last_clean":"2024-04-23T18:27:44.484987+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:27:44.484987+0000","last_undegraded":"2024-04-23T18:27:44.484987+0000","last_fullsized":"2024-04-23T18:27:44.484987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:39.417389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.420863+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:24:44.420863+0000","last_peered":"2024-04-23T18:24:44.420863+0000","last_clean":"2024-04-23T18:24:44.420863+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:24:44.420863+0000","last_undegraded":"2024-04-23T18:24:44.420863+0000","last_fullsized":"2024-04-23T18:24:44.420863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.418867+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:24:44.418867+0000","last_peered":"2024-04-23T18:24:44.418867+0000","last_clean":"2024-04-23T18:24:44.418867+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:24:44.418867+0000","last_undegraded":"2024-04-23T18:24:44.418867+0000","last_fullsized":"2024-04-23T18:24:44.418867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'258","reported_seq":278,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.391005+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:27:44.391005+0000","last_peered":"2024-04-23T18:27:44.391005+0000","last_clean":"2024-04-23T18:27:44.391005+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:27:44.391005+0000","last_undegraded":"2024-04-23T18:27:44.391005+0000","last_fullsized":"2024-04-23T18:27:44.391005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406022+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:24:44.406022+0000","last_peered":"2024-04-23T18:24:44.406022+0000","last_clean":"2024-04-23T18:24:44.406022+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:24:44.406022+0000","last_undegraded":"2024-04-23T18:24:44.406022+0000","last_fullsized":"2024-04-23T18:24:44.406022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:15.911361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.444485+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:24:44.444485+0000","last_peered":"2024-04-23T18:24:44.444485+0000","last_clean":"2024-04-23T18:24:44.444485+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:24:44.444485+0000","last_undegraded":"2024-04-23T18:24:44.444485+0000","last_fullsized":"2024-04-23T18:24:44.444485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'247","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.093506+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:27:44.093506+0000","last_peered":"2024-04-23T18:27:44.093506+0000","last_clean":"2024-04-23T18:27:44.093506+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:27:44.093506+0000","last_undegraded":"2024-04-23T18:27:44.093506+0000","last_fullsized":"2024-04-23T18:27:44.093506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406389+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:24:44.406389+0000","last_peered":"2024-04-23T18:24:44.406389+0000","last_clean":"2024-04-23T18:24:44.406389+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:24:44.406389+0000","last_undegraded":"2024-04-23T18:24:44.406389+0000","last_fullsized":"2024-04-23T18:24:44.406389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:33.207718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'23","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:42.449663+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:27:42.449663+0000","last_peered":"2024-04-23T18:27:42.449663+0000","last_clean":"2024-04-23T18:27:42.449663+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:27:42.449663+0000","last_undegraded":"2024-04-23T18:27:42.449663+0000","last_fullsized":"2024-04-23T18:27:42.449663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:01.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'247","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.358957+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:27:44.358957+0000","last_peered":"2024-04-23T18:27:44.358957+0000","last_clean":"2024-04-23T18:27:44.358957+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:27:44.358957+0000","last_undegraded":"2024-04-23T18:27:44.358957+0000","last_fullsized":"2024-04-23T18:27:44.358957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:11:34.180320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.407056+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:24:39.407056+0000","last_peered":"2024-04-23T18:24:39.407056+0000","last_clean":"2024-04-23T18:24:39.407056+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:24:39.407056+0000","last_undegraded":"2024-04-23T18:24:39.407056+0000","last_fullsized":"2024-04-23T18:24:39.407056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:31.743553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418044+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:24:39.418044+0000","last_peered":"2024-04-23T18:24:39.418044+0000","last_clean":"2024-04-23T18:24:39.418044+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:24:39.418044+0000","last_undegraded":"2024-04-23T18:24:39.418044+0000","last_fullsized":"2024-04-23T18:24:39.418044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'234","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.374568+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:27:44.374568+0000","last_peered":"2024-04-23T18:27:44.374568+0000","last_clean":"2024-04-23T18:27:44.374568+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:27:44.374568+0000","last_undegraded":"2024-04-23T18:27:44.374568+0000","last_fullsized":"2024-04-23T18:27:44.374568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:45:41.584040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.419062+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:24:39.419062+0000","last_peered":"2024-04-23T18:24:39.419062+0000","last_clean":"2024-04-23T18:24:39.419062+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:24:39.419062+0000","last_undegraded":"2024-04-23T18:24:39.419062+0000","last_fullsized":"2024-04-23T18:24:39.419062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.407076+0000","last_change":"2024-04-23T18:22:32.370384+0000","last_active":"2024-04-23T18:24:39.407076+0000","last_peered":"2024-04-23T18:24:39.407076+0000","last_clean":"2024-04-23T18:24:39.407076+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:24:39.407076+0000","last_undegraded":"2024-04-23T18:24:39.407076+0000","last_fullsized":"2024-04-23T18:24:39.407076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:54.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'256","reported_seq":276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.474582+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:27:44.474582+0000","last_peered":"2024-04-23T18:27:44.474582+0000","last_clean":"2024-04-23T18:27:44.474582+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:27:44.474582+0000","last_undegraded":"2024-04-23T18:27:44.474582+0000","last_fullsized":"2024-04-23T18:27:44.474582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:17:00.974112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.420095+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:24:39.420095+0000","last_peered":"2024-04-23T18:24:39.420095+0000","last_clean":"2024-04-23T18:24:39.420095+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:24:39.420095+0000","last_undegraded":"2024-04-23T18:24:39.420095+0000","last_fullsized":"2024-04-23T18:24:39.420095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.419002+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:24:39.419002+0000","last_peered":"2024-04-23T18:24:39.419002+0000","last_clean":"2024-04-23T18:24:39.419002+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:24:39.419002+0000","last_undegraded":"2024-04-23T18:24:39.419002+0000","last_fullsized":"2024-04-23T18:24:39.419002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'242","reported_seq":262,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.287766+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:27:44.287766+0000","last_peered":"2024-04-23T18:27:44.287766+0000","last_clean":"2024-04-23T18:27:44.287766+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:27:44.287766+0000","last_undegraded":"2024-04-23T18:27:44.287766+0000","last_fullsized":"2024-04-23T18:27:44.287766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:28.872212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.406487+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:24:34.406487+0000","last_peered":"2024-04-23T18:24:34.406487+0000","last_clean":"2024-04-23T18:24:34.406487+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:24:34.406487+0000","last_undegraded":"2024-04-23T18:24:34.406487+0000","last_fullsized":"2024-04-23T18:24:34.406487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:15.564029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:42.653567+0000","last_change":"2024-04-23T18:22:32.357468+0000","last_active":"2024-04-23T18:27:42.653567+0000","last_peered":"2024-04-23T18:27:42.653567+0000","last_clean":"2024-04-23T18:27:42.653567+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:27:42.653567+0000","last_undegraded":"2024-04-23T18:27:42.653567+0000","last_fullsized":"2024-04-23T18:27:42.653567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:03.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'249","reported_seq":263,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.344008+0000","last_change":"2024-04-23T18:23:14.730523+0000","last_active":"2024-04-23T18:27:44.344008+0000","last_peered":"2024-04-23T18:27:44.344008+0000","last_clean":"2024-04-23T18:27:44.344008+0000","last_became_active":"2024-04-23T18:23:14.729941+0000","last_became_peered":"2024-04-23T18:23:14.729941+0000","last_unstale":"2024-04-23T18:27:44.344008+0000","last_undegraded":"2024-04-23T18:27:44.344008+0000","last_fullsized":"2024-04-23T18:27:44.344008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:54.938281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405431+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:24:39.405431+0000","last_peered":"2024-04-23T18:24:39.405431+0000","last_clean":"2024-04-23T18:24:39.405431+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:24:39.405431+0000","last_undegraded":"2024-04-23T18:24:39.405431+0000","last_fullsized":"2024-04-23T18:24:39.405431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:42.847779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.417125+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:24:34.417125+0000","last_peered":"2024-04-23T18:24:34.417125+0000","last_clean":"2024-04-23T18:24:34.417125+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:24:34.417125+0000","last_undegraded":"2024-04-23T18:24:34.417125+0000","last_fullsized":"2024-04-23T18:24:34.417125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'311","reported_seq":331,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.503782+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:27:44.503782+0000","last_peered":"2024-04-23T18:27:44.503782+0000","last_clean":"2024-04-23T18:27:44.503782+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:27:44.503782+0000","last_undegraded":"2024-04-23T18:27:44.503782+0000","last_fullsized":"2024-04-23T18:27:44.503782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:30.596654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405894+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:24:39.405894+0000","last_peered":"2024-04-23T18:24:39.405894+0000","last_clean":"2024-04-23T18:24:39.405894+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:24:39.405894+0000","last_undegraded":"2024-04-23T18:24:39.405894+0000","last_fullsized":"2024-04-23T18:24:39.405894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:53.826697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.419025+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:24:39.419025+0000","last_peered":"2024-04-23T18:24:39.419025+0000","last_clean":"2024-04-23T18:24:39.419025+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:24:39.419025+0000","last_undegraded":"2024-04-23T18:24:39.419025+0000","last_fullsized":"2024-04-23T18:24:39.419025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:24.415086+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:24:24.415086+0000","last_peered":"2024-04-23T18:24:24.415086+0000","last_clean":"2024-04-23T18:24:24.415086+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:24:24.415086+0000","last_undegraded":"2024-04-23T18:24:24.415086+0000","last_fullsized":"2024-04-23T18:24:24.415086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'260","reported_seq":280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.376095+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:27:44.376095+0000","last_peered":"2024-04-23T18:27:44.376095+0000","last_clean":"2024-04-23T18:27:44.376095+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:27:44.376095+0000","last_undegraded":"2024-04-23T18:27:44.376095+0000","last_fullsized":"2024-04-23T18:27:44.376095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419817+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:24:49.419817+0000","last_peered":"2024-04-23T18:24:49.419817+0000","last_clean":"2024-04-23T18:24:49.419817+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:24:49.419817+0000","last_undegraded":"2024-04-23T18:24:49.419817+0000","last_fullsized":"2024-04-23T18:24:49.419817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419330+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:24:49.419330+0000","last_peered":"2024-04-23T18:24:49.419330+0000","last_clean":"2024-04-23T18:24:49.419330+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:24:49.419330+0000","last_undegraded":"2024-04-23T18:24:49.419330+0000","last_fullsized":"2024-04-23T18:24:49.419330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:41.746025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'274","reported_seq":294,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.428361+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:27:44.428361+0000","last_peered":"2024-04-23T18:27:44.428361+0000","last_clean":"2024-04-23T18:27:44.428361+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:27:44.428361+0000","last_undegraded":"2024-04-23T18:27:44.428361+0000","last_fullsized":"2024-04-23T18:27:44.428361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.420674+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:24:49.420674+0000","last_peered":"2024-04-23T18:24:49.420674+0000","last_clean":"2024-04-23T18:24:49.420674+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:24:49.420674+0000","last_undegraded":"2024-04-23T18:24:49.420674+0000","last_fullsized":"2024-04-23T18:24:49.420674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.408151+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:24:49.408151+0000","last_peered":"2024-04-23T18:24:49.408151+0000","last_clean":"2024-04-23T18:24:49.408151+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:24:49.408151+0000","last_undegraded":"2024-04-23T18:24:49.408151+0000","last_fullsized":"2024-04-23T18:24:49.408151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:59.039845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'237","reported_seq":264,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.318209+0000","last_change":"2024-04-23T18:23:14.728059+0000","last_active":"2024-04-23T18:27:44.318209+0000","last_peered":"2024-04-23T18:27:44.318209+0000","last_clean":"2024-04-23T18:27:44.318209+0000","last_became_active":"2024-04-23T18:23:14.727676+0000","last_became_peered":"2024-04-23T18:23:14.727676+0000","last_unstale":"2024-04-23T18:27:44.318209+0000","last_undegraded":"2024-04-23T18:27:44.318209+0000","last_fullsized":"2024-04-23T18:27:44.318209+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:26.449657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419886+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:24:49.419886+0000","last_peered":"2024-04-23T18:24:49.419886+0000","last_clean":"2024-04-23T18:24:49.419886+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:24:49.419886+0000","last_undegraded":"2024-04-23T18:24:49.419886+0000","last_fullsized":"2024-04-23T18:24:49.419886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419350+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:24:49.419350+0000","last_peered":"2024-04-23T18:24:49.419350+0000","last_clean":"2024-04-23T18:24:49.419350+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:24:49.419350+0000","last_undegraded":"2024-04-23T18:24:49.419350+0000","last_fullsized":"2024-04-23T18:24:49.419350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:07.024766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'294","reported_seq":314,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.146178+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:27:44.146178+0000","last_peered":"2024-04-23T18:27:44.146178+0000","last_clean":"2024-04-23T18:27:44.146178+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:27:44.146178+0000","last_undegraded":"2024-04-23T18:27:44.146178+0000","last_fullsized":"2024-04-23T18:27:44.146178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419863+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:24:49.419863+0000","last_peered":"2024-04-23T18:24:49.419863+0000","last_clean":"2024-04-23T18:24:49.419863+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:24:49.419863+0000","last_undegraded":"2024-04-23T18:24:49.419863+0000","last_fullsized":"2024-04-23T18:24:49.419863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:38.665933+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:25:38.665933+0000","last_peered":"2024-04-23T18:25:38.665933+0000","last_clean":"2024-04-23T18:25:38.665933+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:25:38.665933+0000","last_undegraded":"2024-04-23T18:25:38.665933+0000","last_fullsized":"2024-04-23T18:25:38.665933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'248","reported_seq":268,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.345939+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:27:44.345939+0000","last_peered":"2024-04-23T18:27:44.345939+0000","last_clean":"2024-04-23T18:27:44.345939+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:27:44.345939+0000","last_undegraded":"2024-04-23T18:27:44.345939+0000","last_fullsized":"2024-04-23T18:27:44.345939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:23:14.724850+0000","last_change":"2024-04-23T18:23:14.723945+0000","last_active":"2024-04-23T18:23:14.724850+0000","last_peered":"2024-04-23T18:23:14.724850+0000","last_clean":"2024-04-23T18:23:14.724850+0000","last_became_active":"2024-04-23T18:23:14.723676+0000","last_became_peered":"2024-04-23T18:23:14.723676+0000","last_unstale":"2024-04-23T18:23:14.724850+0000","last_undegraded":"2024-04-23T18:23:14.724850+0000","last_fullsized":"2024-04-23T18:23:14.724850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:46.330533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'15","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.419797+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:24:54.419797+0000","last_peered":"2024-04-23T18:24:54.419797+0000","last_clean":"2024-04-23T18:24:54.419797+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:24:54.419797+0000","last_undegraded":"2024-04-23T18:24:54.419797+0000","last_fullsized":"2024-04-23T18:24:54.419797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:13.106165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'343","reported_seq":363,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.385996+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:27:44.385996+0000","last_peered":"2024-04-23T18:27:44.385996+0000","last_clean":"2024-04-23T18:27:44.385996+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:27:44.385996+0000","last_undegraded":"2024-04-23T18:27:44.385996+0000","last_fullsized":"2024-04-23T18:27:44.385996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:01:03.058838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.446645+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:24:54.446645+0000","last_peered":"2024-04-23T18:24:54.446645+0000","last_clean":"2024-04-23T18:24:54.446645+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:24:54.446645+0000","last_undegraded":"2024-04-23T18:24:54.446645+0000","last_fullsized":"2024-04-23T18:24:54.446645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"24'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.446755+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:24:54.446755+0000","last_peered":"2024-04-23T18:24:54.446755+0000","last_clean":"2024-04-23T18:24:54.446755+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:24:54.446755+0000","last_undegraded":"2024-04-23T18:24:54.446755+0000","last_fullsized":"2024-04-23T18:24:54.446755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":846,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'253","reported_seq":273,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.450009+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:27:44.450009+0000","last_peered":"2024-04-23T18:27:44.450009+0000","last_clean":"2024-04-23T18:27:44.450009+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:27:44.450009+0000","last_undegraded":"2024-04-23T18:27:44.450009+0000","last_fullsized":"2024-04-23T18:27:44.450009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:07.048425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.420817+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:24:54.420817+0000","last_peered":"2024-04-23T18:24:54.420817+0000","last_clean":"2024-04-23T18:24:54.420817+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:24:54.420817+0000","last_undegraded":"2024-04-23T18:24:54.420817+0000","last_fullsized":"2024-04-23T18:24:54.420817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.422660+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:24:54.422660+0000","last_peered":"2024-04-23T18:24:54.422660+0000","last_clean":"2024-04-23T18:24:54.422660+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:24:54.422660+0000","last_undegraded":"2024-04-23T18:24:54.422660+0000","last_fullsized":"2024-04-23T18:24:54.422660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'263","reported_seq":283,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.501456+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:27:44.501456+0000","last_peered":"2024-04-23T18:27:44.501456+0000","last_clean":"2024-04-23T18:27:44.501456+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:27:44.501456+0000","last_undegraded":"2024-04-23T18:27:44.501456+0000","last_fullsized":"2024-04-23T18:27:44.501456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:44.330921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.407062+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:24:54.407062+0000","last_peered":"2024-04-23T18:24:54.407062+0000","last_clean":"2024-04-23T18:24:54.407062+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:24:54.407062+0000","last_undegraded":"2024-04-23T18:24:54.407062+0000","last_fullsized":"2024-04-23T18:24:54.407062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:22.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'6","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.407101+0000","last_change":"2024-04-23T18:22:32.380578+0000","last_active":"2024-04-23T18:24:54.407101+0000","last_peered":"2024-04-23T18:24:54.407101+0000","last_clean":"2024-04-23T18:24:54.407101+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:24:54.407101+0000","last_undegraded":"2024-04-23T18:24:54.407101+0000","last_fullsized":"2024-04-23T18:24:54.407101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:33.364341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'296","reported_seq":316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.458363+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:27:44.458363+0000","last_peered":"2024-04-23T18:27:44.458363+0000","last_clean":"2024-04-23T18:27:44.458363+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:27:44.458363+0000","last_undegraded":"2024-04-23T18:27:44.458363+0000","last_fullsized":"2024-04-23T18:27:44.458363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":285,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429156+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:24:59.429156+0000","last_peered":"2024-04-23T18:24:59.429156+0000","last_clean":"2024-04-23T18:24:59.429156+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:24:59.429156+0000","last_undegraded":"2024-04-23T18:24:59.429156+0000","last_fullsized":"2024-04-23T18:24:59.429156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'1978","reported_seq":2006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:38.322471+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:27:38.322471+0000","last_peered":"2024-04-23T18:27:38.322471+0000","last_clean":"2024-04-23T18:27:38.322471+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:27:38.322471+0000","last_undegraded":"2024-04-23T18:27:38.322471+0000","last_fullsized":"2024-04-23T18:27:38.322471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1978,"log_dups_size":0,"ondisk_log_size":1978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3963283,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1978,"num_write_kb":4064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'273","reported_seq":286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.447236+0000","last_change":"2024-04-23T18:23:14.730758+0000","last_active":"2024-04-23T18:27:44.447236+0000","last_peered":"2024-04-23T18:27:44.447236+0000","last_clean":"2024-04-23T18:27:44.447236+0000","last_became_active":"2024-04-23T18:23:14.729264+0000","last_became_peered":"2024-04-23T18:23:14.729264+0000","last_unstale":"2024-04-23T18:27:44.447236+0000","last_undegraded":"2024-04-23T18:27:44.447236+0000","last_fullsized":"2024-04-23T18:27:44.447236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:25:09.741395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.424986+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:24:54.424986+0000","last_peered":"2024-04-23T18:24:54.424986+0000","last_clean":"2024-04-23T18:24:54.424986+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:24:54.424986+0000","last_undegraded":"2024-04-23T18:24:54.424986+0000","last_fullsized":"2024-04-23T18:24:54.424986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'7","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:17.563123+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:25:17.563123+0000","last_peered":"2024-04-23T18:25:17.563123+0000","last_clean":"2024-04-23T18:25:17.563123+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:25:17.563123+0000","last_undegraded":"2024-04-23T18:25:17.563123+0000","last_fullsized":"2024-04-23T18:25:17.563123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:57.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'287","reported_seq":307,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.411127+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:27:44.411127+0000","last_peered":"2024-04-23T18:27:44.411127+0000","last_clean":"2024-04-23T18:27:44.411127+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:27:44.411127+0000","last_undegraded":"2024-04-23T18:27:44.411127+0000","last_fullsized":"2024-04-23T18:27:44.411127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.407567+0000","last_change":"2024-04-23T18:22:33.379653+0000","last_active":"2024-04-23T18:24:59.407567+0000","last_peered":"2024-04-23T18:24:59.407567+0000","last_clean":"2024-04-23T18:24:59.407567+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:24:59.407567+0000","last_undegraded":"2024-04-23T18:24:59.407567+0000","last_fullsized":"2024-04-23T18:24:59.407567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:09.919029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429662+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:24:59.429662+0000","last_peered":"2024-04-23T18:24:59.429662+0000","last_clean":"2024-04-23T18:24:59.429662+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:24:59.429662+0000","last_undegraded":"2024-04-23T18:24:59.429662+0000","last_fullsized":"2024-04-23T18:24:59.429662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'292","reported_seq":312,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.376633+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:27:44.376633+0000","last_peered":"2024-04-23T18:27:44.376633+0000","last_clean":"2024-04-23T18:27:44.376633+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:27:44.376633+0000","last_undegraded":"2024-04-23T18:27:44.376633+0000","last_fullsized":"2024-04-23T18:27:44.376633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:11.477842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429648+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:24:59.429648+0000","last_peered":"2024-04-23T18:24:59.429648+0000","last_clean":"2024-04-23T18:24:59.429648+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:24:59.429648+0000","last_undegraded":"2024-04-23T18:24:59.429648+0000","last_fullsized":"2024-04-23T18:24:59.429648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.448017+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:24:59.448017+0000","last_peered":"2024-04-23T18:24:59.448017+0000","last_clean":"2024-04-23T18:24:59.448017+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:24:59.448017+0000","last_undegraded":"2024-04-23T18:24:59.448017+0000","last_fullsized":"2024-04-23T18:24:59.448017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'309","reported_seq":329,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.524017+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:27:44.524017+0000","last_peered":"2024-04-23T18:27:44.524017+0000","last_clean":"2024-04-23T18:27:44.524017+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:27:44.524017+0000","last_undegraded":"2024-04-23T18:27:44.524017+0000","last_fullsized":"2024-04-23T18:27:44.524017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:51.142382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'251","reported_seq":271,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.423077+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:27:44.423077+0000","last_peered":"2024-04-23T18:27:44.423077+0000","last_clean":"2024-04-23T18:27:44.423077+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:27:44.423077+0000","last_undegraded":"2024-04-23T18:27:44.423077+0000","last_fullsized":"2024-04-23T18:27:44.423077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:12.392184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:24.567862+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:27:24.567862+0000","last_peered":"2024-04-23T18:27:24.567862+0000","last_clean":"2024-04-23T18:27:24.567862+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:27:24.567862+0000","last_undegraded":"2024-04-23T18:27:24.567862+0000","last_fullsized":"2024-04-23T18:27:24.567862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:42.721575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429581+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:24:59.429581+0000","last_peered":"2024-04-23T18:24:59.429581+0000","last_clean":"2024-04-23T18:24:59.429581+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:24:59.429581+0000","last_undegraded":"2024-04-23T18:24:59.429581+0000","last_fullsized":"2024-04-23T18:24:59.429581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'245","reported_seq":265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.436308+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:27:44.436308+0000","last_peered":"2024-04-23T18:27:44.436308+0000","last_clean":"2024-04-23T18:27:44.436308+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:27:44.436308+0000","last_undegraded":"2024-04-23T18:27:44.436308+0000","last_fullsized":"2024-04-23T18:27:44.436308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.426807+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:24:59.426807+0000","last_peered":"2024-04-23T18:24:59.426807+0000","last_clean":"2024-04-23T18:24:59.426807+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:24:59.426807+0000","last_undegraded":"2024-04-23T18:24:59.426807+0000","last_fullsized":"2024-04-23T18:24:59.426807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:04.204101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.426852+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:24:59.426852+0000","last_peered":"2024-04-23T18:24:59.426852+0000","last_clean":"2024-04-23T18:24:59.426852+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:24:59.426852+0000","last_undegraded":"2024-04-23T18:24:59.426852+0000","last_fullsized":"2024-04-23T18:24:59.426852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:22.012834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.448866+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:25:04.448866+0000","last_peered":"2024-04-23T18:25:04.448866+0000","last_clean":"2024-04-23T18:25:04.448866+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:25:04.448866+0000","last_undegraded":"2024-04-23T18:25:04.448866+0000","last_fullsized":"2024-04-23T18:25:04.448866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.408050+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:25:04.408050+0000","last_peered":"2024-04-23T18:25:04.408050+0000","last_clean":"2024-04-23T18:25:04.408050+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:25:04.408050+0000","last_undegraded":"2024-04-23T18:25:04.408050+0000","last_fullsized":"2024-04-23T18:25:04.408050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:16.738809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'276","reported_seq":296,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.482439+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:27:44.482439+0000","last_peered":"2024-04-23T18:27:44.482439+0000","last_clean":"2024-04-23T18:27:44.482439+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:27:44.482439+0000","last_undegraded":"2024-04-23T18:27:44.482439+0000","last_fullsized":"2024-04-23T18:27:44.482439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:51.665926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.427467+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:25:04.427467+0000","last_peered":"2024-04-23T18:25:04.427467+0000","last_clean":"2024-04-23T18:25:04.427467+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:25:04.427467+0000","last_undegraded":"2024-04-23T18:25:04.427467+0000","last_fullsized":"2024-04-23T18:25:04.427467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:05.622845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.426743+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:25:04.426743+0000","last_peered":"2024-04-23T18:25:04.426743+0000","last_clean":"2024-04-23T18:25:04.426743+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:25:04.426743+0000","last_undegraded":"2024-04-23T18:25:04.426743+0000","last_fullsized":"2024-04-23T18:25:04.426743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'292","reported_seq":312,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:44.526792+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:27:44.526792+0000","last_peered":"2024-04-23T18:27:44.526792+0000","last_clean":"2024-04-23T18:27:44.526792+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:27:44.526792+0000","last_undegraded":"2024-04-23T18:27:44.526792+0000","last_fullsized":"2024-04-23T18:27:44.526792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:55.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.443391+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:24:39.443391+0000","last_peered":"2024-04-23T18:24:39.443391+0000","last_clean":"2024-04-23T18:24:39.443391+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:24:39.443391+0000","last_undegraded":"2024-04-23T18:24:39.443391+0000","last_fullsized":"2024-04-23T18:24:39.443391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418207+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:24:39.418207+0000","last_peered":"2024-04-23T18:24:39.418207+0000","last_clean":"2024-04-23T18:24:39.418207+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:24:39.418207+0000","last_undegraded":"2024-04-23T18:24:39.418207+0000","last_fullsized":"2024-04-23T18:24:39.418207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:34.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418960+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:24:39.418960+0000","last_peered":"2024-04-23T18:24:39.418960+0000","last_clean":"2024-04-23T18:24:39.418960+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:24:39.418960+0000","last_undegraded":"2024-04-23T18:24:39.418960+0000","last_fullsized":"2024-04-23T18:24:39.418960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405460+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:24:39.405460+0000","last_peered":"2024-04-23T18:24:39.405460+0000","last_clean":"2024-04-23T18:24:39.405460+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:24:39.405460+0000","last_undegraded":"2024-04-23T18:24:39.405460+0000","last_fullsized":"2024-04-23T18:24:39.405460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:36.262627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406352+0000","last_change":"2024-04-23T18:22:33.390592+0000","last_active":"2024-04-23T18:24:44.406352+0000","last_peered":"2024-04-23T18:24:44.406352+0000","last_clean":"2024-04-23T18:24:44.406352+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:24:44.406352+0000","last_undegraded":"2024-04-23T18:24:44.406352+0000","last_fullsized":"2024-04-23T18:24:44.406352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:31.847944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.407689+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:24:44.407689+0000","last_peered":"2024-04-23T18:24:44.407689+0000","last_clean":"2024-04-23T18:24:44.407689+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:24:44.407689+0000","last_undegraded":"2024-04-23T18:24:44.407689+0000","last_fullsized":"2024-04-23T18:24:44.407689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:14:21.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.444383+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:24:44.444383+0000","last_peered":"2024-04-23T18:24:44.444383+0000","last_clean":"2024-04-23T18:24:44.444383+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:24:44.444383+0000","last_undegraded":"2024-04-23T18:24:44.444383+0000","last_fullsized":"2024-04-23T18:24:44.444383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.406374+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:24:44.406374+0000","last_peered":"2024-04-23T18:24:44.406374+0000","last_clean":"2024-04-23T18:24:44.406374+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:24:44.406374+0000","last_undegraded":"2024-04-23T18:24:44.406374+0000","last_fullsized":"2024-04-23T18:24:44.406374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:22.080547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.419755+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:24:44.419755+0000","last_peered":"2024-04-23T18:24:44.419755+0000","last_clean":"2024-04-23T18:24:44.419755+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:24:44.419755+0000","last_undegraded":"2024-04-23T18:24:44.419755+0000","last_fullsized":"2024-04-23T18:24:44.419755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.406806+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:24:49.406806+0000","last_peered":"2024-04-23T18:24:49.406806+0000","last_clean":"2024-04-23T18:24:49.406806+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:24:49.406806+0000","last_undegraded":"2024-04-23T18:24:49.406806+0000","last_fullsized":"2024-04-23T18:24:49.406806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:42.782283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:29.426186+0000","last_change":"2024-04-23T18:23:14.787713+0000","last_active":"2024-04-23T18:25:29.426186+0000","last_peered":"2024-04-23T18:25:29.426186+0000","last_clean":"2024-04-23T18:25:29.426186+0000","last_became_active":"2024-04-23T18:23:14.787340+0000","last_became_peered":"2024-04-23T18:23:14.787340+0000","last_unstale":"2024-04-23T18:25:29.426186+0000","last_undegraded":"2024-04-23T18:25:29.426186+0000","last_fullsized":"2024-04-23T18:25:29.426186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:44:54.939264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.406496+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:24:49.406496+0000","last_peered":"2024-04-23T18:24:49.406496+0000","last_clean":"2024-04-23T18:24:49.406496+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:24:49.406496+0000","last_undegraded":"2024-04-23T18:24:49.406496+0000","last_fullsized":"2024-04-23T18:24:49.406496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:21.001372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.445374+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:24:49.445374+0000","last_peered":"2024-04-23T18:24:49.445374+0000","last_clean":"2024-04-23T18:24:49.445374+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:24:49.445374+0000","last_undegraded":"2024-04-23T18:24:49.445374+0000","last_fullsized":"2024-04-23T18:24:49.445374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:49.419840+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:24:49.419840+0000","last_peered":"2024-04-23T18:24:49.419840+0000","last_clean":"2024-04-23T18:24:49.419840+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:24:49.419840+0000","last_undegraded":"2024-04-23T18:24:49.419840+0000","last_fullsized":"2024-04-23T18:24:49.419840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.419872+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:24:54.419872+0000","last_peered":"2024-04-23T18:24:54.419872+0000","last_clean":"2024-04-23T18:24:54.419872+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:24:54.419872+0000","last_undegraded":"2024-04-23T18:24:54.419872+0000","last_fullsized":"2024-04-23T18:24:54.419872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:35.668750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.422820+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:24:54.422820+0000","last_peered":"2024-04-23T18:24:54.422820+0000","last_clean":"2024-04-23T18:24:54.422820+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:24:54.422820+0000","last_undegraded":"2024-04-23T18:24:54.422820+0000","last_fullsized":"2024-04-23T18:24:54.422820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.422415+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:24:54.422415+0000","last_peered":"2024-04-23T18:24:54.422415+0000","last_clean":"2024-04-23T18:24:54.422415+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:24:54.422415+0000","last_undegraded":"2024-04-23T18:24:54.422415+0000","last_fullsized":"2024-04-23T18:24:54.422415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.408573+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:24:54.408573+0000","last_peered":"2024-04-23T18:24:54.408573+0000","last_clean":"2024-04-23T18:24:54.408573+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:24:54.408573+0000","last_undegraded":"2024-04-23T18:24:54.408573+0000","last_fullsized":"2024-04-23T18:24:54.408573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:58.757336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.407037+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:24:54.407037+0000","last_peered":"2024-04-23T18:24:54.407037+0000","last_clean":"2024-04-23T18:24:54.407037+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:24:54.407037+0000","last_undegraded":"2024-04-23T18:24:54.407037+0000","last_fullsized":"2024-04-23T18:24:54.407037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:43.725280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.426862+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:24:59.426862+0000","last_peered":"2024-04-23T18:24:59.426862+0000","last_clean":"2024-04-23T18:24:59.426862+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:24:59.426862+0000","last_undegraded":"2024-04-23T18:24:59.426862+0000","last_fullsized":"2024-04-23T18:24:59.426862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:42.102284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.425933+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:24:59.425933+0000","last_peered":"2024-04-23T18:24:59.425933+0000","last_clean":"2024-04-23T18:24:59.425933+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:24:59.425933+0000","last_undegraded":"2024-04-23T18:24:59.425933+0000","last_fullsized":"2024-04-23T18:24:59.425933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.447843+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:24:59.447843+0000","last_peered":"2024-04-23T18:24:59.447843+0000","last_clean":"2024-04-23T18:24:59.447843+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:24:59.447843+0000","last_undegraded":"2024-04-23T18:24:59.447843+0000","last_fullsized":"2024-04-23T18:24:59.447843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:16.546558+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:25:16.546558+0000","last_peered":"2024-04-23T18:25:16.546558+0000","last_clean":"2024-04-23T18:25:16.546558+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:25:16.546558+0000","last_undegraded":"2024-04-23T18:25:16.546558+0000","last_fullsized":"2024-04-23T18:25:16.546558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429208+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:24:59.429208+0000","last_peered":"2024-04-23T18:24:59.429208+0000","last_clean":"2024-04-23T18:24:59.429208+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:24:59.429208+0000","last_undegraded":"2024-04-23T18:24:59.429208+0000","last_fullsized":"2024-04-23T18:24:59.429208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.427357+0000","last_change":"2024-04-23T18:23:14.787765+0000","last_active":"2024-04-23T18:25:04.427357+0000","last_peered":"2024-04-23T18:25:04.427357+0000","last_clean":"2024-04-23T18:25:04.427357+0000","last_became_active":"2024-04-23T18:23:14.787444+0000","last_became_peered":"2024-04-23T18:23:14.787444+0000","last_unstale":"2024-04-23T18:25:04.427357+0000","last_undegraded":"2024-04-23T18:25:04.427357+0000","last_fullsized":"2024-04-23T18:25:04.427357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:12.714842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.429969+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:25:04.429969+0000","last_peered":"2024-04-23T18:25:04.429969+0000","last_clean":"2024-04-23T18:25:04.429969+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:25:04.429969+0000","last_undegraded":"2024-04-23T18:25:04.429969+0000","last_fullsized":"2024-04-23T18:25:04.429969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430478+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:25:04.430478+0000","last_peered":"2024-04-23T18:25:04.430478+0000","last_clean":"2024-04-23T18:25:04.430478+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:25:04.430478+0000","last_undegraded":"2024-04-23T18:25:04.430478+0000","last_fullsized":"2024-04-23T18:25:04.430478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430005+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:25:04.430005+0000","last_peered":"2024-04-23T18:25:04.430005+0000","last_clean":"2024-04-23T18:25:04.430005+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:25:04.430005+0000","last_undegraded":"2024-04-23T18:25:04.430005+0000","last_fullsized":"2024-04-23T18:25:04.430005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.418134+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:24:34.418134+0000","last_peered":"2024-04-23T18:24:34.418134+0000","last_clean":"2024-04-23T18:24:34.418134+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:24:34.418134+0000","last_undegraded":"2024-04-23T18:24:34.418134+0000","last_fullsized":"2024-04-23T18:24:34.418134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.405476+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:24:39.405476+0000","last_peered":"2024-04-23T18:24:39.405476+0000","last_clean":"2024-04-23T18:24:39.405476+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:24:39.405476+0000","last_undegraded":"2024-04-23T18:24:39.405476+0000","last_fullsized":"2024-04-23T18:24:39.405476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:36.652214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.407088+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:24:39.407088+0000","last_peered":"2024-04-23T18:24:39.407088+0000","last_clean":"2024-04-23T18:24:39.407088+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:24:39.407088+0000","last_undegraded":"2024-04-23T18:24:39.407088+0000","last_fullsized":"2024-04-23T18:24:39.407088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:29:30.258548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418110+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:24:39.418110+0000","last_peered":"2024-04-23T18:24:39.418110+0000","last_clean":"2024-04-23T18:24:39.418110+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:24:39.418110+0000","last_undegraded":"2024-04-23T18:24:39.418110+0000","last_fullsized":"2024-04-23T18:24:39.418110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":4492099584,"num_objects":1071,"num_object_clones":0,"num_object_copies":4284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1071,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8145,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8984199168,"data_stored":8984199168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8660,"ondisk_log_size":8660,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3967478,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2143,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8093696,"data_stored":7934956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2112,"ondisk_log_size":2112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1293360,"kb_used_data":1233768,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":93078480,"statfs":{"total":96636764160,"available":95312363520,"internally_reserved":0,"allocated":1263378432,"data_stored":1263191549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1566468,"kb_used_data":1495100,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":92805372,"statfs":{"total":96636764160,"available":95032700928,"internally_reserved":0,"allocated":1530982400,"data_stored":1530800291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1343916,"kb_used_data":1290532,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":93027924,"statfs":{"total":96636764160,"available":95260594176,"internally_reserved":0,"allocated":1321504768,"data_stored":1321321499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1481192,"kb_used_data":1423648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":92890648,"statfs":{"total":96636764160,"available":95120023552,"internally_reserved":0,"allocated":1457815552,"data_stored":1457635973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693516,"kb_used_data":1617988,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":92678324,"statfs":{"total":96636764160,"available":94902603776,"internally_reserved":0,"allocated":1656819712,"data_stored":1656629514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77330887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1167792,"kb_used_data":1114408,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":93204048,"statfs":{"total":96636764160,"available":95440945152,"internally_reserved":0,"allocated":1141153792,"data_stored":1140966194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1660848,"kb_used_data":1589544,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":92710992,"statfs":{"total":96636764160,"available":94936055808,"internally_reserved":0,"allocated":1627693056,"data_stored":1627505257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1537068,"kb_used_data":1471332,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":92834772,"statfs":{"total":96636764160,"available":95062806528,"internally_reserved":0,"allocated":1506643968,"data_stored":1506460525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3989504,"data_stored":3964322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3981312,"data_stored":3964219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":966787072,"data_stored":966787072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1400897536,"data_stored":1400897536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":882900992,"data_stored":882900992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1468006400,"data_stored":1468006400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1119879168,"data_stored":1119879168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":950009856,"data_stored":950009856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1186988032,"data_stored":1186988032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1008730112,"data_stored":1008730112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:27:50.357 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:27:50.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.537+0000 7f9e7b000640 1 Processor -- start 2024-04-23T18:27:50.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7b000640 1 -- start start 2024-04-23T18:27:50.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7b000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e740b2d60 0x7f9e74071df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:50.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7b000640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9e74073dc0 0x7f9e74072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:50.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7b000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e740b3140 con 0x7f9e74075bd0 2024-04-23T18:27:50.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7b000640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f9e740c9290 con 0x7f9e74073dc0 2024-04-23T18:27:50.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7b000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9e740713e0 con 0x7f9e740b2d60 2024-04-23T18:27:50.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7a600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9e74073dc0 0x7f9e74072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:50.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7a600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9e74073dc0 0x7f9e74072330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33178/0 (socket says 172.21.15.28:33178) 2024-04-23T18:27:50.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7a600640 1 -- 172.21.15.28:0/236220550 learned_addr learned my addr 172.21.15.28:0/236220550 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:50.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e79c00640 1 --2- 172.21.15.28:0/236220550 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e740b2d60 0x7f9e74071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:50.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7a600640 1 -- 172.21.15.28:0/236220550 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e740b2d60 msgr2=0x7f9e74071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:50.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7a600640 1 --2- 172.21.15.28:0/236220550 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e740b2d60 0x7f9e74071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7a600640 1 -- 172.21.15.28:0/236220550 >> v1:172.21.15.137:6789/0 conn(0x7f9e74075bd0 legacy=0x7f9e7415c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e7a600640 1 -- 172.21.15.28:0/236220550 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e740c8c80 con 0x7f9e74073dc0 2024-04-23T18:27:50.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.541+0000 7f9e79c00640 1 --2- 172.21.15.28:0/236220550 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e740b2d60 0x7f9e74071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:27:50.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e7a600640 1 --2- 172.21.15.28:0/236220550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e74073dc0 0x7f9e74072330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009e50 tx=0x7f9e6c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d31f151beed79c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:50.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e73e00640 1 -- 172.21.15.28:0/236220550 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0a5660 con 0x7f9e74073dc0 2024-04-23T18:27:50.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e73e00640 1 -- 172.21.15.28:0/236220550 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6c0a5800 con 0x7f9e74073dc0 2024-04-23T18:27:50.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e73e00640 1 -- 172.21.15.28:0/236220550 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0a5bd0 con 0x7f9e74073dc0 2024-04-23T18:27:50.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e7b000640 1 -- 172.21.15.28:0/236220550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e74073dc0 msgr2=0x7f9e74072330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e7b000640 1 --2- 172.21.15.28:0/236220550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e74073dc0 0x7f9e74072330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009e50 tx=0x7f9e6c01c9a0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e7b000640 1 -- 172.21.15.28:0/236220550 shutdown_connections 2024-04-23T18:27:50.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e7b000640 1 --2- 172.21.15.28:0/236220550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e74073dc0 0x7f9e74072330 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e7b000640 1 --2- 172.21.15.28:0/236220550 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e740b2d60 0x7f9e74071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e7b000640 1 -- 172.21.15.28:0/236220550 >> 172.21.15.28:0/236220550 conn(0x7f9e740ccf70 msgr2=0x7f9e740cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:50.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e7b000640 1 -- 172.21.15.28:0/236220550 shutdown_connections 2024-04-23T18:27:50.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e7b000640 1 -- 172.21.15.28:0/236220550 wait complete. 2024-04-23T18:27:50.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e7b000640 1 Processor -- start 2024-04-23T18:27:50.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.545+0000 7f9e7b000640 1 -- start start 2024-04-23T18:27:50.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7b000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e74073dc0 0x7f9e74145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:50.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7b000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e74075bd0 0x7f9e74148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:50.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7b000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e740b2d60 0x7f9e74144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:50.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7b000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9e740c7d20 con 0x7f9e740b2d60 2024-04-23T18:27:50.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7b000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7415c420 con 0x7f9e74073dc0 2024-04-23T18:27:50.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7b000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9e740c7ea0 con 0x7f9e74075bd0 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7a600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e740b2d60 0x7f9e74144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7a600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e740b2d60 0x7f9e74144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33192/0 (socket says 172.21.15.28:33192) 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7a600640 1 -- 172.21.15.28:0/2080844585 learned_addr learned my addr 172.21.15.28:0/2080844585 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e79c00640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e74073dc0 0x7f9e74145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e79200640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e74075bd0 0x7f9e74148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7a600640 1 -- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e74075bd0 msgr2=0x7f9e74148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7a600640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e74075bd0 0x7f9e74148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7a600640 1 -- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e74073dc0 msgr2=0x7f9e74145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7a600640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e74073dc0 0x7f9e74145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7a600640 1 -- 172.21.15.28:0/2080844585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e74161a40 con 0x7f9e740b2d60 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e79c00640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e74073dc0 0x7f9e74145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e79200640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e74075bd0 0x7f9e74148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:50.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7a600640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e740b2d60 0x7f9e74144950 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c01a5d0 tx=0x7f9e6c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:50.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e71600640 1 -- 172.21.15.28:0/2080844585 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0bc020 con 0x7f9e740b2d60 2024-04-23T18:27:50.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e71600640 1 -- 172.21.15.28:0/2080844585 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6c0b8670 con 0x7f9e740b2d60 2024-04-23T18:27:50.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e71600640 1 -- 172.21.15.28:0/2080844585 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0b8a20 con 0x7f9e740b2d60 2024-04-23T18:27:50.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7b000640 1 -- 172.21.15.28:0/2080844585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e74162230 con 0x7f9e740b2d60 2024-04-23T18:27:50.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7b000640 1 -- 172.21.15.28:0/2080844585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e741627f0 con 0x7f9e740b2d60 2024-04-23T18:27:50.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e7b000640 1 -- 172.21.15.28:0/2080844585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e74068cd0 con 0x7f9e740b2d60 2024-04-23T18:27:50.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.549+0000 7f9e71600640 1 -- 172.21.15.28:0/2080844585 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e6c0bf020 con 0x7f9e740b2d60 2024-04-23T18:27:50.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.553+0000 7f9e71600640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e54068380 0x7f9e5406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:50.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.553+0000 7f9e71600640 1 -- 172.21.15.28:0/2080844585 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9e6c121f60 con 0x7f9e740b2d60 2024-04-23T18:27:50.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.553+0000 7f9e79c00640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e54068380 0x7f9e5406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:50.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.553+0000 7f9e79c00640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e54068380 0x7f9e5406a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e68006fd0 tx=0x7f9e68008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:50.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.557+0000 7f9e71600640 1 -- 172.21.15.28:0/2080844585 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e6c0c6030 con 0x7f9e740b2d60 2024-04-23T18:27:50.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.721+0000 7f9e7b000640 1 -- 172.21.15.28:0/2080844585 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e740c8a60 con 0x7f9e740b2d60 2024-04-23T18:27:50.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e71600640 1 -- 172.21.15.28:0/2080844585 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18891 (secure 0 0 0) 0x7f9e740c8c80 con 0x7f9e740b2d60 2024-04-23T18:27:50.719 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:27:50.719 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:23:14.705611+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:27:50.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 -- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e54068380 msgr2=0x7f9e5406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e54068380 0x7f9e5406a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e68006fd0 tx=0x7f9e68008040 comp rx=0 tx=0).stop 2024-04-23T18:27:50.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 -- 172.21.15.28:0/2080844585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e740b2d60 msgr2=0x7f9e74144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:50.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e740b2d60 0x7f9e74144950 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c01a5d0 tx=0x7f9e6c019740 comp rx=0 tx=0).stop 2024-04-23T18:27:50.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 -- 172.21.15.28:0/2080844585 shutdown_connections 2024-04-23T18:27:50.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9e54068380 0x7f9e5406a840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9e74075bd0 0x7f9e74148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e740b2d60 0x7f9e74144950 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 --2- 172.21.15.28:0/2080844585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e74073dc0 0x7f9e74145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:50.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 -- 172.21.15.28:0/2080844585 >> 172.21.15.28:0/2080844585 conn(0x7f9e740ccf70 msgr2=0x7f9e740c7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:50.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 -- 172.21.15.28:0/2080844585 shutdown_connections 2024-04-23T18:27:50.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:50.725+0000 7f9e7b000640 1 -- 172.21.15.28:0/2080844585 wait complete. 2024-04-23T18:27:51.741 INFO:tasks.ceph:Scrubbing osd.0 2024-04-23T18:27:51.741 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:27:51.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.901+0000 7f4862a00640 1 Processor -- start 2024-04-23T18:27:51.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.901+0000 7f4862a00640 1 -- start start 2024-04-23T18:27:51.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.905+0000 7f4862a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f485c142460 0x7f485c0c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:51.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.905+0000 7f4862a00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f485c158ff0 con 0x7f485c073600 2024-04-23T18:27:51.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.905+0000 7f4862a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f485c06f770 con 0x7f485c073220 2024-04-23T18:27:51.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.905+0000 7f4862a00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f485c0c5f20 con 0x7f485c142460 2024-04-23T18:27:51.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.905+0000 7f4860a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f485c142460 0x7f485c0c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:51.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.905+0000 7f4853400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f485c073600 0x7f485c141d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33610/0 (socket says 172.21.15.28:33610) 2024-04-23T18:27:51.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.905+0000 7f4860a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f485c142460 0x7f485c0c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33200/0 (socket says 172.21.15.28:33200) 2024-04-23T18:27:51.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.905+0000 7f4853400640 1 -- 172.21.15.28:0/3994322146 learned_addr learned my addr 172.21.15.28:0/3994322146 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:51.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.905+0000 7f4860a00640 1 -- 172.21.15.28:0/3994322146 >> v1:172.21.15.137:6789/0 conn(0x7f485c073220 legacy=0x7f485c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:51.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.905+0000 7f4860a00640 1 -- 172.21.15.28:0/3994322146 >> v1:172.21.15.28:6789/0 conn(0x7f485c073600 legacy=0x7f485c141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:51.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.905+0000 7f4860a00640 1 -- 172.21.15.28:0/3994322146 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c0c6200 con 0x7f485c142460 2024-04-23T18:27:51.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f4860a00640 1 --2- 172.21.15.28:0/3994322146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f485c142460 0x7f485c0c4540 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f48540097c0 tx=0x7f485401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3428194b9889ab1f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:51.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f485b400640 1 -- 172.21.15.28:0/3994322146 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540a7070 con 0x7f485c142460 2024-04-23T18:27:51.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f485b400640 1 -- 172.21.15.28:0/3994322146 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48540b0070 con 0x7f485c142460 2024-04-23T18:27:51.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f485b400640 1 -- 172.21.15.28:0/3994322146 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540ab890 con 0x7f485c142460 2024-04-23T18:27:51.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f4862a00640 1 -- 172.21.15.28:0/3994322146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f485c142460 msgr2=0x7f485c0c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:51.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f4862a00640 1 --2- 172.21.15.28:0/3994322146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f485c142460 0x7f485c0c4540 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f48540097c0 tx=0x7f485401c470 comp rx=0 tx=0).stop 2024-04-23T18:27:51.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f4862a00640 1 -- 172.21.15.28:0/3994322146 shutdown_connections 2024-04-23T18:27:51.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f4862a00640 1 --2- 172.21.15.28:0/3994322146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f485c142460 0x7f485c0c4540 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:51.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f4862a00640 1 -- 172.21.15.28:0/3994322146 >> 172.21.15.28:0/3994322146 conn(0x7f485c06d400 msgr2=0x7f485c0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:51.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f4862a00640 1 -- 172.21.15.28:0/3994322146 shutdown_connections 2024-04-23T18:27:51.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f4862a00640 1 -- 172.21.15.28:0/3994322146 wait complete. 2024-04-23T18:27:51.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f4862a00640 1 Processor -- start 2024-04-23T18:27:51.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.909+0000 7f4862a00640 1 -- start start 2024-04-23T18:27:51.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4862a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f485c073220 0x7f485c13bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:51.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4862a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f485c073600 0x7f485c1f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:51.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4862a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f485c142460 0x7f485c157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:51.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4862a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f485c166880 con 0x7f485c073600 2024-04-23T18:27:51.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4862a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f485c0c71f0 con 0x7f485c073220 2024-04-23T18:27:51.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4862a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f485c166a00 con 0x7f485c142460 2024-04-23T18:27:51.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4853400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f485c073600 0x7f485c1f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:51.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4853400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f485c073600 0x7f485c1f4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33202/0 (socket says 172.21.15.28:33202) 2024-04-23T18:27:51.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4853400640 1 -- 172.21.15.28:0/2124723319 learned_addr learned my addr 172.21.15.28:0/2124723319 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:51.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f485be00640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f485c073220 0x7f485c13bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:51.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4860a00640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f485c142460 0x7f485c157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:51.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4853400640 1 -- 172.21.15.28:0/2124723319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f485c142460 msgr2=0x7f485c157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:51.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4853400640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f485c142460 0x7f485c157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:51.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4853400640 1 -- 172.21.15.28:0/2124723319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f485c073220 msgr2=0x7f485c13bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:51.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4853400640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f485c073220 0x7f485c13bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:51.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4853400640 1 -- 172.21.15.28:0/2124723319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c157840 con 0x7f485c073600 2024-04-23T18:27:51.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4853400640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f485c073600 0x7f485c1f4490 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f484400c500 tx=0x7f484400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:51.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4858c00640 1 -- 172.21.15.28:0/2124723319 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844017070 con 0x7f485c073600 2024-04-23T18:27:51.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4858c00640 1 -- 172.21.15.28:0/2124723319 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4844005cf0 con 0x7f485c073600 2024-04-23T18:27:51.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4858c00640 1 -- 172.21.15.28:0/2124723319 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48440072f0 con 0x7f485c073600 2024-04-23T18:27:51.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4862a00640 1 -- 172.21.15.28:0/2124723319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485c156f00 con 0x7f485c073600 2024-04-23T18:27:51.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4862a00640 1 -- 172.21.15.28:0/2124723319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485c13c4e0 con 0x7f485c073600 2024-04-23T18:27:51.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4862a00640 1 -- 172.21.15.28:0/2124723319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f485c068e50 con 0x7f485c073600 2024-04-23T18:27:51.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.913+0000 7f4858c00640 1 -- 172.21.15.28:0/2124723319 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f484401a070 con 0x7f485c073600 2024-04-23T18:27:51.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.917+0000 7f4858c00640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f48380683d0 0x7f483806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:51.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.917+0000 7f4858c00640 1 -- 172.21.15.28:0/2124723319 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f48440860f0 con 0x7f485c073600 2024-04-23T18:27:51.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.917+0000 7f4858c00640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] conn(0x7f4838071e60 0x7f4838074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.917+0000 7f4858c00640 1 -- 172.21.15.28:0/2124723319 --> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48380749d0 con 0x7f4838071e60 2024-04-23T18:27:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.917+0000 7f4858c00640 1 -- 172.21.15.28:0/2124723319 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f484408d050 con 0x7f485c073600 2024-04-23T18:27:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.917+0000 7f485be00640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f48380683d0 0x7f483806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.917+0000 7f4860a00640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] conn(0x7f4838071e60 0x7f4838074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.917+0000 7f4860a00640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] conn(0x7f4838071e60 0x7f4838074300 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.917+0000 7f485be00640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f48380683d0 0x7f483806a890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f484c001e00 tx=0x7f484c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:51.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.917+0000 7f4858c00640 1 -- 172.21.15.28:0/2124723319 <== osd.0 v2:172.21.15.28:6800/1141872294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48380749d0 con 0x7f4838071e60 2024-04-23T18:27:51.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.929+0000 7f4862a00640 1 -- 172.21.15.28:0/2124723319 --> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f485c0750e0 con 0x7f4838071e60 2024-04-23T18:27:51.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.929+0000 7f4858c00640 1 -- 172.21.15.28:0/2124723319 <== osd.0 v2:172.21.15.28:6800/1141872294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f485c0750e0 con 0x7f4838071e60 2024-04-23T18:27:51.927 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:27:51.927 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:27:51.927 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:27:51.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.933+0000 7f4862a00640 1 -- 172.21.15.28:0/2124723319 >> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] conn(0x7f4838071e60 msgr2=0x7f4838074300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:51.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.933+0000 7f4862a00640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.28:6800/1141872294,v1:172.21.15.28:6801/1141872294] conn(0x7f4838071e60 0x7f4838074300 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:51.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.933+0000 7f4862a00640 1 -- 172.21.15.28:0/2124723319 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f48380683d0 msgr2=0x7f483806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:51.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.933+0000 7f4862a00640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f48380683d0 0x7f483806a890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f484c001e00 tx=0x7f484c009040 comp rx=0 tx=0).stop 2024-04-23T18:27:51.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.933+0000 7f4862a00640 1 -- 172.21.15.28:0/2124723319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f485c073600 msgr2=0x7f485c1f4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:51.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.933+0000 7f4862a00640 1 --2- 172.21.15.28:0/2124723319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f485c073600 0x7f485c1f4490 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f484400c500 tx=0x7f484400c9c0 comp rx=0 tx=0).stop 2024-04-23T18:27:51.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.933+0000 7f4860a00640 1 -- 172.21.15.28:0/2124723319 reap_dead start 2024-04-23T18:27:51.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.933+0000 7f4862a00640 1 -- 172.21.15.28:0/2124723319 shutdown_connections 2024-04-23T18:27:51.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.933+0000 7f4862a00640 1 -- 172.21.15.28:0/2124723319 >> 172.21.15.28:0/2124723319 conn(0x7f485c06d400 msgr2=0x7f485c158710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:51.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.933+0000 7f4862a00640 1 -- 172.21.15.28:0/2124723319 shutdown_connections 2024-04-23T18:27:51.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:51.933+0000 7f4862a00640 1 -- 172.21.15.28:0/2124723319 wait complete. 2024-04-23T18:27:51.945 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-23T18:27:52.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.093+0000 7f9c26c00640 1 Processor -- start 2024-04-23T18:27:52.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.093+0000 7f9c26c00640 1 -- start start 2024-04-23T18:27:52.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.093+0000 7f9c26c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c200c7730 0x7f9c2006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.093+0000 7f9c26c00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2015b1a0 con 0x7f9c200c7b10 2024-04-23T18:27:52.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.093+0000 7f9c26c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c20071fd0 con 0x7f9c200c8240 2024-04-23T18:27:52.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.093+0000 7f9c26c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2015b420 con 0x7f9c200c7730 2024-04-23T18:27:52.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.093+0000 7f9c17400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9c200c7b10 0x7f9c200676e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33614/0 (socket says 172.21.15.28:33614) 2024-04-23T18:27:52.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.093+0000 7f9c17400640 1 -- 172.21.15.28:0/103707825 learned_addr learned my addr 172.21.15.28:0/103707825 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:52.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.093+0000 7f9c1fe00640 1 --2- 172.21.15.28:0/103707825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c200c7730 0x7f9c2006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.097+0000 7f9c1f400640 1 -- 172.21.15.28:0/103707825 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953843255 0 0) 0x7f9c08001120 con 0x7f9c200c7b10 2024-04-23T18:27:52.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.097+0000 7f9c1f400640 1 -- 172.21.15.28:0/103707825 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c04003530 con 0x7f9c200c7b10 2024-04-23T18:27:52.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.097+0000 7f9c1f400640 1 -- 172.21.15.28:0/103707825 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476758512 0 0) 0x7f9c20071fd0 con 0x7f9c200c8240 2024-04-23T18:27:52.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.097+0000 7f9c1f400640 1 -- 172.21.15.28:0/103707825 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c08001120 con 0x7f9c200c8240 2024-04-23T18:27:52.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.097+0000 7f9c1f400640 1 -- 172.21.15.28:0/103707825 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1624100507 0 0) 0x7f9c04003530 con 0x7f9c200c7b10 2024-04-23T18:27:52.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.097+0000 7f9c1fe00640 1 -- 172.21.15.28:0/103707825 >> v1:172.21.15.137:6789/0 conn(0x7f9c200c8240 legacy=0x7f9c20067df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.097+0000 7f9c1fe00640 1 -- 172.21.15.28:0/103707825 >> v1:172.21.15.28:6789/0 conn(0x7f9c200c7b10 legacy=0x7f9c200676e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.097+0000 7f9c1fe00640 1 -- 172.21.15.28:0/103707825 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2015b700 con 0x7f9c200c7730 2024-04-23T18:27:52.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.097+0000 7f9c1fe00640 1 --2- 172.21.15.28:0/103707825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c200c7730 0x7f9c2006f7b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c100097f0 tx=0x7f9c1001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b3404eabb8f738d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.097+0000 7f9c1f400640 1 -- 172.21.15.28:0/103707825 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c100b0070 con 0x7f9c200c7730 2024-04-23T18:27:52.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c1f400640 1 -- 172.21.15.28:0/103707825 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c100ab400 con 0x7f9c200c7730 2024-04-23T18:27:52.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c1f400640 1 -- 172.21.15.28:0/103707825 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08001850 con 0x7f9c200c7730 2024-04-23T18:27:52.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 -- 172.21.15.28:0/103707825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c200c7730 msgr2=0x7f9c2006f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 --2- 172.21.15.28:0/103707825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c200c7730 0x7f9c2006f7b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c100097f0 tx=0x7f9c1001c370 comp rx=0 tx=0).stop 2024-04-23T18:27:52.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 -- 172.21.15.28:0/103707825 shutdown_connections 2024-04-23T18:27:52.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 --2- 172.21.15.28:0/103707825 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c200c7730 0x7f9c2006f7b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 -- 172.21.15.28:0/103707825 >> 172.21.15.28:0/103707825 conn(0x7f9c200cd840 msgr2=0x7f9c200cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:52.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 -- 172.21.15.28:0/103707825 shutdown_connections 2024-04-23T18:27:52.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 -- 172.21.15.28:0/103707825 wait complete. 2024-04-23T18:27:52.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 Processor -- start 2024-04-23T18:27:52.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 -- start start 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c200c7730 0x7f9c20156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c200c7b10 0x7f9c20156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c200c8240 0x7f9c20151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20169560 con 0x7f9c200c8240 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20070100 con 0x7f9c200c7b10 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c26c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9c201696e0 con 0x7f9c200c7730 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c24c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c200c8240 0x7f9c20151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c24c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c200c8240 0x7f9c20151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33212/0 (socket says 172.21.15.28:33212) 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c24c00640 1 -- 172.21.15.28:0/2077084626 learned_addr learned my addr 172.21.15.28:0/2077084626 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c1fe00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c200c7730 0x7f9c20156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c17400640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c200c7b10 0x7f9c20156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c24c00640 1 -- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c200c7730 msgr2=0x7f9c20156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c24c00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c200c7730 0x7f9c20156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c24c00640 1 -- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c200c7b10 msgr2=0x7f9c20156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c24c00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c200c7b10 0x7f9c20156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.101+0000 7f9c24c00640 1 -- 172.21.15.28:0/2077084626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c20154820 con 0x7f9c200c8240 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.105+0000 7f9c24c00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c200c8240 0x7f9c20151390 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c730 tx=0x7f9c1800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.105+0000 7f9c1cc00640 1 -- 172.21.15.28:0/2077084626 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18003b80 con 0x7f9c200c8240 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.105+0000 7f9c1cc00640 1 -- 172.21.15.28:0/2077084626 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c18003d20 con 0x7f9c200c8240 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.105+0000 7f9c1cc00640 1 -- 172.21.15.28:0/2077084626 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800aa30 con 0x7f9c200c8240 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.105+0000 7f9c26c00640 1 -- 172.21.15.28:0/2077084626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c20154ea0 con 0x7f9c200c8240 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.105+0000 7f9c26c00640 1 -- 172.21.15.28:0/2077084626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c20155fd0 con 0x7f9c200c8240 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.105+0000 7f9c26c00640 1 -- 172.21.15.28:0/2077084626 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c20068db0 con 0x7f9c200c8240 2024-04-23T18:27:52.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.105+0000 7f9c1cc00640 1 -- 172.21.15.28:0/2077084626 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9c1800abd0 con 0x7f9c200c8240 2024-04-23T18:27:52.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.105+0000 7f9c1cc00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9bfc0683d0 0x7f9bfc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.105+0000 7f9c1cc00640 1 -- 172.21.15.28:0/2077084626 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9c18086a90 con 0x7f9c200c8240 2024-04-23T18:27:52.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.105+0000 7f9c1fe00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9bfc0683d0 0x7f9bfc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.109+0000 7f9c1fe00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9bfc0683d0 0x7f9bfc06a890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c100ad000 tx=0x7f9c100a6000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.109+0000 7f9c1cc00640 1 -- 172.21.15.28:0/2077084626 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c18056670 con 0x7f9c200c8240 2024-04-23T18:27:52.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.277+0000 7f9c26c00640 1 -- 172.21.15.28:0/2077084626 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f9c200cae80 con 0x7f9bfc0683d0 2024-04-23T18:27:52.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c1cc00640 1 -- 172.21.15.28:0/2077084626 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9c200cae80 con 0x7f9bfc0683d0 2024-04-23T18:27:52.274 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 0 to deep-scrub 2024-04-23T18:27:52.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 -- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9bfc0683d0 msgr2=0x7f9bfc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9bfc0683d0 0x7f9bfc06a890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c100ad000 tx=0x7f9c100a6000 comp rx=0 tx=0).stop 2024-04-23T18:27:52.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 -- 172.21.15.28:0/2077084626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c200c8240 msgr2=0x7f9c20151390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c200c8240 0x7f9c20151390 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c730 tx=0x7f9c1800cbf0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 -- 172.21.15.28:0/2077084626 shutdown_connections 2024-04-23T18:27:52.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9bfc0683d0 0x7f9bfc06a890 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c200c8240 0x7f9c20151390 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c200c7b10 0x7f9c20156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 --2- 172.21.15.28:0/2077084626 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c200c7730 0x7f9c20156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 -- 172.21.15.28:0/2077084626 >> 172.21.15.28:0/2077084626 conn(0x7f9c200cd840 msgr2=0x7f9c20074f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:52.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 -- 172.21.15.28:0/2077084626 shutdown_connections 2024-04-23T18:27:52.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.281+0000 7f9c26c00640 1 -- 172.21.15.28:0/2077084626 wait complete. 2024-04-23T18:27:52.296 INFO:tasks.ceph:Scrubbing osd.1 2024-04-23T18:27:52.296 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:27:52.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f7082e00640 1 Processor -- start 2024-04-23T18:27:52.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f7082e00640 1 -- start start 2024-04-23T18:27:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f7082e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c1594e0 0x7f707c159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f7082e00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707c159e90 con 0x7f707c0cef10 2024-04-23T18:27:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f7082e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707c0c5f70 con 0x7f707c0ceb30 2024-04-23T18:27:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f7082e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f707c073cb0 con 0x7f707c1594e0 2024-04-23T18:27:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707b400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f707c0cef10 0x7f707c14f560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33624/0 (socket says 172.21.15.28:33624) 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707b400640 1 -- 172.21.15.28:0/1292025476 learned_addr learned my addr 172.21.15.28:0/1292025476 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f7080e00640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c1594e0 0x7f707c159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054035900 0 0) 0x7f707c159e90 con 0x7f707c0cef10 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7060003530 con 0x7f707c0cef10 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3241753162 0 0) 0x7f707c0c5f70 con 0x7f707c0ceb30 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f707c159e90 con 0x7f707c0ceb30 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1741270572 0 0) 0x7f7060003530 con 0x7f707c0cef10 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c1594e0 msgr2=0x7f707c159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c1594e0 0x7f707c159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 >> v1:172.21.15.137:6789/0 conn(0x7f707c0ceb30 legacy=0x7f707c0735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c0c6210 con 0x7f707c0cef10 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f7068001680 con 0x7f707c0cef10 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 >> v1:172.21.15.28:6789/0 conn(0x7f707c0cef10 legacy=0x7f707c14f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7060003b80 0x7f7060003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c1594e0 0x7f7060004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7060004d50 0x7f70600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f707c073cb0 con 0x7f7060003b80 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f706000ba80 con 0x7f7060004d50 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f706000bc30 con 0x7f707c1594e0 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707be00640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7060003b80 0x7f7060003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707b400640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c1594e0 0x7f7060004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f7080e00640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7060004d50 0x7f70600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707be00640 1 -- 172.21.15.28:0/1292025476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c1594e0 msgr2=0x7f7060004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707be00640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c1594e0 0x7f7060004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707be00640 1 -- 172.21.15.28:0/1292025476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7060004d50 msgr2=0x7f70600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707be00640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7060004d50 0x7f70600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.449+0000 7f707be00640 1 -- 172.21.15.28:0/1292025476 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7060003530 con 0x7f7060003b80 2024-04-23T18:27:52.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.453+0000 7f707be00640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7060003b80 0x7f7060003f80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f706c0018d0 tx=0x7f706c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32024b42a12d7f51 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.453+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c001520 con 0x7f7060003b80 2024-04-23T18:27:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.453+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f706c0052f0 con 0x7f7060003b80 2024-04-23T18:27:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.453+0000 7f707aa00640 1 -- 172.21.15.28:0/1292025476 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c0a8950 con 0x7f7060003b80 2024-04-23T18:27:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.453+0000 7f7082e00640 1 -- 172.21.15.28:0/1292025476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7060003b80 msgr2=0x7f7060003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.453+0000 7f7082e00640 1 --2- 172.21.15.28:0/1292025476 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7060003b80 0x7f7060003f80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f706c0018d0 tx=0x7f706c01ecf0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.453+0000 7f7080e00640 1 -- 172.21.15.28:0/1292025476 reap_dead start 2024-04-23T18:27:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.453+0000 7f7082e00640 1 -- 172.21.15.28:0/1292025476 shutdown_connections 2024-04-23T18:27:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.453+0000 7f7082e00640 1 -- 172.21.15.28:0/1292025476 >> 172.21.15.28:0/1292025476 conn(0x7f707c0676e0 msgr2=0x7f707c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.453+0000 7f7082e00640 1 -- 172.21.15.28:0/1292025476 shutdown_connections 2024-04-23T18:27:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.453+0000 7f7082e00640 1 -- 172.21.15.28:0/1292025476 wait complete. 2024-04-23T18:27:52.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7082e00640 1 Processor -- start 2024-04-23T18:27:52.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7082e00640 1 -- start start 2024-04-23T18:27:52.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7082e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7060003b80 0x7f707c14d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7082e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f707c0cc760 0x7f707c144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7082e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c06d3b0 0x7f707c1454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7082e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f707c0c6ab0 con 0x7f7060003b80 2024-04-23T18:27:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7082e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f707c0c67d0 con 0x7f707c0cc760 2024-04-23T18:27:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7082e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f707c158f90 con 0x7f707c06d3b0 2024-04-23T18:27:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f707be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7060003b80 0x7f707c14d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f707be00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7060003b80 0x7f707c14d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33238/0 (socket says 172.21.15.28:33238) 2024-04-23T18:27:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f707be00640 1 -- 172.21.15.28:0/690557402 learned_addr learned my addr 172.21.15.28:0/690557402 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7080e00640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c06d3b0 0x7f707c1454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f707b400640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f707c0cc760 0x7f707c144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f707be00640 1 -- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c06d3b0 msgr2=0x7f707c1454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f707be00640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f707c06d3b0 0x7f707c1454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f707be00640 1 -- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f707c0cc760 msgr2=0x7f707c144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f707be00640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f707c0cc760 0x7f707c144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f707be00640 1 -- 172.21.15.28:0/690557402 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c0ccc70 con 0x7f7060003b80 2024-04-23T18:27:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f707b400640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f707c0cc760 0x7f707c144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f707be00640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7060003b80 0x7f707c14d5f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f706c005040 tx=0x7f7060005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7073e00640 1 -- 172.21.15.28:0/690557402 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c0054a0 con 0x7f7060003b80 2024-04-23T18:27:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7073e00640 1 -- 172.21.15.28:0/690557402 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f706c0bf070 con 0x7f7060003b80 2024-04-23T18:27:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7073e00640 1 -- 172.21.15.28:0/690557402 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c001500 con 0x7f7060003b80 2024-04-23T18:27:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7082e00640 1 -- 172.21.15.28:0/690557402 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707c0cd6a0 con 0x7f7060003b80 2024-04-23T18:27:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.457+0000 7f7082e00640 1 -- 172.21.15.28:0/690557402 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f707c0cdc60 con 0x7f7060003b80 2024-04-23T18:27:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.461+0000 7f7082e00640 1 -- 172.21.15.28:0/690557402 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f707c1470e0 con 0x7f7060003b80 2024-04-23T18:27:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.461+0000 7f7073e00640 1 -- 172.21.15.28:0/690557402 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f706c003600 con 0x7f7060003b80 2024-04-23T18:27:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.461+0000 7f7073e00640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f705c0683b0 0x7f705c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.461+0000 7f7073e00640 1 -- 172.21.15.28:0/690557402 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f706c1251d0 con 0x7f7060003b80 2024-04-23T18:27:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.461+0000 7f7073e00640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] conn(0x7f705c071dd0 0x7f705c074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.461+0000 7f7073e00640 1 -- 172.21.15.28:0/690557402 --> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f706c0052f0 con 0x7f705c071dd0 2024-04-23T18:27:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.461+0000 7f7073e00640 1 -- 172.21.15.28:0/690557402 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f706c125580 con 0x7f7060003b80 2024-04-23T18:27:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.461+0000 7f707b400640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f705c0683b0 0x7f705c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.461+0000 7f7080e00640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] conn(0x7f705c071dd0 0x7f705c074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.461+0000 7f7080e00640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] conn(0x7f705c071dd0 0x7f705c074270 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.461+0000 7f707b400640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f705c0683b0 0x7f705c06a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f707c06d340 tx=0x7f7068009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.465+0000 7f7073e00640 1 -- 172.21.15.28:0/690557402 <== osd.1 v2:172.21.15.28:6808/3900609679 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f706c0052f0 con 0x7f705c071dd0 2024-04-23T18:27:52.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7082e00640 1 -- 172.21.15.28:0/690557402 --> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f707c068e50 con 0x7f705c071dd0 2024-04-23T18:27:52.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7073e00640 1 -- 172.21.15.28:0/690557402 <== osd.1 v2:172.21.15.28:6808/3900609679 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f707c068e50 con 0x7f705c071dd0 2024-04-23T18:27:52.472 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:27:52.472 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:27:52.472 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:27:52.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7082e00640 1 -- 172.21.15.28:0/690557402 >> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] conn(0x7f705c071dd0 msgr2=0x7f705c074270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7082e00640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.28:6808/3900609679,v1:172.21.15.28:6809/3900609679] conn(0x7f705c071dd0 0x7f705c074270 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7082e00640 1 -- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f705c0683b0 msgr2=0x7f705c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7082e00640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f705c0683b0 0x7f705c06a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f707c06d340 tx=0x7f7068009040 comp rx=0 tx=0).stop 2024-04-23T18:27:52.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7082e00640 1 -- 172.21.15.28:0/690557402 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7060003b80 msgr2=0x7f707c14d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7082e00640 1 --2- 172.21.15.28:0/690557402 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7060003b80 0x7f707c14d5f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f706c005040 tx=0x7f7060005840 comp rx=0 tx=0).stop 2024-04-23T18:27:52.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7080e00640 1 -- 172.21.15.28:0/690557402 reap_dead start 2024-04-23T18:27:52.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7082e00640 1 -- 172.21.15.28:0/690557402 shutdown_connections 2024-04-23T18:27:52.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7082e00640 1 -- 172.21.15.28:0/690557402 >> 172.21.15.28:0/690557402 conn(0x7f707c0676e0 msgr2=0x7f707c157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:52.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7082e00640 1 -- 172.21.15.28:0/690557402 shutdown_connections 2024-04-23T18:27:52.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.477+0000 7f7082e00640 1 -- 172.21.15.28:0/690557402 wait complete. 2024-04-23T18:27:52.490 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-23T18:27:52.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.637+0000 7f2abb800640 1 Processor -- start 2024-04-23T18:27:52.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.637+0000 7f2abb800640 1 -- start start 2024-04-23T18:27:52.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.637+0000 7f2abb800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ab40c87f0 0x7f2ab415f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.637+0000 7f2abb800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab415b4a0 con 0x7f2ab406ea00 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.637+0000 7f2abb800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab415b740 con 0x7f2ab415cb50 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.637+0000 7f2abb800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2ab415f7c0 con 0x7f2ab40c87f0 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.637+0000 7f2ab9800640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2ab406ea00 0x7f2ab406ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33628/0 (socket says 172.21.15.28:33628) 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.637+0000 7f2ab9800640 1 -- 172.21.15.28:0/2270997434 learned_addr learned my addr 172.21.15.28:0/2270997434 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.637+0000 7f2ab8e00640 1 --2- 172.21.15.28:0/2270997434 >> v2:172.21.15.137:3300/0 conn(0x7f2ab40c87f0 0x7f2ab415f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.641+0000 7f2ab3e00640 1 -- 172.21.15.28:0/2270997434 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266112947 0 0) 0x7f2ab415b4a0 con 0x7f2ab406ea00 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.641+0000 7f2ab3e00640 1 -- 172.21.15.28:0/2270997434 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a98003530 con 0x7f2ab406ea00 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.641+0000 7f2ab3e00640 1 -- 172.21.15.28:0/2270997434 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3058034340 0 0) 0x7f2a98003530 con 0x7f2ab406ea00 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.641+0000 7f2ab8e00640 1 -- 172.21.15.28:0/2270997434 >> v1:172.21.15.137:6789/0 conn(0x7f2ab415cb50 legacy=0x7f2ab415cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.641+0000 7f2ab8e00640 1 -- 172.21.15.28:0/2270997434 >> v1:172.21.15.28:6789/0 conn(0x7f2ab406ea00 legacy=0x7f2ab406ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.641+0000 7f2ab8e00640 1 -- 172.21.15.28:0/2270997434 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab415ba20 con 0x7f2ab40c87f0 2024-04-23T18:27:52.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.641+0000 7f2ab8e00640 1 --2- 172.21.15.28:0/2270997434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab40c87f0 0x7f2ab415f280 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7f0712e956f42fd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.641+0000 7f2ab3e00640 1 -- 172.21.15.28:0/2270997434 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40b5070 con 0x7f2ab40c87f0 2024-04-23T18:27:52.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.641+0000 7f2ab3e00640 1 -- 172.21.15.28:0/2270997434 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa40a8630 con 0x7f2ab40c87f0 2024-04-23T18:27:52.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.641+0000 7f2ab3e00640 1 -- 172.21.15.28:0/2270997434 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac001a20 con 0x7f2ab40c87f0 2024-04-23T18:27:52.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 -- 172.21.15.28:0/2270997434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab40c87f0 msgr2=0x7f2ab415f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 --2- 172.21.15.28:0/2270997434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab40c87f0 0x7f2ab415f280 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401ebb0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 -- 172.21.15.28:0/2270997434 shutdown_connections 2024-04-23T18:27:52.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 --2- 172.21.15.28:0/2270997434 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab40c87f0 0x7f2ab415f280 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 -- 172.21.15.28:0/2270997434 >> 172.21.15.28:0/2270997434 conn(0x7f2ab4072f30 msgr2=0x7f2ab4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:52.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 -- 172.21.15.28:0/2270997434 shutdown_connections 2024-04-23T18:27:52.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 -- 172.21.15.28:0/2270997434 wait complete. 2024-04-23T18:27:52.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 Processor -- start 2024-04-23T18:27:52.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 -- start start 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab406ea00 0x7f2ab40ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab40c87f0 0x7f2ab4151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab415cb50 0x7f2ab41e4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab40c8bd0 con 0x7f2ab406ea00 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab415bfe0 con 0x7f2ab40c87f0 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2abb800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab40c8d50 con 0x7f2ab415cb50 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2ab8e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab406ea00 0x7f2ab40ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2ab8e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab406ea00 0x7f2ab40ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33250/0 (socket says 172.21.15.28:33250) 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2ab8e00640 1 -- 172.21.15.28:0/1143377107 learned_addr learned my addr 172.21.15.28:0/1143377107 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2ab9800640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab415cb50 0x7f2ab41e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.645+0000 7f2aabe00640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab40c87f0 0x7f2ab4151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab8e00640 1 -- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab415cb50 msgr2=0x7f2ab41e4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab8e00640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab415cb50 0x7f2ab41e4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab8e00640 1 -- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab40c87f0 msgr2=0x7f2ab4151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab8e00640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab40c87f0 0x7f2ab4151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab8e00640 1 -- 172.21.15.28:0/1143377107 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab40c6f60 con 0x7f2ab406ea00 2024-04-23T18:27:52.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab8e00640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab406ea00 0x7f2ab40ce990 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2aa401b7c0 tx=0x7f2aa401b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab1600640 1 -- 172.21.15.28:0/1143377107 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40b5040 con 0x7f2ab406ea00 2024-04-23T18:27:52.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab1600640 1 -- 172.21.15.28:0/1143377107 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa40a98f0 con 0x7f2ab406ea00 2024-04-23T18:27:52.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab1600640 1 -- 172.21.15.28:0/1143377107 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40a9ca0 con 0x7f2ab406ea00 2024-04-23T18:27:52.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2abb800640 1 -- 172.21.15.28:0/1143377107 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab40cd8f0 con 0x7f2ab406ea00 2024-04-23T18:27:52.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2abb800640 1 -- 172.21.15.28:0/1143377107 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab40cdeb0 con 0x7f2ab406ea00 2024-04-23T18:27:52.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2abb800640 1 -- 172.21.15.28:0/1143377107 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab4068db0 con 0x7f2ab406ea00 2024-04-23T18:27:52.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab1600640 1 -- 172.21.15.28:0/1143377107 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2aa40c2030 con 0x7f2ab406ea00 2024-04-23T18:27:52.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab1600640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a90068380 0x7f2a9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2ab1600640 1 -- 172.21.15.28:0/1143377107 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2aa4123980 con 0x7f2ab406ea00 2024-04-23T18:27:52.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.649+0000 7f2aabe00640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a90068380 0x7f2a9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.653+0000 7f2aabe00640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a90068380 0x7f2a9006a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ab41f1f90 tx=0x7f2a9c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.653+0000 7f2ab1600640 1 -- 172.21.15.28:0/1143377107 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2aa40c9020 con 0x7f2ab406ea00 2024-04-23T18:27:52.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.821+0000 7f2abb800640 1 -- 172.21.15.28:0/1143377107 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f2ab40cd6a0 con 0x7f2a90068380 2024-04-23T18:27:52.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.821+0000 7f2ab1600640 1 -- 172.21.15.28:0/1143377107 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2ab40cd6a0 con 0x7f2a90068380 2024-04-23T18:27:52.816 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 1 to deep-scrub 2024-04-23T18:27:52.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.821+0000 7f2abb800640 1 -- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a90068380 msgr2=0x7f2a9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.821+0000 7f2abb800640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a90068380 0x7f2a9006a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ab41f1f90 tx=0x7f2a9c009040 comp rx=0 tx=0).stop 2024-04-23T18:27:52.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.821+0000 7f2abb800640 1 -- 172.21.15.28:0/1143377107 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab406ea00 msgr2=0x7f2ab40ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.821+0000 7f2abb800640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab406ea00 0x7f2ab40ce990 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2aa401b7c0 tx=0x7f2aa401b950 comp rx=0 tx=0).stop 2024-04-23T18:27:52.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.825+0000 7f2abb800640 1 -- 172.21.15.28:0/1143377107 shutdown_connections 2024-04-23T18:27:52.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.825+0000 7f2abb800640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f2a90068380 0x7f2a9006a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.825+0000 7f2abb800640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2ab415cb50 0x7f2ab41e4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.825+0000 7f2abb800640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ab40c87f0 0x7f2ab4151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.825+0000 7f2abb800640 1 --2- 172.21.15.28:0/1143377107 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ab406ea00 0x7f2ab40ce990 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.825+0000 7f2abb800640 1 -- 172.21.15.28:0/1143377107 >> 172.21.15.28:0/1143377107 conn(0x7f2ab4072f30 msgr2=0x7f2ab40c5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:52.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.825+0000 7f2abb800640 1 -- 172.21.15.28:0/1143377107 shutdown_connections 2024-04-23T18:27:52.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.825+0000 7f2abb800640 1 -- 172.21.15.28:0/1143377107 wait complete. 2024-04-23T18:27:52.838 INFO:tasks.ceph:Scrubbing osd.2 2024-04-23T18:27:52.838 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:27:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e9c600640 1 Processor -- start 2024-04-23T18:27:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e9c600640 1 -- start start 2024-04-23T18:27:52.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e9c600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3e94073220 0x7f3e940c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e9c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e94141d50 0x7f3e941421a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e9c600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e94158ff0 con 0x7f3e94073600 2024-04-23T18:27:52.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e9c600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3e941426e0 con 0x7f3e94073220 2024-04-23T18:27:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e9c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9406f770 con 0x7f3e94141d50 2024-04-23T18:27:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e99200640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3e94073600 0x7f3e9406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33632/0 (socket says 172.21.15.28:33632) 2024-04-23T18:27:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e99200640 1 -- 172.21.15.28:0/26267326 learned_addr learned my addr 172.21.15.28:0/26267326 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e9a600640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e94141d50 0x7f3e941421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e99c00640 1 --2- 172.21.15.28:0/26267326 >> v2:172.21.15.137:3300/0 conn(0x7f3e94073220 0x7f3e940c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481202814 0 0) 0x7f3e94158ff0 con 0x7f3e94073600 2024-04-23T18:27:52.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.989+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e7c003530 con 0x7f3e94073600 2024-04-23T18:27:52.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3561184089 0 0) 0x7f3e7c003530 con 0x7f3e94073600 2024-04-23T18:27:52.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e94141d50 msgr2=0x7f3e941421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:52.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e94141d50 0x7f3e941421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 >> v2:172.21.15.137:3300/0 conn(0x7f3e94073220 msgr2=0x7f3e940c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:52.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 --2- 172.21.15.28:0/26267326 >> v2:172.21.15.137:3300/0 conn(0x7f3e94073220 0x7f3e940c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e940c5f20 con 0x7f3e94073600 2024-04-23T18:27:52.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f3e80001680 con 0x7f3e94073600 2024-04-23T18:27:52.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 >> v1:172.21.15.28:6789/0 conn(0x7f3e94073600 legacy=0x7f3e9406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e7c0039c0 0x7f3e7c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e94141d50 0x7f3e7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e7c004d50 0x7f3e7c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e941426e0 con 0x7f3e7c004d50 2024-04-23T18:27:52.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9406f770 con 0x7f3e7c0039c0 2024-04-23T18:27:52.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7c00b9d0 con 0x7f3e94141d50 2024-04-23T18:27:52.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e9a600640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e7c004d50 0x7f3e7c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e99c00640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e7c0039c0 0x7f3e7c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e99200640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e94141d50 0x7f3e7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e9a600640 1 -- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e94141d50 msgr2=0x7f3e7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:52.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e9a600640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e94141d50 0x7f3e7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e9a600640 1 -- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e7c0039c0 msgr2=0x7f3e7c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:52.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e9a600640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e7c0039c0 0x7f3e7c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e9a600640 1 -- 172.21.15.28:0/26267326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c003530 con 0x7f3e7c004d50 2024-04-23T18:27:52.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e99c00640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e7c0039c0 0x7f3e7c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:52.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e9a600640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e7c004d50 0x7f3e7c0051d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009fc0 tx=0x7f3e8c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273144d80a7919f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c0b2070 con 0x7f3e7c004d50 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8c0a5c90 con 0x7f3e7c004d50 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.993+0000 7f3e93e00640 1 -- 172.21.15.28:0/26267326 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c009c10 con 0x7f3e7c004d50 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 -- 172.21.15.28:0/26267326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e7c004d50 msgr2=0x7f3e7c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 --2- 172.21.15.28:0/26267326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e7c004d50 0x7f3e7c0051d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009fc0 tx=0x7f3e8c01cc80 comp rx=0 tx=0).stop 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9a600640 1 -- 172.21.15.28:0/26267326 reap_dead start 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 -- 172.21.15.28:0/26267326 shutdown_connections 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 -- 172.21.15.28:0/26267326 >> 172.21.15.28:0/26267326 conn(0x7f3e9406d400 msgr2=0x7f3e940676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 -- 172.21.15.28:0/26267326 shutdown_connections 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 -- 172.21.15.28:0/26267326 wait complete. 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 Processor -- start 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 -- start start 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e7c004d50 0x7f3e941e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e941e37c0 0x7f3e9413b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e941df560 0x7f3e941df9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940c67c0 con 0x7f3e7c004d50 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940c64e0 con 0x7f3e941df560 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f3e940c6aa0 con 0x7f3e941e37c0 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e99c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e7c004d50 0x7f3e941e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e99c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e7c004d50 0x7f3e941e6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33260/0 (socket says 172.21.15.28:33260) 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e99c00640 1 -- 172.21.15.28:0/1127394719 learned_addr learned my addr 172.21.15.28:0/1127394719 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e99200640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e941e37c0 0x7f3e9413b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9a600640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e941df560 0x7f3e941df9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e99c00640 1 -- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e941e37c0 msgr2=0x7f3e9413b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e99c00640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e941e37c0 0x7f3e9413b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e99c00640 1 -- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e941df560 msgr2=0x7f3e941df9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:52.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e99c00640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e941df560 0x7f3e941df9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:52.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e99c00640 1 -- 172.21.15.28:0/1127394719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e941e3c70 con 0x7f3e7c004d50 2024-04-23T18:27:52.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:52.997+0000 7f3e9a600640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e941df560 0x7f3e941df9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:27:52.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e99c00640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e7c004d50 0x7f3e941e6150 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3e88011560 tx=0x7f3e88011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:52.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e91600640 1 -- 172.21.15.28:0/1127394719 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88004220 con 0x7f3e7c004d50 2024-04-23T18:27:52.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e91600640 1 -- 172.21.15.28:0/1127394719 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e880043c0 con 0x7f3e7c004d50 2024-04-23T18:27:52.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e91600640 1 -- 172.21.15.28:0/1127394719 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88015870 con 0x7f3e7c004d50 2024-04-23T18:27:52.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e9c600640 1 -- 172.21.15.28:0/1127394719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e941e3f10 con 0x7f3e7c004d50 2024-04-23T18:27:52.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e9c600640 1 -- 172.21.15.28:0/1127394719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e941e44d0 con 0x7f3e7c004d50 2024-04-23T18:27:52.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e9c600640 1 -- 172.21.15.28:0/1127394719 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e94068e50 con 0x7f3e7c004d50 2024-04-23T18:27:52.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e91600640 1 -- 172.21.15.28:0/1127394719 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e88015a10 con 0x7f3e7c004d50 2024-04-23T18:27:53.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e91600640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3e740683b0 0x7f3e7406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e91600640 1 -- 172.21.15.28:0/1127394719 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3e88087a50 con 0x7f3e7c004d50 2024-04-23T18:27:53.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e91600640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] conn(0x7f3e74071dc0 0x7f3e74074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e91600640 1 -- 172.21.15.28:0/1127394719 --> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e74074930 con 0x7f3e74071dc0 2024-04-23T18:27:53.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e91600640 1 -- 172.21.15.28:0/1127394719 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3e88087e00 con 0x7f3e7c004d50 2024-04-23T18:27:53.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e99200640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3e740683b0 0x7f3e7406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.001+0000 7f3e9a600640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] conn(0x7f3e74071dc0 0x7f3e74074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.005+0000 7f3e9a600640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] conn(0x7f3e74071dc0 0x7f3e74074260 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.005+0000 7f3e99200640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3e740683b0 0x7f3e7406a870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3e94158910 tx=0x7f3e80001460 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.005+0000 7f3e91600640 1 -- 172.21.15.28:0/1127394719 <== osd.2 v2:172.21.15.28:6824/769511597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e74074930 con 0x7f3e74071dc0 2024-04-23T18:27:53.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9c600640 1 -- 172.21.15.28:0/1127394719 --> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3e940c4a80 con 0x7f3e74071dc0 2024-04-23T18:27:53.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e91600640 1 -- 172.21.15.28:0/1127394719 <== osd.2 v2:172.21.15.28:6824/769511597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3e940c4a80 con 0x7f3e74071dc0 2024-04-23T18:27:53.014 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:27:53.014 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:27:53.014 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:27:53.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9c600640 1 -- 172.21.15.28:0/1127394719 >> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] conn(0x7f3e74071dc0 msgr2=0x7f3e74074260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9c600640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.28:6824/769511597,v1:172.21.15.28:6825/769511597] conn(0x7f3e74071dc0 0x7f3e74074260 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9c600640 1 -- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3e740683b0 msgr2=0x7f3e7406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9c600640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f3e740683b0 0x7f3e7406a870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3e94158910 tx=0x7f3e80001460 comp rx=0 tx=0).stop 2024-04-23T18:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9c600640 1 -- 172.21.15.28:0/1127394719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e7c004d50 msgr2=0x7f3e941e6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9c600640 1 --2- 172.21.15.28:0/1127394719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3e7c004d50 0x7f3e941e6150 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3e88011560 tx=0x7f3e88011a20 comp rx=0 tx=0).stop 2024-04-23T18:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9a600640 1 -- 172.21.15.28:0/1127394719 reap_dead start 2024-04-23T18:27:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9c600640 1 -- 172.21.15.28:0/1127394719 shutdown_connections 2024-04-23T18:27:53.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9c600640 1 -- 172.21.15.28:0/1127394719 >> 172.21.15.28:0/1127394719 conn(0x7f3e9406d400 msgr2=0x7f3e941594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:53.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9c600640 1 -- 172.21.15.28:0/1127394719 shutdown_connections 2024-04-23T18:27:53.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.017+0000 7f3e9c600640 1 -- 172.21.15.28:0/1127394719 wait complete. 2024-04-23T18:27:53.032 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-23T18:27:53.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e9000640 1 Processor -- start 2024-04-23T18:27:53.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e9000640 1 -- start start 2024-04-23T18:27:53.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e9000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f92e406f9b0 0x7f92e406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e9000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e415b290 con 0x7f92e40c7900 2024-04-23T18:27:53.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e9000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e40c8ad0 con 0x7f92e4071de0 2024-04-23T18:27:53.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e9000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f92e40c8db0 con 0x7f92e406f9b0 2024-04-23T18:27:53.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e1e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f92e40c7900 0x7f92e40c8240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33644/0 (socket says 172.21.15.28:33644) 2024-04-23T18:27:53.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e1e00640 1 -- 172.21.15.28:0/2907862072 learned_addr learned my addr 172.21.15.28:0/2907862072 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:53.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e2800640 1 --2- 172.21.15.28:0/2907862072 >> v2:172.21.15.137:3300/0 conn(0x7f92e406f9b0 0x7f92e406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e1400640 1 -- 172.21.15.28:0/2907862072 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044044949 0 0) 0x7f92e415b290 con 0x7f92e40c7900 2024-04-23T18:27:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e1400640 1 -- 172.21.15.28:0/2907862072 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92c8003530 con 0x7f92e40c7900 2024-04-23T18:27:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e2800640 1 -- 172.21.15.28:0/2907862072 >> v1:172.21.15.137:6789/0 conn(0x7f92e4071de0 legacy=0x7f92e415e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e2800640 1 -- 172.21.15.28:0/2907862072 >> v1:172.21.15.28:6789/0 conn(0x7f92e40c7900 legacy=0x7f92e40c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.181+0000 7f92e2800640 1 -- 172.21.15.28:0/2907862072 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e415b550 con 0x7f92e406f9b0 2024-04-23T18:27:53.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.185+0000 7f92e2800640 1 --2- 172.21.15.28:0/2907862072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92e406f9b0 0x7f92e406fde0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009d90 tx=0x7f92dc01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d38f8d8f9d04f89 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.185+0000 7f92e1400640 1 -- 172.21.15.28:0/2907862072 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0b4070 con 0x7f92e406f9b0 2024-04-23T18:27:53.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.185+0000 7f92e1400640 1 -- 172.21.15.28:0/2907862072 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92dc0af600 con 0x7f92e406f9b0 2024-04-23T18:27:53.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.185+0000 7f92e1400640 1 -- 172.21.15.28:0/2907862072 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0af9b0 con 0x7f92e406f9b0 2024-04-23T18:27:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.185+0000 7f92e9000640 1 -- 172.21.15.28:0/2907862072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92e406f9b0 msgr2=0x7f92e406fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.185+0000 7f92e9000640 1 --2- 172.21.15.28:0/2907862072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92e406f9b0 0x7f92e406fde0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009d90 tx=0x7f92dc01f150 comp rx=0 tx=0).stop 2024-04-23T18:27:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.185+0000 7f92e9000640 1 -- 172.21.15.28:0/2907862072 shutdown_connections 2024-04-23T18:27:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.185+0000 7f92e9000640 1 --2- 172.21.15.28:0/2907862072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92e406f9b0 0x7f92e406fde0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.185+0000 7f92e9000640 1 -- 172.21.15.28:0/2907862072 >> 172.21.15.28:0/2907862072 conn(0x7f92e406b9e0 msgr2=0x7f92e406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.185+0000 7f92e9000640 1 -- 172.21.15.28:0/2907862072 shutdown_connections 2024-04-23T18:27:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.185+0000 7f92e9000640 1 -- 172.21.15.28:0/2907862072 wait complete. 2024-04-23T18:27:53.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e9000640 1 Processor -- start 2024-04-23T18:27:53.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e9000640 1 -- start start 2024-04-23T18:27:53.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92e406f9b0 0x7f92e40c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e9000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92e4071de0 0x7f92e414b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e9000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92e40c7900 0x7f92e415eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e9000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92e40c7ce0 con 0x7f92e40c7900 2024-04-23T18:27:53.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e9000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f92e415bb10 con 0x7f92e406f9b0 2024-04-23T18:27:53.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e9000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f92e40caba0 con 0x7f92e4071de0 2024-04-23T18:27:53.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e2800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92e40c7900 0x7f92e415eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e2800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92e40c7900 0x7f92e415eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33268/0 (socket says 172.21.15.28:33268) 2024-04-23T18:27:53.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e2800640 1 -- 172.21.15.28:0/1175519530 learned_addr learned my addr 172.21.15.28:0/1175519530 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:53.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92dbe00640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92e4071de0 0x7f92e414b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e1e00640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92e406f9b0 0x7f92e40c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e2800640 1 -- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92e4071de0 msgr2=0x7f92e414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e2800640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92e4071de0 0x7f92e414b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e2800640 1 -- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92e406f9b0 msgr2=0x7f92e40c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e2800640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92e406f9b0 0x7f92e40c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e2800640 1 -- 172.21.15.28:0/1175519530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e414bae0 con 0x7f92e40c7900 2024-04-23T18:27:53.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e2800640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92e40c7900 0x7f92e415eca0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009d90 tx=0x7f92dc01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92da000640 1 -- 172.21.15.28:0/1175519530 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0b4040 con 0x7f92e40c7900 2024-04-23T18:27:53.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92da000640 1 -- 172.21.15.28:0/1175519530 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92dc0039a0 con 0x7f92e40c7900 2024-04-23T18:27:53.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92da000640 1 -- 172.21.15.28:0/1175519530 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc009450 con 0x7f92e40c7900 2024-04-23T18:27:53.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e9000640 1 -- 172.21.15.28:0/1175519530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e415d070 con 0x7f92e40c7900 2024-04-23T18:27:53.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.189+0000 7f92e9000640 1 -- 172.21.15.28:0/1175519530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e40c6040 con 0x7f92e40c7900 2024-04-23T18:27:53.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.193+0000 7f92e9000640 1 -- 172.21.15.28:0/1175519530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e4068db0 con 0x7f92e40c7900 2024-04-23T18:27:53.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.193+0000 7f92da000640 1 -- 172.21.15.28:0/1175519530 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f92dc0c4060 con 0x7f92e40c7900 2024-04-23T18:27:53.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.193+0000 7f92da000640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f92c0068380 0x7f92c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.193+0000 7f92da000640 1 -- 172.21.15.28:0/1175519530 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f92dc124800 con 0x7f92e40c7900 2024-04-23T18:27:53.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.193+0000 7f92e1e00640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f92c0068380 0x7f92c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.193+0000 7f92e1e00640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f92c0068380 0x7f92c006a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f92d40011f0 tx=0x7f92d4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.201+0000 7f92da000640 1 -- 172.21.15.28:0/1175519530 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f92dc018cb0 con 0x7f92e40c7900 2024-04-23T18:27:53.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.361+0000 7f92e9000640 1 -- 172.21.15.28:0/1175519530 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f92e415e740 con 0x7f92c0068380 2024-04-23T18:27:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.361+0000 7f92da000640 1 -- 172.21.15.28:0/1175519530 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f92d4001cf0 con 0x7f92c0068380 2024-04-23T18:27:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 2 to deep-scrub 2024-04-23T18:27:53.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 -- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f92c0068380 msgr2=0x7f92c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f92c0068380 0x7f92c006a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f92d40011f0 tx=0x7f92d4009040 comp rx=0 tx=0).stop 2024-04-23T18:27:53.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 -- 172.21.15.28:0/1175519530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92e40c7900 msgr2=0x7f92e415eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92e40c7900 0x7f92e415eca0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009d90 tx=0x7f92dc01bef0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 -- 172.21.15.28:0/1175519530 shutdown_connections 2024-04-23T18:27:53.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f92c0068380 0x7f92c006a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92e4071de0 0x7f92e414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f92e40c7900 0x7f92e415eca0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 --2- 172.21.15.28:0/1175519530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92e406f9b0 0x7f92e40c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 -- 172.21.15.28:0/1175519530 >> 172.21.15.28:0/1175519530 conn(0x7f92e406b9e0 msgr2=0x7f92e40cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:53.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 -- 172.21.15.28:0/1175519530 shutdown_connections 2024-04-23T18:27:53.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.365+0000 7f92e9000640 1 -- 172.21.15.28:0/1175519530 wait complete. 2024-04-23T18:27:53.382 INFO:tasks.ceph:Scrubbing osd.3 2024-04-23T18:27:53.383 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:27:53.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.533+0000 7f82cca00640 1 Processor -- start 2024-04-23T18:27:53.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.533+0000 7f82cca00640 1 -- start start 2024-04-23T18:27:53.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.533+0000 7f82cca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82c8073220 0x7f82c80c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.533+0000 7f82cca00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f82c8073600 0x7f82c806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.533+0000 7f82cca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f82c806f5a0 0x7f82c8141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82cca00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f82c8158ff0 con 0x7f82c8073600 2024-04-23T18:27:53.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82cca00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f82c80c5f20 con 0x7f82c806f5a0 2024-04-23T18:27:53.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82cca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f82c80c6200 con 0x7f82c8073220 2024-04-23T18:27:53.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82bd400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f82c8073600 0x7f82c806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82bd400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f82c8073600 0x7f82c806f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33284/0 (socket says 172.21.15.28:33284) 2024-04-23T18:27:53.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82bd400640 1 -- 172.21.15.28:0/3738662364 learned_addr learned my addr 172.21.15.28:0/3738662364 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:53.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82c5e00640 1 --2- 172.21.15.28:0/3738662364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82c8073220 0x7f82c80c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82c6800640 1 --2- 172.21.15.28:0/3738662364 >> v2:172.21.15.137:3300/0 conn(0x7f82c806f5a0 0x7f82c8141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82bd400640 1 -- 172.21.15.28:0/3738662364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82c8073220 msgr2=0x7f82c80c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:53.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82bd400640 1 --2- 172.21.15.28:0/3738662364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82c8073220 0x7f82c80c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82bd400640 1 -- 172.21.15.28:0/3738662364 >> v2:172.21.15.137:3300/0 conn(0x7f82c806f5a0 msgr2=0x7f82c8141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:53.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82bd400640 1 --2- 172.21.15.28:0/3738662364 >> v2:172.21.15.137:3300/0 conn(0x7f82c806f5a0 0x7f82c8141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82bd400640 1 -- 172.21.15.28:0/3738662364 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c80c64e0 con 0x7f82c8073600 2024-04-23T18:27:53.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82bd400640 1 --2- 172.21.15.28:0/3738662364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82c8073600 0x7f82c806f060 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f82c80ca4e0 tx=0x7f82b001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253a19377db35a07 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82c5400640 1 -- 172.21.15.28:0/3738662364 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b00aa610 con 0x7f82c8073600 2024-04-23T18:27:53.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82c5400640 1 -- 172.21.15.28:0/3738662364 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b00af070 con 0x7f82c8073600 2024-04-23T18:27:53.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.537+0000 7f82c5400640 1 -- 172.21.15.28:0/3738662364 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b00aa9d0 con 0x7f82c8073600 2024-04-23T18:27:53.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 -- 172.21.15.28:0/3738662364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82c8073600 msgr2=0x7f82c806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 --2- 172.21.15.28:0/3738662364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82c8073600 0x7f82c806f060 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f82c80ca4e0 tx=0x7f82b001c4f0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 -- 172.21.15.28:0/3738662364 shutdown_connections 2024-04-23T18:27:53.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 --2- 172.21.15.28:0/3738662364 >> v2:172.21.15.137:3300/0 conn(0x7f82c806f5a0 0x7f82c8141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 --2- 172.21.15.28:0/3738662364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82c8073600 0x7f82c806f060 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 --2- 172.21.15.28:0/3738662364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82c8073220 0x7f82c80c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 -- 172.21.15.28:0/3738662364 >> 172.21.15.28:0/3738662364 conn(0x7f82c806d400 msgr2=0x7f82c80676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:53.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 -- 172.21.15.28:0/3738662364 shutdown_connections 2024-04-23T18:27:53.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 -- 172.21.15.28:0/3738662364 wait complete. 2024-04-23T18:27:53.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 Processor -- start 2024-04-23T18:27:53.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 -- start start 2024-04-23T18:27:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82c8073220 0x7f82c81566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82c8073600 0x7f82c80c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82c81391a0 0x7f82c81f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80c90c0 con 0x7f82c8073220 2024-04-23T18:27:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80c71f0 con 0x7f82c8073600 2024-04-23T18:27:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82cca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f82c80c9240 con 0x7f82c81391a0 2024-04-23T18:27:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82c5e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82c8073220 0x7f82c81566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82c5e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82c8073220 0x7f82c81566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33300/0 (socket says 172.21.15.28:33300) 2024-04-23T18:27:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82c5e00640 1 -- 172.21.15.28:0/1774655789 learned_addr learned my addr 172.21.15.28:0/1774655789 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82c6800640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82c81391a0 0x7f82c81f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82bd400640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82c8073600 0x7f82c80c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82c5e00640 1 -- 172.21.15.28:0/1774655789 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82c81391a0 msgr2=0x7f82c81f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82c5e00640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f82c81391a0 0x7f82c81f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82c5e00640 1 -- 172.21.15.28:0/1774655789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82c8073600 msgr2=0x7f82c80c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82c5e00640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82c8073600 0x7f82c80c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82c5e00640 1 -- 172.21.15.28:0/1774655789 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c81f7490 con 0x7f82c8073220 2024-04-23T18:27:53.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.541+0000 7f82c5e00640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82c8073220 0x7f82c81566e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f82b800d800 tx=0x7f82b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82bea00640 1 -- 172.21.15.28:0/1774655789 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b800b660 con 0x7f82c8073220 2024-04-23T18:27:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82bea00640 1 -- 172.21.15.28:0/1774655789 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b8019070 con 0x7f82c8073220 2024-04-23T18:27:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82bea00640 1 -- 172.21.15.28:0/1774655789 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b800ba00 con 0x7f82c8073220 2024-04-23T18:27:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82cca00640 1 -- 172.21.15.28:0/1774655789 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c81f7770 con 0x7f82c8073220 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82cca00640 1 -- 172.21.15.28:0/1774655789 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c81f7d30 con 0x7f82c8073220 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82cca00640 1 -- 172.21.15.28:0/1774655789 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82c8138ea0 con 0x7f82c8073220 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82bea00640 1 -- 172.21.15.28:0/1774655789 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82b800bba0 con 0x7f82c8073220 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82bea00640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f82a4068380 0x7f82a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82bea00640 1 -- 172.21.15.28:0/1774655789 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f82b8087d00 con 0x7f82c8073220 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82bea00640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] conn(0x7f82a4071da0 0x7f82a4074240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82bea00640 1 -- 172.21.15.28:0/1774655789 --> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82b8006820 con 0x7f82a4071da0 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82bea00640 1 -- 172.21.15.28:0/1774655789 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f82b80880b0 con 0x7f82c8073220 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82bd400640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f82a4068380 0x7f82a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.545+0000 7f82c6800640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] conn(0x7f82a4071da0 0x7f82a4074240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.549+0000 7f82c6800640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] conn(0x7f82a4071da0 0x7f82a4074240 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.549+0000 7f82bd400640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f82a4068380 0x7f82a406a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f82b00ae000 tx=0x7f82b00a7000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.549+0000 7f82bea00640 1 -- 172.21.15.28:0/1774655789 <== osd.3 v2:172.21.15.28:6816/1483415769 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f82b8006820 con 0x7f82a4071da0 2024-04-23T18:27:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82cca00640 1 -- 172.21.15.28:0/1774655789 --> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f82c8068e50 con 0x7f82a4071da0 2024-04-23T18:27:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82bea00640 1 -- 172.21.15.28:0/1774655789 <== osd.3 v2:172.21.15.28:6816/1483415769 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f82c8068e50 con 0x7f82a4071da0 2024-04-23T18:27:53.557 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:27:53.557 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:27:53.557 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:27:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82cca00640 1 -- 172.21.15.28:0/1774655789 >> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] conn(0x7f82a4071da0 msgr2=0x7f82a4074240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82cca00640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.28:6816/1483415769,v1:172.21.15.28:6817/1483415769] conn(0x7f82a4071da0 0x7f82a4074240 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82cca00640 1 -- 172.21.15.28:0/1774655789 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f82a4068380 msgr2=0x7f82a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82cca00640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f82a4068380 0x7f82a406a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f82b00ae000 tx=0x7f82b00a7000 comp rx=0 tx=0).stop 2024-04-23T18:27:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82cca00640 1 -- 172.21.15.28:0/1774655789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82c8073220 msgr2=0x7f82c81566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82cca00640 1 --2- 172.21.15.28:0/1774655789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82c8073220 0x7f82c81566e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f82b800d800 tx=0x7f82b800dcc0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82c6800640 1 -- 172.21.15.28:0/1774655789 reap_dead start 2024-04-23T18:27:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82cca00640 1 -- 172.21.15.28:0/1774655789 shutdown_connections 2024-04-23T18:27:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82cca00640 1 -- 172.21.15.28:0/1774655789 >> 172.21.15.28:0/1774655789 conn(0x7f82c806d400 msgr2=0x7f82c80676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82cca00640 1 -- 172.21.15.28:0/1774655789 shutdown_connections 2024-04-23T18:27:53.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.561+0000 7f82cca00640 1 -- 172.21.15.28:0/1774655789 wait complete. 2024-04-23T18:27:53.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-23T18:27:53.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a82e00640 1 Processor -- start 2024-04-23T18:27:53.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a82e00640 1 -- start start 2024-04-23T18:27:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a82e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6a7c152ec0 0x7f6a7c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a82e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6a7c0c9f70 0x7f6a7c070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a82e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a7c071180 0x7f6a7c15c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a82e00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f6a7c0c8b20 con 0x7f6a7c152ec0 2024-04-23T18:27:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a82e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6a7c0c7c50 con 0x7f6a7c0c9f70 2024-04-23T18:27:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a82e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7c0c7f10 con 0x7f6a7c071180 2024-04-23T18:27:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a81a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6a7c152ec0 0x7f6a7c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a81a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6a7c152ec0 0x7f6a7c0c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33306/0 (socket says 172.21.15.28:33306) 2024-04-23T18:27:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a81a00640 1 -- 172.21.15.28:0/1949740747 learned_addr learned my addr 172.21.15.28:0/1949740747 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a81000640 1 --2- 172.21.15.28:0/1949740747 >> v2:172.21.15.137:3300/0 conn(0x7f6a7c0c9f70 0x7f6a7c070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a82400640 1 --2- 172.21.15.28:0/1949740747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a7c071180 0x7f6a7c15c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a81a00640 1 -- 172.21.15.28:0/1949740747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a7c071180 msgr2=0x7f6a7c15c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a81a00640 1 --2- 172.21.15.28:0/1949740747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a7c071180 0x7f6a7c15c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a81a00640 1 -- 172.21.15.28:0/1949740747 >> v2:172.21.15.137:3300/0 conn(0x7f6a7c0c9f70 msgr2=0x7f6a7c070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a81a00640 1 --2- 172.21.15.28:0/1949740747 >> v2:172.21.15.137:3300/0 conn(0x7f6a7c0c9f70 0x7f6a7c070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a81a00640 1 -- 172.21.15.28:0/1949740747 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c0c81f0 con 0x7f6a7c152ec0 2024-04-23T18:27:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.725+0000 7f6a81000640 1 --2- 172.21.15.28:0/1949740747 >> v2:172.21.15.137:3300/0 conn(0x7f6a7c0c9f70 0x7f6a7c070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a81a00640 1 --2- 172.21.15.28:0/1949740747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a7c152ec0 0x7f6a7c0c97d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c070100 tx=0x7f6a7001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e311438df892ec19 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a7be00640 1 -- 172.21.15.28:0/1949740747 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a700b5070 con 0x7f6a7c152ec0 2024-04-23T18:27:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a7be00640 1 -- 172.21.15.28:0/1949740747 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700a89d0 con 0x7f6a7c152ec0 2024-04-23T18:27:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a7be00640 1 -- 172.21.15.28:0/1949740747 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a700a8da0 con 0x7f6a7c152ec0 2024-04-23T18:27:53.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a82e00640 1 -- 172.21.15.28:0/1949740747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a7c152ec0 msgr2=0x7f6a7c0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a82e00640 1 --2- 172.21.15.28:0/1949740747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a7c152ec0 0x7f6a7c0c97d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c070100 tx=0x7f6a7001ed10 comp rx=0 tx=0).stop 2024-04-23T18:27:53.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a82e00640 1 -- 172.21.15.28:0/1949740747 shutdown_connections 2024-04-23T18:27:53.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a82e00640 1 --2- 172.21.15.28:0/1949740747 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a7c071180 0x7f6a7c15c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a82e00640 1 --2- 172.21.15.28:0/1949740747 >> v2:172.21.15.137:3300/0 conn(0x7f6a7c0c9f70 0x7f6a7c070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a82e00640 1 --2- 172.21.15.28:0/1949740747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a7c152ec0 0x7f6a7c0c97d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a82e00640 1 -- 172.21.15.28:0/1949740747 >> 172.21.15.28:0/1949740747 conn(0x7f6a7c0676e0 msgr2=0x7f6a7c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:53.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a82e00640 1 -- 172.21.15.28:0/1949740747 shutdown_connections 2024-04-23T18:27:53.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.729+0000 7f6a82e00640 1 -- 172.21.15.28:0/1949740747 wait complete. 2024-04-23T18:27:53.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82e00640 1 Processor -- start 2024-04-23T18:27:53.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82e00640 1 -- start start 2024-04-23T18:27:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a7c071180 0x7f6a7c153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a7c0c9f70 0x7f6a7c1e2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a7c152ec0 0x7f6a7c15b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c0c9d10 con 0x7f6a7c152ec0 2024-04-23T18:27:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c0c87b0 con 0x7f6a7c0c9f70 2024-04-23T18:27:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7c1532a0 con 0x7f6a7c071180 2024-04-23T18:27:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a7c152ec0 0x7f6a7c15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a7c152ec0 0x7f6a7c15b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33316/0 (socket says 172.21.15.28:33316) 2024-04-23T18:27:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82400640 1 -- 172.21.15.28:0/3292676263 learned_addr learned my addr 172.21.15.28:0/3292676263 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a81a00640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a7c071180 0x7f6a7c153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a81000640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a7c0c9f70 0x7f6a7c1e2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82400640 1 -- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a7c071180 msgr2=0x7f6a7c153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82400640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a7c071180 0x7f6a7c153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82400640 1 -- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a7c0c9f70 msgr2=0x7f6a7c1e2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82400640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a7c0c9f70 0x7f6a7c1e2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82400640 1 -- 172.21.15.28:0/3292676263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c155a00 con 0x7f6a7c152ec0 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a81000640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a7c0c9f70 0x7f6a7c1e2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82400640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a7c152ec0 0x7f6a7c15b700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6a74007d50 tx=0x7f6a7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a79600640 1 -- 172.21.15.28:0/3292676263 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74014420 con 0x7f6a7c152ec0 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a79600640 1 -- 172.21.15.28:0/3292676263 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a74019070 con 0x7f6a7c152ec0 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a79600640 1 -- 172.21.15.28:0/3292676263 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74014820 con 0x7f6a7c152ec0 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82e00640 1 -- 172.21.15.28:0/3292676263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7c155ce0 con 0x7f6a7c152ec0 2024-04-23T18:27:53.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.733+0000 7f6a82e00640 1 -- 172.21.15.28:0/3292676263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a7c1562a0 con 0x7f6a7c152ec0 2024-04-23T18:27:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.737+0000 7f6a82e00640 1 -- 172.21.15.28:0/3292676263 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a7c074290 con 0x7f6a7c152ec0 2024-04-23T18:27:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.737+0000 7f6a79600640 1 -- 172.21.15.28:0/3292676263 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a740149c0 con 0x7f6a7c152ec0 2024-04-23T18:27:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.737+0000 7f6a79600640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a5c068380 0x7f6a5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.737+0000 7f6a79600640 1 -- 172.21.15.28:0/3292676263 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f6a740875d0 con 0x7f6a7c152ec0 2024-04-23T18:27:53.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.737+0000 7f6a81a00640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a5c068380 0x7f6a5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:53.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.737+0000 7f6a81a00640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a5c068380 0x7f6a5c06a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6a700b2000 tx=0x7f6a70009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:53.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.741+0000 7f6a79600640 1 -- 172.21.15.28:0/3292676263 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a74057660 con 0x7f6a7c152ec0 2024-04-23T18:27:53.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.909+0000 7f6a82e00640 1 -- 172.21.15.28:0/3292676263 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6a7c1eee00 con 0x7f6a5c068380 2024-04-23T18:27:53.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.909+0000 7f6a79600640 1 -- 172.21.15.28:0/3292676263 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6a7c1eee00 con 0x7f6a5c068380 2024-04-23T18:27:53.904 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 3 to deep-scrub 2024-04-23T18:27:53.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 -- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a5c068380 msgr2=0x7f6a5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a5c068380 0x7f6a5c06a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6a700b2000 tx=0x7f6a70009040 comp rx=0 tx=0).stop 2024-04-23T18:27:53.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 -- 172.21.15.28:0/3292676263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a7c152ec0 msgr2=0x7f6a7c15b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:53.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a7c152ec0 0x7f6a7c15b700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6a74007d50 tx=0x7f6a7400e4b0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 -- 172.21.15.28:0/3292676263 shutdown_connections 2024-04-23T18:27:53.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f6a5c068380 0x7f6a5c06a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a7c152ec0 0x7f6a7c15b700 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a7c0c9f70 0x7f6a7c1e2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 --2- 172.21.15.28:0/3292676263 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6a7c071180 0x7f6a7c153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:53.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 -- 172.21.15.28:0/3292676263 >> 172.21.15.28:0/3292676263 conn(0x7f6a7c0676e0 msgr2=0x7f6a7c072d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:53.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 -- 172.21.15.28:0/3292676263 shutdown_connections 2024-04-23T18:27:53.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:53.913+0000 7f6a82e00640 1 -- 172.21.15.28:0/3292676263 wait complete. 2024-04-23T18:27:53.926 INFO:tasks.ceph:Scrubbing osd.4 2024-04-23T18:27:53.926 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:27:54.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.077+0000 7f0bb2c00640 1 Processor -- start 2024-04-23T18:27:54.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb2c00640 1 -- start start 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb2c00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0bac155100 0x7f0bac0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb2c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bac1554e0 0x7f0bac072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb2c00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bac15afb0 con 0x7f0bac0cf260 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb2c00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f0bac15c4a0 con 0x7f0bac155100 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb2c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0bac15b270 con 0x7f0bac1554e0 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb1800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0bac155100 0x7f0bac0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb2200640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0bac0cf260 0x7f0bac15c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33658/0 (socket says 172.21.15.28:33658) 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb2200640 1 -- 172.21.15.28:0/2255387241 learned_addr learned my addr 172.21.15.28:0/2255387241 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb0e00640 1 --2- 172.21.15.28:0/2255387241 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bac1554e0 0x7f0bac072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb1800640 1 -- 172.21.15.28:0/2255387241 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bac1554e0 msgr2=0x7f0bac072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb1800640 1 --2- 172.21.15.28:0/2255387241 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bac1554e0 0x7f0bac072dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb1800640 1 -- 172.21.15.28:0/2255387241 >> v1:172.21.15.28:6789/0 conn(0x7f0bac0cf260 legacy=0x7f0bac15c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.081+0000 7f0bb1800640 1 -- 172.21.15.28:0/2255387241 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac15b550 con 0x7f0bac155100 2024-04-23T18:27:54.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0bb1800640 1 --2- 172.21.15.28:0/2255387241 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bac155100 0x7f0bac0cea50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00097c0 tx=0x7f0ba001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a6d3d8aea158d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0babe00640 1 -- 172.21.15.28:0/2255387241 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00b5070 con 0x7f0bac155100 2024-04-23T18:27:54.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0babe00640 1 -- 172.21.15.28:0/2255387241 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba00a8990 con 0x7f0bac155100 2024-04-23T18:27:54.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0babe00640 1 -- 172.21.15.28:0/2255387241 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00a8d60 con 0x7f0bac155100 2024-04-23T18:27:54.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0bb2c00640 1 -- 172.21.15.28:0/2255387241 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bac155100 msgr2=0x7f0bac0cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0bb2c00640 1 --2- 172.21.15.28:0/2255387241 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bac155100 0x7f0bac0cea50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00097c0 tx=0x7f0ba001ec90 comp rx=0 tx=0).stop 2024-04-23T18:27:54.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0bb2c00640 1 -- 172.21.15.28:0/2255387241 shutdown_connections 2024-04-23T18:27:54.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0bb2c00640 1 --2- 172.21.15.28:0/2255387241 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bac1554e0 0x7f0bac072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0bb2c00640 1 --2- 172.21.15.28:0/2255387241 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bac155100 0x7f0bac0cea50 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0bb2c00640 1 -- 172.21.15.28:0/2255387241 >> 172.21.15.28:0/2255387241 conn(0x7f0bac0759a0 msgr2=0x7f0bac0709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:54.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0bb2c00640 1 -- 172.21.15.28:0/2255387241 shutdown_connections 2024-04-23T18:27:54.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0bb2c00640 1 -- 172.21.15.28:0/2255387241 wait complete. 2024-04-23T18:27:54.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0bb2c00640 1 Processor -- start 2024-04-23T18:27:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.085+0000 7f0bb2c00640 1 -- start start 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb2c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bac0cf260 0x7f0bac1f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb2c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bac155100 0x7f0bac15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb2c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bac1554e0 0x7f0bac14b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb2c00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac15bdf0 con 0x7f0bac155100 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb2c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac15bb10 con 0x7f0bac1554e0 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb2c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f0bac0cef90 con 0x7f0bac0cf260 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb0e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bac155100 0x7f0bac15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb0e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bac155100 0x7f0bac15cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33330/0 (socket says 172.21.15.28:33330) 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb0e00640 1 -- 172.21.15.28:0/1382026175 learned_addr learned my addr 172.21.15.28:0/1382026175 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb1800640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bac0cf260 0x7f0bac1f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb2200640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bac1554e0 0x7f0bac14b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb0e00640 1 -- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bac0cf260 msgr2=0x7f0bac1f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb0e00640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bac0cf260 0x7f0bac1f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb0e00640 1 -- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bac1554e0 msgr2=0x7f0bac14b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb0e00640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bac1554e0 0x7f0bac14b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb0e00640 1 -- 172.21.15.28:0/1382026175 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac14b8f0 con 0x7f0bac155100 2024-04-23T18:27:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb1800640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0bac0cf260 0x7f0bac1f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:27:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb2200640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bac1554e0 0x7f0bac14b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:27:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb0e00640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bac155100 0x7f0bac15cfa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800d800 tx=0x7f0b9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0ba9600640 1 -- 172.21.15.28:0/1382026175 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9800b660 con 0x7f0bac155100 2024-04-23T18:27:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0ba9600640 1 -- 172.21.15.28:0/1382026175 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b98019070 con 0x7f0bac155100 2024-04-23T18:27:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb2c00640 1 -- 172.21.15.28:0/1382026175 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bac15e8d0 con 0x7f0bac155100 2024-04-23T18:27:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0ba9600640 1 -- 172.21.15.28:0/1382026175 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9800ba00 con 0x7f0bac155100 2024-04-23T18:27:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb2c00640 1 -- 172.21.15.28:0/1382026175 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bac0ca6c0 con 0x7f0bac155100 2024-04-23T18:27:54.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.089+0000 7f0bb2c00640 1 -- 172.21.15.28:0/1382026175 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bac068cd0 con 0x7f0bac155100 2024-04-23T18:27:54.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.093+0000 7f0ba9600640 1 -- 172.21.15.28:0/1382026175 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0b9800bba0 con 0x7f0bac155100 2024-04-23T18:27:54.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.093+0000 7f0ba9600640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b8c0683b0 0x7f0b8c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.093+0000 7f0ba9600640 1 -- 172.21.15.28:0/1382026175 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f0b98087cb0 con 0x7f0bac155100 2024-04-23T18:27:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.093+0000 7f0ba9600640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] conn(0x7f0b8c071dc0 0x7f0b8c074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.093+0000 7f0ba9600640 1 -- 172.21.15.28:0/1382026175 --> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b98024e50 con 0x7f0b8c071dc0 2024-04-23T18:27:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.093+0000 7f0bb1800640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b8c0683b0 0x7f0b8c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.093+0000 7f0ba9600640 1 -- 172.21.15.28:0/1382026175 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0b98088060 con 0x7f0bac155100 2024-04-23T18:27:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.093+0000 7f0bb2200640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] conn(0x7f0b8c071dc0 0x7f0b8c074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.093+0000 7f0bb1800640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b8c0683b0 0x7f0b8c06a870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00b2000 tx=0x7f0ba00aa070 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.093+0000 7f0bb2200640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] conn(0x7f0b8c071dc0 0x7f0b8c074260 crc :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.097+0000 7f0ba9600640 1 -- 172.21.15.28:0/1382026175 <== osd.4 v2:172.21.15.137:6806/3497527296 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b98024e50 con 0x7f0b8c071dc0 2024-04-23T18:27:54.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.109+0000 7f0bb2c00640 1 -- 172.21.15.28:0/1382026175 --> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0bac0ce470 con 0x7f0b8c071dc0 2024-04-23T18:27:54.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0ba9600640 1 -- 172.21.15.28:0/1382026175 <== osd.4 v2:172.21.15.137:6806/3497527296 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0bac0ce470 con 0x7f0b8c071dc0 2024-04-23T18:27:54.106 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:27:54.106 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:27:54.107 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:27:54.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0bb2c00640 1 -- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] conn(0x7f0b8c071dc0 msgr2=0x7f0b8c074260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0bb2c00640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:6806/3497527296,v1:172.21.15.137:6808/3497527296] conn(0x7f0b8c071dc0 0x7f0b8c074260 crc :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0bb2c00640 1 -- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b8c0683b0 msgr2=0x7f0b8c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0bb2c00640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0b8c0683b0 0x7f0b8c06a870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00b2000 tx=0x7f0ba00aa070 comp rx=0 tx=0).stop 2024-04-23T18:27:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0bb2c00640 1 -- 172.21.15.28:0/1382026175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bac155100 msgr2=0x7f0bac15cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0bb2c00640 1 --2- 172.21.15.28:0/1382026175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0bac155100 0x7f0bac15cfa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800d800 tx=0x7f0b9800dcc0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0bb2200640 1 -- 172.21.15.28:0/1382026175 reap_dead start 2024-04-23T18:27:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0bb2c00640 1 -- 172.21.15.28:0/1382026175 shutdown_connections 2024-04-23T18:27:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0bb2c00640 1 -- 172.21.15.28:0/1382026175 >> 172.21.15.28:0/1382026175 conn(0x7f0bac0759a0 msgr2=0x7f0bac152930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0bb2c00640 1 -- 172.21.15.28:0/1382026175 shutdown_connections 2024-04-23T18:27:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.113+0000 7f0bb2c00640 1 -- 172.21.15.28:0/1382026175 wait complete. 2024-04-23T18:27:54.125 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-23T18:27:54.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.273+0000 7f1dea800640 1 Processor -- start 2024-04-23T18:27:54.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.273+0000 7f1dea800640 1 -- start start 2024-04-23T18:27:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.273+0000 7f1dea800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1de41552f0 0x7f1de415e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.273+0000 7f1dea800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1de40c3a50 0x7f1de415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.273+0000 7f1dea800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de415ecd0 con 0x7f1de40c4110 2024-04-23T18:27:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.273+0000 7f1dea800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f1de415b540 con 0x7f1de40c3a50 2024-04-23T18:27:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.273+0000 7f1dea800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1de415efb0 con 0x7f1de41552f0 2024-04-23T18:27:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.273+0000 7f1ddaa00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1de40c3a50 0x7f1de415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.273+0000 7f1de3e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1de40c4110 0x7f1de40c75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33672/0 (socket says 172.21.15.28:33672) 2024-04-23T18:27:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.273+0000 7f1de3e00640 1 -- 172.21.15.28:0/2096029464 learned_addr learned my addr 172.21.15.28:0/2096029464 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1de3400640 1 --2- 172.21.15.28:0/2096029464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1de41552f0 0x7f1de415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1ddaa00640 1 -- 172.21.15.28:0/2096029464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1de41552f0 msgr2=0x7f1de415e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1ddaa00640 1 --2- 172.21.15.28:0/2096029464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1de41552f0 0x7f1de415e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1ddaa00640 1 -- 172.21.15.28:0/2096029464 >> v1:172.21.15.28:6789/0 conn(0x7f1de40c4110 legacy=0x7f1de40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1ddaa00640 1 -- 172.21.15.28:0/2096029464 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de415f290 con 0x7f1de40c3a50 2024-04-23T18:27:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1de2a00640 1 -- 172.21.15.28:0/2096029464 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 901841073 0 0) 0x7f1de415ecd0 con 0x7f1de40c4110 2024-04-23T18:27:54.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1ddaa00640 1 --2- 172.21.15.28:0/2096029464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1de40c3a50 0x7f1de415b9d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0097c0 tx=0x7f1dcc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d270ac2d7cb07600 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1de2a00640 1 -- 172.21.15.28:0/2096029464 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc0b0070 con 0x7f1de40c3a50 2024-04-23T18:27:54.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1de2a00640 1 -- 172.21.15.28:0/2096029464 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc0ab600 con 0x7f1de40c3a50 2024-04-23T18:27:54.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1de2a00640 1 -- 172.21.15.28:0/2096029464 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc0ab9d0 con 0x7f1de40c3a50 2024-04-23T18:27:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1dea800640 1 -- 172.21.15.28:0/2096029464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1de40c3a50 msgr2=0x7f1de415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.277+0000 7f1dea800640 1 --2- 172.21.15.28:0/2096029464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1de40c3a50 0x7f1de415b9d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0097c0 tx=0x7f1dcc01c410 comp rx=0 tx=0).stop 2024-04-23T18:27:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 -- 172.21.15.28:0/2096029464 shutdown_connections 2024-04-23T18:27:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 --2- 172.21.15.28:0/2096029464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1de40c3a50 0x7f1de415b9d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 --2- 172.21.15.28:0/2096029464 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1de41552f0 0x7f1de415e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 -- 172.21.15.28:0/2096029464 >> 172.21.15.28:0/2096029464 conn(0x7f1de4075e30 msgr2=0x7f1de40676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 -- 172.21.15.28:0/2096029464 shutdown_connections 2024-04-23T18:27:54.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 -- 172.21.15.28:0/2096029464 wait complete. 2024-04-23T18:27:54.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 Processor -- start 2024-04-23T18:27:54.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 -- start start 2024-04-23T18:27:54.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1de40c3a50 0x7f1de4156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1de40c4110 0x7f1de4071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1de41552f0 0x7f1de415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1de415bf10 con 0x7f1de41552f0 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1de40c4660 con 0x7f1de40c4110 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1de415c090 con 0x7f1de40c3a50 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1de3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1de41552f0 0x7f1de415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1de3e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1de41552f0 0x7f1de415a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33354/0 (socket says 172.21.15.28:33354) 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1de3e00640 1 -- 172.21.15.28:0/2023726037 learned_addr learned my addr 172.21.15.28:0/2023726037 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1de3400640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1de40c3a50 0x7f1de4156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1ddaa00640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1de40c4110 0x7f1de4071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1de3e00640 1 -- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1de40c3a50 msgr2=0x7f1de4156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1de3e00640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1de40c3a50 0x7f1de4156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1de3e00640 1 -- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1de40c4110 msgr2=0x7f1de4071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1de3e00640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1de40c4110 0x7f1de4071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1de3e00640 1 -- 172.21.15.28:0/2023726037 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de4158660 con 0x7f1de41552f0 2024-04-23T18:27:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1de3e00640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1de41552f0 0x7f1de415a860 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c7d0 tx=0x7f1ddc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1ddbe00640 1 -- 172.21.15.28:0/2023726037 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc018070 con 0x7f1de41552f0 2024-04-23T18:27:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1ddbe00640 1 -- 172.21.15.28:0/2023726037 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ddc00a640 con 0x7f1de41552f0 2024-04-23T18:27:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 -- 172.21.15.28:0/2023726037 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de41578a0 con 0x7f1de41552f0 2024-04-23T18:27:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1ddbe00640 1 -- 172.21.15.28:0/2023726037 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00aa70 con 0x7f1de41552f0 2024-04-23T18:27:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.281+0000 7f1dea800640 1 -- 172.21.15.28:0/2023726037 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de4152e70 con 0x7f1de41552f0 2024-04-23T18:27:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.285+0000 7f1dea800640 1 -- 172.21.15.28:0/2023726037 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1de4068db0 con 0x7f1de41552f0 2024-04-23T18:27:54.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.285+0000 7f1ddbe00640 1 -- 172.21.15.28:0/2023726037 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ddc01b070 con 0x7f1de41552f0 2024-04-23T18:27:54.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.285+0000 7f1ddbe00640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1dc0068380 0x7f1dc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.285+0000 7f1ddbe00640 1 -- 172.21.15.28:0/2023726037 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1ddc0863d0 con 0x7f1de41552f0 2024-04-23T18:27:54.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.285+0000 7f1de3400640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1dc0068380 0x7f1dc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.285+0000 7f1de3400640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1dc0068380 0x7f1dc006a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400b930 tx=0x7f1dd4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.289+0000 7f1ddbe00640 1 -- 172.21.15.28:0/2023726037 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ddc056580 con 0x7f1de41552f0 2024-04-23T18:27:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.457+0000 7f1dea800640 1 -- 172.21.15.28:0/2023726037 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f1de40c8120 con 0x7f1dc0068380 2024-04-23T18:27:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1ddbe00640 1 -- 172.21.15.28:0/2023726037 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1de40c8120 con 0x7f1dc0068380 2024-04-23T18:27:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 4 to deep-scrub 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 -- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1dc0068380 msgr2=0x7f1dc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1dc0068380 0x7f1dc006a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400b930 tx=0x7f1dd4008040 comp rx=0 tx=0).stop 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 -- 172.21.15.28:0/2023726037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1de41552f0 msgr2=0x7f1de415a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1de41552f0 0x7f1de415a860 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c7d0 tx=0x7f1ddc00cc90 comp rx=0 tx=0).stop 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 -- 172.21.15.28:0/2023726037 shutdown_connections 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1dc0068380 0x7f1dc006a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1de41552f0 0x7f1de415a860 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1de40c4110 0x7f1de4071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 --2- 172.21.15.28:0/2023726037 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1de40c3a50 0x7f1de4156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 -- 172.21.15.28:0/2023726037 >> 172.21.15.28:0/2023726037 conn(0x7f1de4075e30 msgr2=0x7f1de41500b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 -- 172.21.15.28:0/2023726037 shutdown_connections 2024-04-23T18:27:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.461+0000 7f1dea800640 1 -- 172.21.15.28:0/2023726037 wait complete. 2024-04-23T18:27:54.476 INFO:tasks.ceph:Scrubbing osd.5 2024-04-23T18:27:54.476 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:27:54.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.629+0000 7faa21600640 1 Processor -- start 2024-04-23T18:27:54.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.629+0000 7faa21600640 1 -- start start 2024-04-23T18:27:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa21600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faa1c15b580 0x7faa1c071730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa21600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa1c15b960 0x7faa1c0c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa21600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa1c151ba0 0x7faa1c152010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa21600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7faa1c071c70 con 0x7faa1c151ba0 2024-04-23T18:27:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa21600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7faa1c071ee0 con 0x7faa1c15b580 2024-04-23T18:27:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa21600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faa1c072180 con 0x7faa1c15b960 2024-04-23T18:27:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa1b400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa1c151ba0 0x7faa1c152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa1b400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa1c151ba0 0x7faa1c152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33360/0 (socket says 172.21.15.28:33360) 2024-04-23T18:27:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa1b400640 1 -- 172.21.15.28:0/988226904 learned_addr learned my addr 172.21.15.28:0/988226904 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa13e00640 1 --2- 172.21.15.28:0/988226904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa1c15b960 0x7faa1c0c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa1aa00640 1 --2- 172.21.15.28:0/988226904 >> v2:172.21.15.137:3300/0 conn(0x7faa1c15b580 0x7faa1c071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa1b400640 1 -- 172.21.15.28:0/988226904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa1c15b960 msgr2=0x7faa1c0c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa1b400640 1 --2- 172.21.15.28:0/988226904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa1c15b960 0x7faa1c0c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa1b400640 1 -- 172.21.15.28:0/988226904 >> v2:172.21.15.137:3300/0 conn(0x7faa1c15b580 msgr2=0x7faa1c071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa1b400640 1 --2- 172.21.15.28:0/988226904 >> v2:172.21.15.137:3300/0 conn(0x7faa1c15b580 0x7faa1c071730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa1b400640 1 -- 172.21.15.28:0/988226904 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c072420 con 0x7faa1c151ba0 2024-04-23T18:27:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa1aa00640 1 --2- 172.21.15.28:0/988226904 >> v2:172.21.15.137:3300/0 conn(0x7faa1c15b580 0x7faa1c071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:27:54.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.633+0000 7faa1b400640 1 --2- 172.21.15.28:0/988226904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa1c151ba0 0x7faa1c152010 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0683f0 tx=0x7faa1401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c51f92ea2413f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa1a000640 1 -- 172.21.15.28:0/988226904 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140b4070 con 0x7faa1c151ba0 2024-04-23T18:27:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa1a000640 1 -- 172.21.15.28:0/988226904 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa140af400 con 0x7faa1c151ba0 2024-04-23T18:27:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa1a000640 1 -- 172.21.15.28:0/988226904 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140af7d0 con 0x7faa1c151ba0 2024-04-23T18:27:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 -- 172.21.15.28:0/988226904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa1c151ba0 msgr2=0x7faa1c152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 --2- 172.21.15.28:0/988226904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa1c151ba0 0x7faa1c152010 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0683f0 tx=0x7faa1401f1e0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 -- 172.21.15.28:0/988226904 shutdown_connections 2024-04-23T18:27:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 --2- 172.21.15.28:0/988226904 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa1c151ba0 0x7faa1c152010 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 --2- 172.21.15.28:0/988226904 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa1c15b960 0x7faa1c0c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 --2- 172.21.15.28:0/988226904 >> v2:172.21.15.137:3300/0 conn(0x7faa1c15b580 0x7faa1c071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 -- 172.21.15.28:0/988226904 >> 172.21.15.28:0/988226904 conn(0x7faa1c06d400 msgr2=0x7faa1c0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 -- 172.21.15.28:0/988226904 shutdown_connections 2024-04-23T18:27:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 -- 172.21.15.28:0/988226904 wait complete. 2024-04-23T18:27:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 Processor -- start 2024-04-23T18:27:54.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 -- start start 2024-04-23T18:27:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa1c151ba0 0x7faa1c1f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa1c15b580 0x7faa1c0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1c15b960 0x7faa1c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c072cc0 con 0x7faa1c151ba0 2024-04-23T18:27:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c0729e0 con 0x7faa1c15b960 2024-04-23T18:27:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa21600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faa1c0c7f80 con 0x7faa1c15b580 2024-04-23T18:27:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa1aa00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa1c151ba0 0x7faa1c1f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa1aa00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa1c151ba0 0x7faa1c1f1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33366/0 (socket says 172.21.15.28:33366) 2024-04-23T18:27:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.637+0000 7faa1aa00640 1 -- 172.21.15.28:0/320495034 learned_addr learned my addr 172.21.15.28:0/320495034 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa13e00640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa1c15b580 0x7faa1c0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa1b400640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1c15b960 0x7faa1c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa1aa00640 1 -- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa1c15b580 msgr2=0x7faa1c0cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa1aa00640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faa1c15b580 0x7faa1c0cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa1aa00640 1 -- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1c15b960 msgr2=0x7faa1c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa1aa00640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1c15b960 0x7faa1c0cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa1aa00640 1 -- 172.21.15.28:0/320495034 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c0cbdf0 con 0x7faa1c151ba0 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa1aa00640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa1c151ba0 0x7faa1c1f1860 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c7c0 tx=0x7faa0c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa12a00640 1 -- 172.21.15.28:0/320495034 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0079d0 con 0x7faa1c151ba0 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa12a00640 1 -- 172.21.15.28:0/320495034 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa0c007b70 con 0x7faa1c151ba0 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa12a00640 1 -- 172.21.15.28:0/320495034 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0113f0 con 0x7faa1c151ba0 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa21600640 1 -- 172.21.15.28:0/320495034 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1c0ca530 con 0x7faa1c151ba0 2024-04-23T18:27:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa21600640 1 -- 172.21.15.28:0/320495034 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1c0caaf0 con 0x7faa1c151ba0 2024-04-23T18:27:54.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa21600640 1 -- 172.21.15.28:0/320495034 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa1c068e50 con 0x7faa1c151ba0 2024-04-23T18:27:54.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa12a00640 1 -- 172.21.15.28:0/320495034 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faa0c011590 con 0x7faa1c151ba0 2024-04-23T18:27:54.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa12a00640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa9f8068380 0x7fa9f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa12a00640 1 -- 172.21.15.28:0/320495034 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7faa0c086fa0 con 0x7faa1c151ba0 2024-04-23T18:27:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa12a00640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] conn(0x7fa9f8071d90 0x7fa9f8074230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa12a00640 1 -- 172.21.15.28:0/320495034 --> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9f8074900 con 0x7fa9f8071d90 2024-04-23T18:27:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa12a00640 1 -- 172.21.15.28:0/320495034 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faa0c08e050 con 0x7faa1c151ba0 2024-04-23T18:27:54.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.641+0000 7faa13e00640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa9f8068380 0x7fa9f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.645+0000 7faa1b400640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] conn(0x7fa9f8071d90 0x7fa9f8074230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.645+0000 7faa13e00640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa9f8068380 0x7fa9f806a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faa1c151000 tx=0x7faa04008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.645+0000 7faa1b400640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] conn(0x7fa9f8071d90 0x7fa9f8074230 crc :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.645+0000 7faa12a00640 1 -- 172.21.15.28:0/320495034 <== osd.5 v2:172.21.15.137:6824/1206756250 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa9f8074900 con 0x7fa9f8071d90 2024-04-23T18:27:54.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa21600640 1 -- 172.21.15.28:0/320495034 --> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faa1c071300 con 0x7fa9f8071d90 2024-04-23T18:27:54.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa12a00640 1 -- 172.21.15.28:0/320495034 <== osd.5 v2:172.21.15.137:6824/1206756250 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faa1c071300 con 0x7fa9f8071d90 2024-04-23T18:27:54.655 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:27:54.655 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:27:54.655 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:27:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa21600640 1 -- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] conn(0x7fa9f8071d90 msgr2=0x7fa9f8074230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa21600640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:6824/1206756250,v1:172.21.15.137:6825/1206756250] conn(0x7fa9f8071d90 0x7fa9f8074230 crc :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa21600640 1 -- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa9f8068380 msgr2=0x7fa9f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa21600640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa9f8068380 0x7fa9f806a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faa1c151000 tx=0x7faa04008040 comp rx=0 tx=0).stop 2024-04-23T18:27:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa21600640 1 -- 172.21.15.28:0/320495034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa1c151ba0 msgr2=0x7faa1c1f1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa21600640 1 --2- 172.21.15.28:0/320495034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa1c151ba0 0x7faa1c1f1860 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c7c0 tx=0x7faa0c00cc80 comp rx=0 tx=0).stop 2024-04-23T18:27:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa1b400640 1 -- 172.21.15.28:0/320495034 reap_dead start 2024-04-23T18:27:54.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa21600640 1 -- 172.21.15.28:0/320495034 shutdown_connections 2024-04-23T18:27:54.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa21600640 1 -- 172.21.15.28:0/320495034 >> 172.21.15.28:0/320495034 conn(0x7faa1c06d400 msgr2=0x7faa1c14cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:54.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa21600640 1 -- 172.21.15.28:0/320495034 shutdown_connections 2024-04-23T18:27:54.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.661+0000 7faa21600640 1 -- 172.21.15.28:0/320495034 wait complete. 2024-04-23T18:27:54.675 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-23T18:27:54.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f1020000640 1 Processor -- start 2024-04-23T18:27:54.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f1020000640 1 -- start start 2024-04-23T18:27:54.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f1020000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10180c4110 0x7f101815e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f1020000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101815ecd0 con 0x7f10180c3a50 2024-04-23T18:27:54.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f1020000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101815efb0 con 0x7f10181552f0 2024-04-23T18:27:54.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f1020000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f101815c0e0 con 0x7f10180c4110 2024-04-23T18:27:54.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f101cc00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f10180c3a50 0x7f10180c75c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33674/0 (socket says 172.21.15.28:33674) 2024-04-23T18:27:54.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f101cc00640 1 -- 172.21.15.28:0/2322678197 learned_addr learned my addr 172.21.15.28:0/2322678197 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:54.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f101e000640 1 --2- 172.21.15.28:0/2322678197 >> v2:172.21.15.137:3300/0 conn(0x7f10180c4110 0x7f101815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f1017e00640 1 -- 172.21.15.28:0/2322678197 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2656188485 0 0) 0x7f101815ecd0 con 0x7f10180c3a50 2024-04-23T18:27:54.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f1017e00640 1 -- 172.21.15.28:0/2322678197 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1000003530 con 0x7f10180c3a50 2024-04-23T18:27:54.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f101e000640 1 -- 172.21.15.28:0/2322678197 >> v1:172.21.15.137:6789/0 conn(0x7f10181552f0 legacy=0x7f101815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f101e000640 1 -- 172.21.15.28:0/2322678197 >> v1:172.21.15.28:6789/0 conn(0x7f10180c3a50 legacy=0x7f10180c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.825+0000 7f101e000640 1 -- 172.21.15.28:0/2322678197 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101815f290 con 0x7f10180c4110 2024-04-23T18:27:54.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.829+0000 7f101e000640 1 --2- 172.21.15.28:0/2322678197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10180c4110 0x7f101815e660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1010009d90 tx=0x7f101001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5a3a1e51d28b8e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.829+0000 7f1017e00640 1 -- 172.21.15.28:0/2322678197 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10100b2070 con 0x7f10180c4110 2024-04-23T18:27:54.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.829+0000 7f1017e00640 1 -- 172.21.15.28:0/2322678197 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10100a57a0 con 0x7f10180c4110 2024-04-23T18:27:54.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.829+0000 7f1017e00640 1 -- 172.21.15.28:0/2322678197 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10100a5b50 con 0x7f10180c4110 2024-04-23T18:27:54.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.829+0000 7f1020000640 1 -- 172.21.15.28:0/2322678197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10180c4110 msgr2=0x7f101815e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.829+0000 7f1020000640 1 --2- 172.21.15.28:0/2322678197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10180c4110 0x7f101815e660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1010009d90 tx=0x7f101001c8e0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.829+0000 7f1020000640 1 -- 172.21.15.28:0/2322678197 shutdown_connections 2024-04-23T18:27:54.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.829+0000 7f1020000640 1 --2- 172.21.15.28:0/2322678197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10180c4110 0x7f101815e660 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.829+0000 7f1020000640 1 -- 172.21.15.28:0/2322678197 >> 172.21.15.28:0/2322678197 conn(0x7f1018075e30 msgr2=0x7f10180676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:54.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.829+0000 7f1020000640 1 -- 172.21.15.28:0/2322678197 shutdown_connections 2024-04-23T18:27:54.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.829+0000 7f1020000640 1 -- 172.21.15.28:0/2322678197 wait complete. 2024-04-23T18:27:54.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1020000640 1 Processor -- start 2024-04-23T18:27:54.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1020000640 1 -- start start 2024-04-23T18:27:54.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1020000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10180c3a50 0x7f1018146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1020000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10180c4110 0x7f1018143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1020000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10181552f0 0x7f10181f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1020000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f10180c7cd0 con 0x7f10180c4110 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1020000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10180c4660 con 0x7f10180c3a50 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1020000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f10180c7e50 con 0x7f10181552f0 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101cc00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10180c4110 0x7f1018143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101cc00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10180c4110 0x7f1018143ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33368/0 (socket says 172.21.15.28:33368) 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101cc00640 1 -- 172.21.15.28:0/1749912358 learned_addr learned my addr 172.21.15.28:0/1749912358 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101d600640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10180c3a50 0x7f1018146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101e000640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10181552f0 0x7f10181f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101cc00640 1 -- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10181552f0 msgr2=0x7f10181f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101cc00640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10181552f0 0x7f10181f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101cc00640 1 -- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10180c3a50 msgr2=0x7f1018146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:54.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101cc00640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10180c3a50 0x7f1018146dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:54.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101cc00640 1 -- 172.21.15.28:0/1749912358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10181f8490 con 0x7f10180c4110 2024-04-23T18:27:54.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101d600640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10180c3a50 0x7f1018146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:54.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101e000640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10181552f0 0x7f10181f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:54.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f101cc00640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10180c4110 0x7f1018143ae0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f100400c500 tx=0x7f100400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1015600640 1 -- 172.21.15.28:0/1749912358 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004017070 con 0x7f10180c4110 2024-04-23T18:27:54.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1015600640 1 -- 172.21.15.28:0/1749912358 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1004005cf0 con 0x7f10180c4110 2024-04-23T18:27:54.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1020000640 1 -- 172.21.15.28:0/1749912358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1018147a00 con 0x7f10180c4110 2024-04-23T18:27:54.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1015600640 1 -- 172.21.15.28:0/1749912358 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10040072f0 con 0x7f10180c4110 2024-04-23T18:27:54.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1020000640 1 -- 172.21.15.28:0/1749912358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10181462f0 con 0x7f10180c4110 2024-04-23T18:27:54.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.833+0000 7f1020000640 1 -- 172.21.15.28:0/1749912358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1018068db0 con 0x7f10180c4110 2024-04-23T18:27:54.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.837+0000 7f1015600640 1 -- 172.21.15.28:0/1749912358 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f100401a070 con 0x7f10180c4110 2024-04-23T18:27:54.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.837+0000 7f1015600640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0ff8068380 0x7f0ff806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:54.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.837+0000 7f1015600640 1 -- 172.21.15.28:0/1749912358 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f10040861e0 con 0x7f10180c4110 2024-04-23T18:27:54.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.837+0000 7f101d600640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0ff8068380 0x7f0ff806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:54.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.837+0000 7f101d600640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0ff8068380 0x7f0ff806a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f100c000f70 tx=0x7f100c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:54.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:54.841+0000 7f1015600640 1 -- 172.21.15.28:0/1749912358 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1004055c30 con 0x7f10180c4110 2024-04-23T18:27:55.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.013+0000 7f1020000640 1 -- 172.21.15.28:0/1749912358 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f10181438c0 con 0x7f0ff8068380 2024-04-23T18:27:55.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.013+0000 7f1015600640 1 -- 172.21.15.28:0/1749912358 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f10181438c0 con 0x7f0ff8068380 2024-04-23T18:27:55.009 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 5 to deep-scrub 2024-04-23T18:27:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 -- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0ff8068380 msgr2=0x7f0ff806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0ff8068380 0x7f0ff806a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f100c000f70 tx=0x7f100c009040 comp rx=0 tx=0).stop 2024-04-23T18:27:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 -- 172.21.15.28:0/1749912358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10180c4110 msgr2=0x7f1018143ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10180c4110 0x7f1018143ae0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f100400c500 tx=0x7f100400c9c0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 -- 172.21.15.28:0/1749912358 shutdown_connections 2024-04-23T18:27:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f0ff8068380 0x7f0ff806a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f10181552f0 0x7f10181f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10180c4110 0x7f1018143ae0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 --2- 172.21.15.28:0/1749912358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10180c3a50 0x7f1018146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 -- 172.21.15.28:0/1749912358 >> 172.21.15.28:0/1749912358 conn(0x7f1018075e30 msgr2=0x7f10180cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 -- 172.21.15.28:0/1749912358 shutdown_connections 2024-04-23T18:27:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.017+0000 7f1020000640 1 -- 172.21.15.28:0/1749912358 wait complete. 2024-04-23T18:27:55.030 INFO:tasks.ceph:Scrubbing osd.6 2024-04-23T18:27:55.030 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:27:55.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc41c800640 1 Processor -- start 2024-04-23T18:27:55.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc41c800640 1 -- start start 2024-04-23T18:27:55.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc41c800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc41415b580 0x7fc414071730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc41c800640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc41415b960 0x7fc4140c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc41c800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc414151ba0 0x7fc414151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc41c800640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fc414071c70 con 0x7fc41415b960 2024-04-23T18:27:55.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc41c800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc414071ee0 con 0x7fc41415b580 2024-04-23T18:27:55.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc41c800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc414072180 con 0x7fc414151ba0 2024-04-23T18:27:55.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc419400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc41415b960 0x7fc4140c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc419400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc41415b960 0x7fc4140c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33384/0 (socket says 172.21.15.28:33384) 2024-04-23T18:27:55.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc419400640 1 -- 172.21.15.28:0/3211133655 learned_addr learned my addr 172.21.15.28:0/3211133655 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:55.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc419e00640 1 --2- 172.21.15.28:0/3211133655 >> v2:172.21.15.137:3300/0 conn(0x7fc41415b580 0x7fc414071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc41a800640 1 --2- 172.21.15.28:0/3211133655 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc414151ba0 0x7fc414151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc419400640 1 -- 172.21.15.28:0/3211133655 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc414151ba0 msgr2=0x7fc414151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:55.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc419400640 1 --2- 172.21.15.28:0/3211133655 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc414151ba0 0x7fc414151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc419400640 1 -- 172.21.15.28:0/3211133655 >> v2:172.21.15.137:3300/0 conn(0x7fc41415b580 msgr2=0x7fc414071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:55.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc419400640 1 --2- 172.21.15.28:0/3211133655 >> v2:172.21.15.137:3300/0 conn(0x7fc41415b580 0x7fc414071730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc419400640 1 -- 172.21.15.28:0/3211133655 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc414072420 con 0x7fc41415b960 2024-04-23T18:27:55.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.185+0000 7fc419e00640 1 --2- 172.21.15.28:0/3211133655 >> v2:172.21.15.137:3300/0 conn(0x7fc41415b580 0x7fc414071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:55.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc419400640 1 --2- 172.21.15.28:0/3211133655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc41415b960 0x7fc4140c7a40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc4140683f0 tx=0x7fc40401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff151489059e2409 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc418a00640 1 -- 172.21.15.28:0/3211133655 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4040b5070 con 0x7fc41415b960 2024-04-23T18:27:55.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc418a00640 1 -- 172.21.15.28:0/3211133655 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4040a89d0 con 0x7fc41415b960 2024-04-23T18:27:55.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc418a00640 1 -- 172.21.15.28:0/3211133655 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4040a8da0 con 0x7fc41415b960 2024-04-23T18:27:55.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc41c800640 1 -- 172.21.15.28:0/3211133655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc41415b960 msgr2=0x7fc4140c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc41c800640 1 --2- 172.21.15.28:0/3211133655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc41415b960 0x7fc4140c7a40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc4140683f0 tx=0x7fc40401ed10 comp rx=0 tx=0).stop 2024-04-23T18:27:55.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc41c800640 1 -- 172.21.15.28:0/3211133655 shutdown_connections 2024-04-23T18:27:55.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc41c800640 1 --2- 172.21.15.28:0/3211133655 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc414151ba0 0x7fc414151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc41c800640 1 --2- 172.21.15.28:0/3211133655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc41415b960 0x7fc4140c7a40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc41c800640 1 --2- 172.21.15.28:0/3211133655 >> v2:172.21.15.137:3300/0 conn(0x7fc41415b580 0x7fc414071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc41c800640 1 -- 172.21.15.28:0/3211133655 >> 172.21.15.28:0/3211133655 conn(0x7fc41406d400 msgr2=0x7fc4140676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:55.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc41c800640 1 -- 172.21.15.28:0/3211133655 shutdown_connections 2024-04-23T18:27:55.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc41c800640 1 -- 172.21.15.28:0/3211133655 wait complete. 2024-04-23T18:27:55.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.189+0000 7fc41c800640 1 Processor -- start 2024-04-23T18:27:55.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41c800640 1 -- start start 2024-04-23T18:27:55.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41c800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc414151ba0 0x7fc41414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41c800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc41415b580 0x7fc4141f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41c800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc41415b960 0x7fc4141f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41c800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc414072cc0 con 0x7fc41415b580 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41c800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4140729e0 con 0x7fc414151ba0 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41c800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fc4140c7f80 con 0x7fc41415b960 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc419400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc41415b580 0x7fc4141f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc419400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc41415b580 0x7fc4141f28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33392/0 (socket says 172.21.15.28:33392) 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc419400640 1 -- 172.21.15.28:0/3620509525 learned_addr learned my addr 172.21.15.28:0/3620509525 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc419e00640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc414151ba0 0x7fc41414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41a800640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc41415b960 0x7fc4141f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc419400640 1 -- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc41415b960 msgr2=0x7fc4141f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc419400640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc41415b960 0x7fc4141f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc419400640 1 -- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc414151ba0 msgr2=0x7fc41414cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc419400640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc414151ba0 0x7fc41414cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc419400640 1 -- 172.21.15.28:0/3620509525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc414069060 con 0x7fc41415b580 2024-04-23T18:27:55.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41a800640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc41415b960 0x7fc4141f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T18:27:55.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc419400640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc41415b580 0x7fc4141f28e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc4040b3040 tx=0x7fc40401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc40e000640 1 -- 172.21.15.28:0/3620509525 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4040b5070 con 0x7fc41415b580 2024-04-23T18:27:55.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc40e000640 1 -- 172.21.15.28:0/3620509525 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4040b0a70 con 0x7fc41415b580 2024-04-23T18:27:55.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc40e000640 1 -- 172.21.15.28:0/3620509525 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4040b0e60 con 0x7fc41415b580 2024-04-23T18:27:55.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41c800640 1 -- 172.21.15.28:0/3620509525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc414147a90 con 0x7fc41415b580 2024-04-23T18:27:55.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41c800640 1 -- 172.21.15.28:0/3620509525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4140c4f60 con 0x7fc41415b580 2024-04-23T18:27:55.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.193+0000 7fc41c800640 1 -- 172.21.15.28:0/3620509525 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc414068e50 con 0x7fc41415b580 2024-04-23T18:27:55.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.197+0000 7fc40e000640 1 -- 172.21.15.28:0/3620509525 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4040c2060 con 0x7fc41415b580 2024-04-23T18:27:55.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.197+0000 7fc40e000640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc3f80683b0 0x7fc3f806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.197+0000 7fc40e000640 1 -- 172.21.15.28:0/3620509525 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc404123fe0 con 0x7fc41415b580 2024-04-23T18:27:55.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.197+0000 7fc40e000640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] conn(0x7fc3f8071dc0 0x7fc3f8074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.197+0000 7fc40e000640 1 -- 172.21.15.28:0/3620509525 --> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4040aaea0 con 0x7fc3f8071dc0 2024-04-23T18:27:55.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.197+0000 7fc419e00640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc3f80683b0 0x7fc3f806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.197+0000 7fc40e000640 1 -- 172.21.15.28:0/3620509525 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc4041265e0 con 0x7fc41415b580 2024-04-23T18:27:55.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.197+0000 7fc41a800640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] conn(0x7fc3f8071dc0 0x7fc3f8074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.197+0000 7fc419e00640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc3f80683b0 0x7fc3f806a870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc4080098b0 tx=0x7fc408008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.197+0000 7fc41a800640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] conn(0x7fc3f8071dc0 0x7fc3f8074260 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.201+0000 7fc40e000640 1 -- 172.21.15.28:0/3620509525 <== osd.6 v2:172.21.15.137:6816/276934842 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4040aaea0 con 0x7fc3f8071dc0 2024-04-23T18:27:55.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41c800640 1 -- 172.21.15.28:0/3620509525 --> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc414162490 con 0x7fc3f8071dc0 2024-04-23T18:27:55.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc40e000640 1 -- 172.21.15.28:0/3620509525 <== osd.6 v2:172.21.15.137:6816/276934842 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc414162490 con 0x7fc3f8071dc0 2024-04-23T18:27:55.208 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:27:55.208 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:27:55.208 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:27:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41c800640 1 -- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] conn(0x7fc3f8071dc0 msgr2=0x7fc3f8074260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41c800640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:6816/276934842,v1:172.21.15.137:6817/276934842] conn(0x7fc3f8071dc0 0x7fc3f8074260 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41c800640 1 -- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc3f80683b0 msgr2=0x7fc3f806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41c800640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fc3f80683b0 0x7fc3f806a870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc4080098b0 tx=0x7fc408008040 comp rx=0 tx=0).stop 2024-04-23T18:27:55.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41c800640 1 -- 172.21.15.28:0/3620509525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc41415b580 msgr2=0x7fc4141f28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41c800640 1 --2- 172.21.15.28:0/3620509525 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc41415b580 0x7fc4141f28e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc4040b3040 tx=0x7fc40401bab0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41a800640 1 -- 172.21.15.28:0/3620509525 reap_dead start 2024-04-23T18:27:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41c800640 1 -- 172.21.15.28:0/3620509525 shutdown_connections 2024-04-23T18:27:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41c800640 1 -- 172.21.15.28:0/3620509525 >> 172.21.15.28:0/3620509525 conn(0x7fc41406d400 msgr2=0x7fc4140c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41c800640 1 -- 172.21.15.28:0/3620509525 shutdown_connections 2024-04-23T18:27:55.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.213+0000 7fc41c800640 1 -- 172.21.15.28:0/3620509525 wait complete. 2024-04-23T18:27:55.228 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-23T18:27:55.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f9a00640 1 Processor -- start 2024-04-23T18:27:55.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f9a00640 1 -- start start 2024-04-23T18:27:55.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f9a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe1f4158f80 0x7fe1f4073c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f9a00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1f40c9850 0x7fe1f40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f9a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f40c71f0 con 0x7fe1f4071940 2024-04-23T18:27:55.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f9a00640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe1f4070d40 con 0x7fe1f40c9850 2024-04-23T18:27:55.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f9a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe1f4071d20 con 0x7fe1f4158f80 2024-04-23T18:27:55.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f3400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1f40c9850 0x7fe1f40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f3400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1f40c9850 0x7fe1f40c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33394/0 (socket says 172.21.15.28:33394) 2024-04-23T18:27:55.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f3400640 1 -- 172.21.15.28:0/3778345269 learned_addr learned my addr 172.21.15.28:0/3778345269 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:55.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1ea000640 1 --2- 172.21.15.28:0/3778345269 >> v2:172.21.15.137:3300/0 conn(0x7fe1f4158f80 0x7fe1f4073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f3400640 1 -- 172.21.15.28:0/3778345269 >> v2:172.21.15.137:3300/0 conn(0x7fe1f4158f80 msgr2=0x7fe1f4073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:55.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f3400640 1 --2- 172.21.15.28:0/3778345269 >> v2:172.21.15.137:3300/0 conn(0x7fe1f4158f80 0x7fe1f4073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f3400640 1 -- 172.21.15.28:0/3778345269 >> v1:172.21.15.137:6789/0 conn(0x7fe1f4071940 legacy=0x7fe1f40ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.377+0000 7fe1f3400640 1 -- 172.21.15.28:0/3778345269 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f4159410 con 0x7fe1f40c9850 2024-04-23T18:27:55.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f3400640 1 --2- 172.21.15.28:0/3778345269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1f40c9850 0x7fe1f40c5c60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4068640 tx=0x7fe1ec01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f423bd1adfdc1b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f2000640 1 -- 172.21.15.28:0/3778345269 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec0b5070 con 0x7fe1f40c9850 2024-04-23T18:27:55.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f2000640 1 -- 172.21.15.28:0/3778345269 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec0a8a10 con 0x7fe1f40c9850 2024-04-23T18:27:55.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f2000640 1 -- 172.21.15.28:0/3778345269 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec0a8de0 con 0x7fe1f40c9850 2024-04-23T18:27:55.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f9a00640 1 -- 172.21.15.28:0/3778345269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1f40c9850 msgr2=0x7fe1f40c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f9a00640 1 --2- 172.21.15.28:0/3778345269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1f40c9850 0x7fe1f40c5c60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4068640 tx=0x7fe1ec01ed10 comp rx=0 tx=0).stop 2024-04-23T18:27:55.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f9a00640 1 -- 172.21.15.28:0/3778345269 shutdown_connections 2024-04-23T18:27:55.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f9a00640 1 --2- 172.21.15.28:0/3778345269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1f40c9850 0x7fe1f40c5c60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f9a00640 1 --2- 172.21.15.28:0/3778345269 >> v2:172.21.15.137:3300/0 conn(0x7fe1f4158f80 0x7fe1f4073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f9a00640 1 -- 172.21.15.28:0/3778345269 >> 172.21.15.28:0/3778345269 conn(0x7fe1f4075e30 msgr2=0x7fe1f40676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:55.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f9a00640 1 -- 172.21.15.28:0/3778345269 shutdown_connections 2024-04-23T18:27:55.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.381+0000 7fe1f9a00640 1 -- 172.21.15.28:0/3778345269 wait complete. 2024-04-23T18:27:55.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f9a00640 1 Processor -- start 2024-04-23T18:27:55.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f9a00640 1 -- start start 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f9a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1f4071940 0x7fe1f414abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f9a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1f40c9850 0x7fe1f40cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f9a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1f41f1090 0x7fe1f41f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f9a00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f4159cb0 con 0x7fe1f41f1090 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f9a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f41599d0 con 0x7fe1f40c9850 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f9a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f40cc680 con 0x7fe1f4071940 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1f41f1090 0x7fe1f41f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1f41f1090 0x7fe1f41f4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33396/0 (socket says 172.21.15.28:33396) 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f3400640 1 -- 172.21.15.28:0/696650570 learned_addr learned my addr 172.21.15.28:0/696650570 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1ea000640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1f40c9850 0x7fe1f40cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f2a00640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1f4071940 0x7fe1f414abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f3400640 1 -- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1f4071940 msgr2=0x7fe1f414abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f3400640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1f4071940 0x7fe1f414abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f3400640 1 -- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1f40c9850 msgr2=0x7fe1f40cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f3400640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1f40c9850 0x7fe1f40cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f3400640 1 -- 172.21.15.28:0/696650570 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f414b2d0 con 0x7fe1f41f1090 2024-04-23T18:27:55.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f2a00640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1f4071940 0x7fe1f414abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:55.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f3400640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1f41f1090 0x7fe1f41f4d70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec01c940 tx=0x7fe1ec01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1eb400640 1 -- 172.21.15.28:0/696650570 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec0b5070 con 0x7fe1f41f1090 2024-04-23T18:27:55.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1eb400640 1 -- 172.21.15.28:0/696650570 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec0b0ac0 con 0x7fe1f41f1090 2024-04-23T18:27:55.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1eb400640 1 -- 172.21.15.28:0/696650570 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec0bb410 con 0x7fe1f41f1090 2024-04-23T18:27:55.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f9a00640 1 -- 172.21.15.28:0/696650570 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f41f15d0 con 0x7fe1f41f1090 2024-04-23T18:27:55.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f9a00640 1 -- 172.21.15.28:0/696650570 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f41f1b90 con 0x7fe1f41f1090 2024-04-23T18:27:55.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.385+0000 7fe1f9a00640 1 -- 172.21.15.28:0/696650570 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f4068db0 con 0x7fe1f41f1090 2024-04-23T18:27:55.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.389+0000 7fe1eb400640 1 -- 172.21.15.28:0/696650570 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe1ec0c2060 con 0x7fe1f41f1090 2024-04-23T18:27:55.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.389+0000 7fe1eb400640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe1d00683b0 0x7fe1d006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.389+0000 7fe1eb400640 1 -- 172.21.15.28:0/696650570 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe1ec123fb0 con 0x7fe1f41f1090 2024-04-23T18:27:55.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.389+0000 7fe1f2a00640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe1d00683b0 0x7fe1d006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.389+0000 7fe1f2a00640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe1d00683b0 0x7fe1d006a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4001710 tx=0x7fe1e4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.393+0000 7fe1eb400640 1 -- 172.21.15.28:0/696650570 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe1ec018870 con 0x7fe1f41f1090 2024-04-23T18:27:55.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.557+0000 7fe1f9a00640 1 -- 172.21.15.28:0/696650570 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fe1f414b100 con 0x7fe1d00683b0 2024-04-23T18:27:55.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.557+0000 7fe1eb400640 1 -- 172.21.15.28:0/696650570 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe1f414b100 con 0x7fe1d00683b0 2024-04-23T18:27:55.553 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 6 to deep-scrub 2024-04-23T18:27:55.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 -- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe1d00683b0 msgr2=0x7fe1d006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe1d00683b0 0x7fe1d006a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4001710 tx=0x7fe1e4009040 comp rx=0 tx=0).stop 2024-04-23T18:27:55.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 -- 172.21.15.28:0/696650570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1f41f1090 msgr2=0x7fe1f41f4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1f41f1090 0x7fe1f41f4d70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec01c940 tx=0x7fe1ec01bab0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 -- 172.21.15.28:0/696650570 shutdown_connections 2024-04-23T18:27:55.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe1d00683b0 0x7fe1d006a870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1f41f1090 0x7fe1f41f4d70 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1f40c9850 0x7fe1f40cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 --2- 172.21.15.28:0/696650570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1f4071940 0x7fe1f414abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 -- 172.21.15.28:0/696650570 >> 172.21.15.28:0/696650570 conn(0x7fe1f4075e30 msgr2=0x7fe1f4073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:55.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 -- 172.21.15.28:0/696650570 shutdown_connections 2024-04-23T18:27:55.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.561+0000 7fe1f9a00640 1 -- 172.21.15.28:0/696650570 wait complete. 2024-04-23T18:27:55.574 INFO:tasks.ceph:Scrubbing osd.7 2024-04-23T18:27:55.574 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:27:55.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.725+0000 7f07fa600640 1 Processor -- start 2024-04-23T18:27:55.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.725+0000 7f07fa600640 1 -- start start 2024-04-23T18:27:55.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07fa600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f4073220 0x7f07f40c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07fa600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f07f4073600 0x7f07f406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07fa600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07f406f5a0 0x7f07f4141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07fa600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f07f4158ff0 con 0x7f07f4073600 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07fa600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f07f40c5f20 con 0x7f07f406f5a0 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07fa600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f07f40c6200 con 0x7f07f4073220 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07ebe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f07f4073600 0x7f07f406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07ebe00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f07f4073600 0x7f07f406f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33400/0 (socket says 172.21.15.28:33400) 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07ebe00640 1 -- 172.21.15.28:0/2168335954 learned_addr learned my addr 172.21.15.28:0/2168335954 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07f3e00640 1 --2- 172.21.15.28:0/2168335954 >> v2:172.21.15.137:3300/0 conn(0x7f07f406f5a0 0x7f07f4141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07f3400640 1 --2- 172.21.15.28:0/2168335954 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f4073220 0x7f07f40c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07ebe00640 1 -- 172.21.15.28:0/2168335954 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f4073220 msgr2=0x7f07f40c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07ebe00640 1 --2- 172.21.15.28:0/2168335954 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f4073220 0x7f07f40c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07ebe00640 1 -- 172.21.15.28:0/2168335954 >> v2:172.21.15.137:3300/0 conn(0x7f07f406f5a0 msgr2=0x7f07f4141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07ebe00640 1 --2- 172.21.15.28:0/2168335954 >> v2:172.21.15.137:3300/0 conn(0x7f07f406f5a0 0x7f07f4141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07ebe00640 1 -- 172.21.15.28:0/2168335954 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f40c64e0 con 0x7f07f4073600 2024-04-23T18:27:55.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.729+0000 7f07f3e00640 1 --2- 172.21.15.28:0/2168335954 >> v2:172.21.15.137:3300/0 conn(0x7f07f406f5a0 0x7f07f4141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:27:55.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07ebe00640 1 --2- 172.21.15.28:0/2168335954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f4073600 0x7f07f406f060 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f07f40ca4e0 tx=0x7f07dc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f73b029caa10e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07f2a00640 1 -- 172.21.15.28:0/2168335954 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc0aa610 con 0x7f07f4073600 2024-04-23T18:27:55.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07f2a00640 1 -- 172.21.15.28:0/2168335954 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc0af070 con 0x7f07f4073600 2024-04-23T18:27:55.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07f2a00640 1 -- 172.21.15.28:0/2168335954 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc0aa9d0 con 0x7f07f4073600 2024-04-23T18:27:55.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07fa600640 1 -- 172.21.15.28:0/2168335954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f4073600 msgr2=0x7f07f406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07fa600640 1 --2- 172.21.15.28:0/2168335954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f4073600 0x7f07f406f060 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f07f40ca4e0 tx=0x7f07dc01c4f0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07fa600640 1 -- 172.21.15.28:0/2168335954 shutdown_connections 2024-04-23T18:27:55.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07fa600640 1 --2- 172.21.15.28:0/2168335954 >> v2:172.21.15.137:3300/0 conn(0x7f07f406f5a0 0x7f07f4141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07fa600640 1 --2- 172.21.15.28:0/2168335954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f4073600 0x7f07f406f060 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07fa600640 1 --2- 172.21.15.28:0/2168335954 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f4073220 0x7f07f40c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07fa600640 1 -- 172.21.15.28:0/2168335954 >> 172.21.15.28:0/2168335954 conn(0x7f07f406d400 msgr2=0x7f07f40676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:55.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07fa600640 1 -- 172.21.15.28:0/2168335954 shutdown_connections 2024-04-23T18:27:55.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07fa600640 1 -- 172.21.15.28:0/2168335954 wait complete. 2024-04-23T18:27:55.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07fa600640 1 Processor -- start 2024-04-23T18:27:55.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.733+0000 7f07fa600640 1 -- start start 2024-04-23T18:27:55.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07fa600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f4073220 0x7f07f4157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07fa600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f4073600 0x7f07f413a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07fa600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f41547b0 0x7f07f413ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07fa600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f07f40c90c0 con 0x7f07f4073220 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07fa600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f07f40c71f0 con 0x7f07f41547b0 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07fa600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f07f40c9240 con 0x7f07f4073600 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07f3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f4073220 0x7f07f4157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07f3400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f4073220 0x7f07f4157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33410/0 (socket says 172.21.15.28:33410) 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07f3400640 1 -- 172.21.15.28:0/3994335683 learned_addr learned my addr 172.21.15.28:0/3994335683 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07ebe00640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f4073600 0x7f07f413a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07f3e00640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f41547b0 0x7f07f413ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07f3400640 1 -- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f4073600 msgr2=0x7f07f413a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07f3400640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f07f4073600 0x7f07f413a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07f3400640 1 -- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f41547b0 msgr2=0x7f07f413ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07f3400640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f41547b0 0x7f07f413ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07f3400640 1 -- 172.21.15.28:0/3994335683 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f4158d00 con 0x7f07f4073220 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07f3400640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f4073220 0x7f07f4157c30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f07e400d830 tx=0x7f07e400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07eb400640 1 -- 172.21.15.28:0/3994335683 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e400b6c0 con 0x7f07f4073220 2024-04-23T18:27:55.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07eb400640 1 -- 172.21.15.28:0/3994335683 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e4019070 con 0x7f07f4073220 2024-04-23T18:27:55.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07fa600640 1 -- 172.21.15.28:0/3994335683 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f4154fe0 con 0x7f07f4073220 2024-04-23T18:27:55.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07eb400640 1 -- 172.21.15.28:0/3994335683 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e400ba60 con 0x7f07f4073220 2024-04-23T18:27:55.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07fa600640 1 -- 172.21.15.28:0/3994335683 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f4156210 con 0x7f07f4073220 2024-04-23T18:27:55.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07fa600640 1 -- 172.21.15.28:0/3994335683 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f07f4068e50 con 0x7f07f4073220 2024-04-23T18:27:55.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.737+0000 7f07eb400640 1 -- 172.21.15.28:0/3994335683 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f07e401e460 con 0x7f07f4073220 2024-04-23T18:27:55.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.741+0000 7f07eb400640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f07d0068380 0x7f07d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.741+0000 7f07eb400640 1 -- 172.21.15.28:0/3994335683 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f07e4087540 con 0x7f07f4073220 2024-04-23T18:27:55.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.741+0000 7f07eb400640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] conn(0x7f07d0071da0 0x7f07d0074240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.741+0000 7f07eb400640 1 -- 172.21.15.28:0/3994335683 --> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07d0074910 con 0x7f07d0071da0 2024-04-23T18:27:55.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.741+0000 7f07eb400640 1 -- 172.21.15.28:0/3994335683 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f07e408e050 con 0x7f07f4073220 2024-04-23T18:27:55.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.741+0000 7f07ebe00640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f07d0068380 0x7f07d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.741+0000 7f07f3e00640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] conn(0x7f07d0071da0 0x7f07d0074240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.741+0000 7f07ebe00640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f07d0068380 0x7f07d006a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0ae000 tx=0x7f07dc0a7000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.741+0000 7f07f3e00640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] conn(0x7f07d0071da0 0x7f07d0074240 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.741+0000 7f07eb400640 1 -- 172.21.15.28:0/3994335683 <== osd.7 v2:172.21.15.137:6800/2261796983 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f07d0074910 con 0x7f07d0071da0 2024-04-23T18:27:55.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07fa600640 1 -- 172.21.15.28:0/3994335683 --> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f07f4136970 con 0x7f07d0071da0 2024-04-23T18:27:55.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07eb400640 1 -- 172.21.15.28:0/3994335683 <== osd.7 v2:172.21.15.137:6800/2261796983 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f07f4136970 con 0x7f07d0071da0 2024-04-23T18:27:55.752 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-04-23T18:27:55.752 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:27:55.752 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-04-23T18:27:55.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07fa600640 1 -- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] conn(0x7f07d0071da0 msgr2=0x7f07d0074240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07fa600640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:6800/2261796983,v1:172.21.15.137:6801/2261796983] conn(0x7f07d0071da0 0x7f07d0074240 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07fa600640 1 -- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f07d0068380 msgr2=0x7f07d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07fa600640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f07d0068380 0x7f07d006a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0ae000 tx=0x7f07dc0a7000 comp rx=0 tx=0).stop 2024-04-23T18:27:55.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07fa600640 1 -- 172.21.15.28:0/3994335683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f4073220 msgr2=0x7f07f4157c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07fa600640 1 --2- 172.21.15.28:0/3994335683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07f4073220 0x7f07f4157c30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f07e400d830 tx=0x7f07e400dcf0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07f3e00640 1 -- 172.21.15.28:0/3994335683 reap_dead start 2024-04-23T18:27:55.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07fa600640 1 -- 172.21.15.28:0/3994335683 shutdown_connections 2024-04-23T18:27:55.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07fa600640 1 -- 172.21.15.28:0/3994335683 >> 172.21.15.28:0/3994335683 conn(0x7f07f406d400 msgr2=0x7f07f40cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:55.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07fa600640 1 -- 172.21.15.28:0/3994335683 shutdown_connections 2024-04-23T18:27:55.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.757+0000 7f07fa600640 1 -- 172.21.15.28:0/3994335683 wait complete. 2024-04-23T18:27:55.770 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-23T18:27:55.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b2e200640 1 Processor -- start 2024-04-23T18:27:55.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b2e200640 1 -- start start 2024-04-23T18:27:55.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b2e200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8b280c71b0 0x7f8b2806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b2e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b280c7590 0x7f8b2815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b2e200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8b28159d30 0x7f8b28152f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b2e200640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f8b2815d560 con 0x7f8b280c71b0 2024-04-23T18:27:55.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b2e200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8b2806fcf0 con 0x7f8b28159d30 2024-04-23T18:27:55.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b2e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8b28159290 con 0x7f8b280c7590 2024-04-23T18:27:55.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b27400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8b280c71b0 0x7f8b2806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b27400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8b280c71b0 0x7f8b2806f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33420/0 (socket says 172.21.15.28:33420) 2024-04-23T18:27:55.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b27400640 1 -- 172.21.15.28:0/1825896001 learned_addr learned my addr 172.21.15.28:0/1825896001 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:55.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b1fe00640 1 --2- 172.21.15.28:0/1825896001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b280c7590 0x7f8b2815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b27e00640 1 --2- 172.21.15.28:0/1825896001 >> v2:172.21.15.137:3300/0 conn(0x7f8b28159d30 0x7f8b28152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b27400640 1 -- 172.21.15.28:0/1825896001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b280c7590 msgr2=0x7f8b2815c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:55.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b27400640 1 --2- 172.21.15.28:0/1825896001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b280c7590 0x7f8b2815c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b27400640 1 -- 172.21.15.28:0/1825896001 >> v2:172.21.15.137:3300/0 conn(0x7f8b28159d30 msgr2=0x7f8b28152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:55.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b27400640 1 --2- 172.21.15.28:0/1825896001 >> v2:172.21.15.137:3300/0 conn(0x7f8b28159d30 0x7f8b28152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.917+0000 7f8b27400640 1 -- 172.21.15.28:0/1825896001 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b28073d80 con 0x7f8b280c71b0 2024-04-23T18:27:55.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b27400640 1 --2- 172.21.15.28:0/1825896001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b280c71b0 0x7f8b2806f7b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8b28071de0 tx=0x7f8b1801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1648bf75ab33142 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b26a00640 1 -- 172.21.15.28:0/1825896001 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b180b5070 con 0x7f8b280c71b0 2024-04-23T18:27:55.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b26a00640 1 -- 172.21.15.28:0/1825896001 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b180a89d0 con 0x7f8b280c71b0 2024-04-23T18:27:55.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b26a00640 1 -- 172.21.15.28:0/1825896001 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b180a8da0 con 0x7f8b280c71b0 2024-04-23T18:27:55.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b2e200640 1 -- 172.21.15.28:0/1825896001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b280c71b0 msgr2=0x7f8b2806f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b2e200640 1 --2- 172.21.15.28:0/1825896001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b280c71b0 0x7f8b2806f7b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8b28071de0 tx=0x7f8b1801ed10 comp rx=0 tx=0).stop 2024-04-23T18:27:55.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b2e200640 1 -- 172.21.15.28:0/1825896001 shutdown_connections 2024-04-23T18:27:55.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b2e200640 1 --2- 172.21.15.28:0/1825896001 >> v2:172.21.15.137:3300/0 conn(0x7f8b28159d30 0x7f8b28152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b2e200640 1 --2- 172.21.15.28:0/1825896001 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b280c7590 0x7f8b2815c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b2e200640 1 --2- 172.21.15.28:0/1825896001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b280c71b0 0x7f8b2806f7b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b2e200640 1 -- 172.21.15.28:0/1825896001 >> 172.21.15.28:0/1825896001 conn(0x7f8b280cd840 msgr2=0x7f8b280cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:55.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b2e200640 1 -- 172.21.15.28:0/1825896001 shutdown_connections 2024-04-23T18:27:55.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.921+0000 7f8b2e200640 1 -- 172.21.15.28:0/1825896001 wait complete. 2024-04-23T18:27:55.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b2e200640 1 Processor -- start 2024-04-23T18:27:55.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b2e200640 1 -- start start 2024-04-23T18:27:55.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b2e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b280c71b0 0x7f8b2815c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b2e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b280c7590 0x7f8b2814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b2e200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b28159d30 0x7f8b28158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b2e200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8b28159530 con 0x7f8b28159d30 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b2e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2815d280 con 0x7f8b280c71b0 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b2e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f8b28159810 con 0x7f8b280c7590 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b27e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b28159d30 0x7f8b28158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b27e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b28159d30 0x7f8b28158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33434/0 (socket says 172.21.15.28:33434) 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b27e00640 1 -- 172.21.15.28:0/3857198213 learned_addr learned my addr 172.21.15.28:0/3857198213 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b1fe00640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b280c7590 0x7f8b2814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b27400640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b280c71b0 0x7f8b2815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b27e00640 1 -- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b280c7590 msgr2=0x7f8b2814e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b27e00640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b280c7590 0x7f8b2814e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b27e00640 1 -- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b280c71b0 msgr2=0x7f8b2815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b27e00640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b280c71b0 0x7f8b2815c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b27e00640 1 -- 172.21.15.28:0/3857198213 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b28069420 con 0x7f8b28159d30 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b27e00640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b28159d30 0x7f8b28158070 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8b20007d90 tx=0x7f8b2000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b1f400640 1 -- 172.21.15.28:0/3857198213 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20014420 con 0x7f8b28159d30 2024-04-23T18:27:55.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b1f400640 1 -- 172.21.15.28:0/3857198213 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b20019070 con 0x7f8b28159d30 2024-04-23T18:27:55.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b1f400640 1 -- 172.21.15.28:0/3857198213 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20014820 con 0x7f8b28159d30 2024-04-23T18:27:55.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b2e200640 1 -- 172.21.15.28:0/3857198213 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b280c8700 con 0x7f8b28159d30 2024-04-23T18:27:55.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.925+0000 7f8b2e200640 1 -- 172.21.15.28:0/3857198213 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b281f2f10 con 0x7f8b28159d30 2024-04-23T18:27:55.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.929+0000 7f8b2e200640 1 -- 172.21.15.28:0/3857198213 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b28068db0 con 0x7f8b28159d30 2024-04-23T18:27:55.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.929+0000 7f8b1f400640 1 -- 172.21.15.28:0/3857198213 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8b200149c0 con 0x7f8b28159d30 2024-04-23T18:27:55.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.929+0000 7f8b1f400640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8b040683b0 0x7f8b0406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:55.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.929+0000 7f8b1f400640 1 -- 172.21.15.28:0/3857198213 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8b20087440 con 0x7f8b28159d30 2024-04-23T18:27:55.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.929+0000 7f8b27400640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8b040683b0 0x7f8b0406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:55.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.933+0000 7f8b27400640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8b040683b0 0x7f8b0406a870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8b180b2000 tx=0x7f8b18008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:55.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:55.937+0000 7f8b1f400640 1 -- 172.21.15.28:0/3857198213 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b20056f20 con 0x7f8b28159d30 2024-04-23T18:27:56.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.101+0000 7f8b2e200640 1 -- 172.21.15.28:0/3857198213 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f8b281f31f0 con 0x7f8b040683b0 2024-04-23T18:27:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.101+0000 7f8b1f400640 1 -- 172.21.15.28:0/3857198213 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8b281f31f0 con 0x7f8b040683b0 2024-04-23T18:27:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 7 to deep-scrub 2024-04-23T18:27:56.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 -- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8b040683b0 msgr2=0x7f8b0406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:56.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8b040683b0 0x7f8b0406a870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8b180b2000 tx=0x7f8b18008040 comp rx=0 tx=0).stop 2024-04-23T18:27:56.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 -- 172.21.15.28:0/3857198213 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b28159d30 msgr2=0x7f8b28158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:56.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b28159d30 0x7f8b28158070 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8b20007d90 tx=0x7f8b2000e4b0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 -- 172.21.15.28:0/3857198213 shutdown_connections 2024-04-23T18:27:56.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8b040683b0 0x7f8b0406a870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8b280c7590 0x7f8b2814e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8b28159d30 0x7f8b28158070 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 --2- 172.21.15.28:0/3857198213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b280c71b0 0x7f8b2815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 -- 172.21.15.28:0/3857198213 >> 172.21.15.28:0/3857198213 conn(0x7f8b280cd840 msgr2=0x7f8b28072f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:56.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 -- 172.21.15.28:0/3857198213 shutdown_connections 2024-04-23T18:27:56.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.105+0000 7f8b2e200640 1 -- 172.21.15.28:0/3857198213 wait complete. 2024-04-23T18:27:56.119 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:27:56.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f873ca00640 1 Processor -- start 2024-04-23T18:27:56.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f873ca00640 1 -- start start 2024-04-23T18:27:56.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f873ca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f873815d160 0x7f87380710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:56.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f873ca00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f873815b650 con 0x7f87381444e0 2024-04-23T18:27:56.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f873ca00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f873815b930 con 0x7f87380c91e0 2024-04-23T18:27:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f873ca00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f873815bc10 con 0x7f873815d160 2024-04-23T18:27:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8735e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f87381444e0 0x7f8738072dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33678/0 (socket says 172.21.15.28:33678) 2024-04-23T18:27:56.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8735e00640 1 -- 172.21.15.28:0/2827661502 learned_addr learned my addr 172.21.15.28:0/2827661502 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:27:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8736800640 1 --2- 172.21.15.28:0/2827661502 >> v2:172.21.15.137:3300/0 conn(0x7f873815d160 0x7f87380710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1594947866 0 0) 0x7f873815b650 con 0x7f87381444e0 2024-04-23T18:27:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f871c003530 con 0x7f87381444e0 2024-04-23T18:27:56.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2609032555 0 0) 0x7f871c003530 con 0x7f87381444e0 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 >> v2:172.21.15.137:3300/0 conn(0x7f873815d160 msgr2=0x7f87380710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 --2- 172.21.15.28:0/2827661502 >> v2:172.21.15.137:3300/0 conn(0x7f873815d160 0x7f87380710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 >> v1:172.21.15.137:6789/0 conn(0x7f87380c91e0 legacy=0x7f873815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873815bef0 con 0x7f87381444e0 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7f8728001680 con 0x7f87381444e0 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 >> v1:172.21.15.28:6789/0 conn(0x7f87381444e0 legacy=0x7f8738072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 --2- 172.21.15.28:0/2827661502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f871c0039c0 0x7f871c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 --2- 172.21.15.28:0/2827661502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f871c004810 0x7f871c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 --2- 172.21.15.28:0/2827661502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f871c0051d0 0x7f871c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f873815bc10 con 0x7f871c0051d0 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f871c00c080 con 0x7f871c004810 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f871c00c280 con 0x7f871c0039c0 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8736800640 1 --2- 172.21.15.28:0/2827661502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f871c0051d0 0x7f871c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:56.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8735e00640 1 --2- 172.21.15.28:0/2827661502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f871c0039c0 0x7f871c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:56.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8735400640 1 --2- 172.21.15.28:0/2827661502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f871c004810 0x7f871c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:56.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8736800640 1 -- 172.21.15.28:0/2827661502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f871c0039c0 msgr2=0x7f871c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:56.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8736800640 1 --2- 172.21.15.28:0/2827661502 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f871c0039c0 0x7f871c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8736800640 1 -- 172.21.15.28:0/2827661502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f871c004810 msgr2=0x7f871c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:27:56.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8736800640 1 --2- 172.21.15.28:0/2827661502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f871c004810 0x7f871c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.269+0000 7f8736800640 1 -- 172.21.15.28:0/2827661502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871c003530 con 0x7f871c0051d0 2024-04-23T18:27:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f8736800640 1 -- 172.21.15.28:0/2827661502 reap_dead start 2024-04-23T18:27:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f8736800640 1 --2- 172.21.15.28:0/2827661502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f871c0051d0 0x7f871c00b9d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8730009fc0 tx=0x7f873001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ff1ccce77ea641 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730009c10 con 0x7f871c0051d0 2024-04-23T18:27:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87300a5cd0 con 0x7f871c0051d0 2024-04-23T18:27:56.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f8734a00640 1 -- 172.21.15.28:0/2827661502 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730003be0 con 0x7f871c0051d0 2024-04-23T18:27:56.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f873ca00640 1 -- 172.21.15.28:0/2827661502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f871c0051d0 msgr2=0x7f871c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:56.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f873ca00640 1 --2- 172.21.15.28:0/2827661502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f871c0051d0 0x7f871c00b9d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8730009fc0 tx=0x7f873001ccc0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f873ca00640 1 -- 172.21.15.28:0/2827661502 shutdown_connections 2024-04-23T18:27:56.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f873ca00640 1 --2- 172.21.15.28:0/2827661502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f871c0051d0 0x7f871c00b9d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f873ca00640 1 -- 172.21.15.28:0/2827661502 >> 172.21.15.28:0/2827661502 conn(0x7f87380676e0 msgr2=0x7f8738067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:56.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f873ca00640 1 -- 172.21.15.28:0/2827661502 shutdown_connections 2024-04-23T18:27:56.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.273+0000 7f873ca00640 1 -- 172.21.15.28:0/2827661502 wait complete. 2024-04-23T18:27:56.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f873ca00640 1 Processor -- start 2024-04-23T18:27:56.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f873ca00640 1 -- start start 2024-04-23T18:27:56.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f873ca00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f871c0051d0 0x7f873815ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f873ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87381f0c90 0x7f8738158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f873ca00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87381588d0 0x7f87381595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f873ca00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8738144a40 con 0x7f87381588d0 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f873ca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87381448c0 con 0x7f87381f0c90 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f873ca00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f873815b300 con 0x7f871c0051d0 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f8736800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87381588d0 0x7f87381595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f8736800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87381588d0 0x7f87381595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33454/0 (socket says 172.21.15.28:33454) 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f8736800640 1 -- 172.21.15.28:0/3744287337 learned_addr learned my addr 172.21.15.28:0/3744287337 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f8735e00640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f871c0051d0 0x7f873815ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f8735400640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87381f0c90 0x7f8738158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f8736800640 1 -- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f871c0051d0 msgr2=0x7f873815ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f8736800640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f871c0051d0 0x7f873815ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f8736800640 1 -- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87381f0c90 msgr2=0x7f8738158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:56.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f8736800640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87381f0c90 0x7f8738158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f8736800640 1 -- 172.21.15.28:0/3744287337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87381427e0 con 0x7f87381588d0 2024-04-23T18:27:56.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f8736800640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87381588d0 0x7f87381595e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f87300987f0 tx=0x7f8730009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:56.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f872e000640 1 -- 172.21.15.28:0/3744287337 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87300aed70 con 0x7f87381588d0 2024-04-23T18:27:56.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f872e000640 1 -- 172.21.15.28:0/3744287337 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87300bd070 con 0x7f87381588d0 2024-04-23T18:27:56.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f873ca00640 1 -- 172.21.15.28:0/3744287337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87381f1140 con 0x7f87381588d0 2024-04-23T18:27:56.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f872e000640 1 -- 172.21.15.28:0/3744287337 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730003ba0 con 0x7f87381588d0 2024-04-23T18:27:56.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f873ca00640 1 -- 172.21.15.28:0/3744287337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87381f1700 con 0x7f87381588d0 2024-04-23T18:27:56.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.277+0000 7f873ca00640 1 -- 172.21.15.28:0/3744287337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8738068cd0 con 0x7f87381588d0 2024-04-23T18:27:56.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.281+0000 7f872e000640 1 -- 172.21.15.28:0/3744287337 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8730004030 con 0x7f87381588d0 2024-04-23T18:27:56.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.281+0000 7f872e000640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8718068380 0x7f871806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:27:56.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.281+0000 7f872e000640 1 -- 172.21.15.28:0/3744287337 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f8730122a60 con 0x7f87381588d0 2024-04-23T18:27:56.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.281+0000 7f8735e00640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8718068380 0x7f871806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:27:56.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.281+0000 7f8735e00640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8718068380 0x7f871806a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8728000c10 tx=0x7f8728009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:27:56.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.285+0000 7f872e000640 1 -- 172.21.15.28:0/3744287337 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f87381427e0 con 0x7f87381588d0 2024-04-23T18:27:56.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.449+0000 7f873ca00640 1 -- 172.21.15.28:0/3744287337 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87381419c0 con 0x7f8718068380 2024-04-23T18:27:56.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.473+0000 7f872e000640 1 -- 172.21.15.28:0/3744287337 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+331223 (secure 0 0 0) 0x7f87381419c0 con 0x7f8718068380 2024-04-23T18:27:56.470 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:27:56.472 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:27:56.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 -- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8718068380 msgr2=0x7f871806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:56.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8718068380 0x7f871806a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8728000c10 tx=0x7f8728009040 comp rx=0 tx=0).stop 2024-04-23T18:27:56.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 -- 172.21.15.28:0/3744287337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87381588d0 msgr2=0x7f87381595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:27:56.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87381588d0 0x7f87381595e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f87300987f0 tx=0x7f8730009750 comp rx=0 tx=0).stop 2024-04-23T18:27:56.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 -- 172.21.15.28:0/3744287337 shutdown_connections 2024-04-23T18:27:56.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f8718068380 0x7f871806a840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87381588d0 0x7f87381595e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87381f0c90 0x7f8738158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 --2- 172.21.15.28:0/3744287337 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f871c0051d0 0x7f873815ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:27:56.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 -- 172.21.15.28:0/3744287337 >> 172.21.15.28:0/3744287337 conn(0x7f87380676e0 msgr2=0x7f8738070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:27:56.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 -- 172.21.15.28:0/3744287337 shutdown_connections 2024-04-23T18:27:56.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:27:56.477+0000 7f873ca00640 1 -- 172.21.15.28:0/3744287337 wait complete. 2024-04-23T18:27:56.490 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-04-23T18:27:55.444793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4563132,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":121,"num_read_kb":105,"num_write":11536,"num_write_kb":25172377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13510,"ondisk_log_size":13510,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":502000,"kb_used_data":11248,"kb_used_omap":12,"kb_used_meta":490675,"kb_avail":754472720,"statfs":{"total":773094113280,"available":772580065280,"internally_reserved":0,"allocated":11517952,"data_stored":10039954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":502451760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737407900,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2585,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003611"},"pg_stats":[{"pgid":"2.1f","version":"24'9","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:26:44.459196+0000","last_change":"2024-04-23T18:22:32.386555+0000","last_active":"2024-04-23T18:26:44.459196+0000","last_peered":"2024-04-23T18:26:44.459196+0000","last_clean":"2024-04-23T18:26:44.459196+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:26:44.459196+0000","last_undegraded":"2024-04-23T18:26:44.459196+0000","last_fullsized":"2024-04-23T18:26:44.459196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.843257+0000","last_change":"2024-04-23T18:23:14.723733+0000","last_active":"2024-04-23T18:27:48.843257+0000","last_peered":"2024-04-23T18:27:48.843257+0000","last_clean":"2024-04-23T18:27:48.843257+0000","last_became_active":"2024-04-23T18:23:14.723423+0000","last_became_peered":"2024-04-23T18:23:14.723423+0000","last_unstale":"2024-04-23T18:27:48.843257+0000","last_undegraded":"2024-04-23T18:27:48.843257+0000","last_fullsized":"2024-04-23T18:27:48.843257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"26'360","reported_seq":381,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.657046+0000","last_change":"2024-04-23T18:22:37.722640+0000","last_active":"2024-04-23T18:27:47.657046+0000","last_peered":"2024-04-23T18:27:47.657046+0000","last_clean":"2024-04-23T18:27:47.657046+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:27:47.657046+0000","last_undegraded":"2024-04-23T18:27:47.657046+0000","last_fullsized":"2024-04-23T18:27:47.657046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:26:34.442497+0000","last_change":"2024-04-23T18:22:32.369284+0000","last_active":"2024-04-23T18:26:34.442497+0000","last_peered":"2024-04-23T18:26:34.442497+0000","last_clean":"2024-04-23T18:26:34.442497+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:26:34.442497+0000","last_undegraded":"2024-04-23T18:26:34.442497+0000","last_fullsized":"2024-04-23T18:26:34.442497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.864535+0000","last_change":"2024-04-23T18:22:33.379688+0000","last_active":"2024-04-23T18:27:48.864535+0000","last_peered":"2024-04-23T18:27:48.864535+0000","last_clean":"2024-04-23T18:27:48.864535+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:27:48.864535+0000","last_undegraded":"2024-04-23T18:27:48.864535+0000","last_fullsized":"2024-04-23T18:27:48.864535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'377","reported_seq":397,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.619066+0000","last_change":"2024-04-23T18:22:37.430178+0000","last_active":"2024-04-23T18:27:47.619066+0000","last_peered":"2024-04-23T18:27:47.619066+0000","last_clean":"2024-04-23T18:27:47.619066+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:27:47.619066+0000","last_undegraded":"2024-04-23T18:27:47.619066+0000","last_fullsized":"2024-04-23T18:27:47.619066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.255135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430064+0000","last_change":"2024-04-23T18:22:32.400061+0000","last_active":"2024-04-23T18:25:04.430064+0000","last_peered":"2024-04-23T18:25:04.430064+0000","last_clean":"2024-04-23T18:25:04.430064+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:25:04.430064+0000","last_undegraded":"2024-04-23T18:25:04.430064+0000","last_fullsized":"2024-04-23T18:25:04.430064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:01.836908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.874251+0000","last_change":"2024-04-23T18:22:33.392679+0000","last_active":"2024-04-23T18:27:48.874251+0000","last_peered":"2024-04-23T18:27:48.874251+0000","last_clean":"2024-04-23T18:27:48.874251+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:27:48.874251+0000","last_undegraded":"2024-04-23T18:27:48.874251+0000","last_fullsized":"2024-04-23T18:27:48.874251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:23:06.170710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'324","reported_seq":344,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.383502+0000","last_change":"2024-04-23T18:22:37.416757+0000","last_active":"2024-04-23T18:27:47.383502+0000","last_peered":"2024-04-23T18:27:47.383502+0000","last_clean":"2024-04-23T18:27:47.383502+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:27:47.383502+0000","last_undegraded":"2024-04-23T18:27:47.383502+0000","last_fullsized":"2024-04-23T18:27:47.383502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:57:21.669923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.430032+0000","last_change":"2024-04-23T18:22:32.403630+0000","last_active":"2024-04-23T18:25:04.430032+0000","last_peered":"2024-04-23T18:25:04.430032+0000","last_clean":"2024-04-23T18:25:04.430032+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:25:04.430032+0000","last_undegraded":"2024-04-23T18:25:04.430032+0000","last_fullsized":"2024-04-23T18:25:04.430032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:51.633927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.869671+0000","last_change":"2024-04-23T18:22:33.393383+0000","last_active":"2024-04-23T18:27:48.869671+0000","last_peered":"2024-04-23T18:27:48.869671+0000","last_clean":"2024-04-23T18:27:48.869671+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:27:48.869671+0000","last_undegraded":"2024-04-23T18:27:48.869671+0000","last_fullsized":"2024-04-23T18:27:48.869671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:59.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'298","reported_seq":318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.629360+0000","last_change":"2024-04-23T18:22:37.435287+0000","last_active":"2024-04-23T18:27:47.629360+0000","last_peered":"2024-04-23T18:27:47.629360+0000","last_clean":"2024-04-23T18:27:47.629360+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:27:47.629360+0000","last_undegraded":"2024-04-23T18:27:47.629360+0000","last_fullsized":"2024-04-23T18:27:47.629360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:25:46.579725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.864125+0000","last_change":"2024-04-23T18:22:33.390966+0000","last_active":"2024-04-23T18:27:48.864125+0000","last_peered":"2024-04-23T18:27:48.864125+0000","last_clean":"2024-04-23T18:27:48.864125+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:27:48.864125+0000","last_undegraded":"2024-04-23T18:27:48.864125+0000","last_fullsized":"2024-04-23T18:27:48.864125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:57:15.987077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:51.515161+0000","last_change":"2024-04-23T18:22:32.401276+0000","last_active":"2024-04-23T18:24:51.515161+0000","last_peered":"2024-04-23T18:24:51.515161+0000","last_clean":"2024-04-23T18:24:51.515161+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:24:51.515161+0000","last_undegraded":"2024-04-23T18:24:51.515161+0000","last_fullsized":"2024-04-23T18:24:51.515161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:54:17.544416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'366","reported_seq":386,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.608539+0000","last_change":"2024-04-23T18:22:37.422739+0000","last_active":"2024-04-23T18:27:47.608539+0000","last_peered":"2024-04-23T18:27:47.608539+0000","last_clean":"2024-04-23T18:27:47.608539+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:27:47.608539+0000","last_undegraded":"2024-04-23T18:27:47.608539+0000","last_fullsized":"2024-04-23T18:27:47.608539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:42.676709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'8","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.852893+0000","last_change":"2024-04-23T18:22:33.370696+0000","last_active":"2024-04-23T18:27:48.852893+0000","last_peered":"2024-04-23T18:27:48.852893+0000","last_clean":"2024-04-23T18:27:48.852893+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:27:48.852893+0000","last_undegraded":"2024-04-23T18:27:48.852893+0000","last_fullsized":"2024-04-23T18:27:48.852893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'2","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:54.370442+0000","last_change":"2024-04-23T18:27:54.370483+0000","last_active":"2024-04-23T18:27:54.370442+0000","last_peered":"2024-04-23T18:27:54.370442+0000","last_clean":"2024-04-23T18:27:54.370442+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:27:54.370442+0000","last_undegraded":"2024-04-23T18:27:54.370442+0000","last_fullsized":"2024-04-23T18:27:54.370442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-23T18:27:54.370351+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-23T18:27:54.370351+0000","last_clean_scrub_stamp":"2024-04-23T18:27:54.370351+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:57.883732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'330","reported_seq":350,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.646047+0000","last_change":"2024-04-23T18:22:37.422168+0000","last_active":"2024-04-23T18:27:47.646047+0000","last_peered":"2024-04-23T18:27:47.646047+0000","last_clean":"2024-04-23T18:27:47.646047+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:27:47.646047+0000","last_undegraded":"2024-04-23T18:27:47.646047+0000","last_fullsized":"2024-04-23T18:27:47.646047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'9","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.851996+0000","last_change":"2024-04-23T18:22:33.362302+0000","last_active":"2024-04-23T18:27:48.851996+0000","last_peered":"2024-04-23T18:27:48.851996+0000","last_clean":"2024-04-23T18:27:48.851996+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:27:48.851996+0000","last_undegraded":"2024-04-23T18:27:48.851996+0000","last_fullsized":"2024-04-23T18:27:48.851996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:26:54.560925+0000","last_change":"2024-04-23T18:22:32.379169+0000","last_active":"2024-04-23T18:26:54.560925+0000","last_peered":"2024-04-23T18:26:54.560925+0000","last_clean":"2024-04-23T18:26:54.560925+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:26:54.560925+0000","last_undegraded":"2024-04-23T18:26:54.560925+0000","last_fullsized":"2024-04-23T18:26:54.560925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'321","reported_seq":342,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.646128+0000","last_change":"2024-04-23T18:22:37.713660+0000","last_active":"2024-04-23T18:27:47.646128+0000","last_peered":"2024-04-23T18:27:47.646128+0000","last_clean":"2024-04-23T18:27:47.646128+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:27:47.646128+0000","last_undegraded":"2024-04-23T18:27:47.646128+0000","last_fullsized":"2024-04-23T18:27:47.646128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.774903+0000","last_change":"2024-04-23T18:22:33.370909+0000","last_active":"2024-04-23T18:27:48.774903+0000","last_peered":"2024-04-23T18:27:48.774903+0000","last_clean":"2024-04-23T18:27:48.774903+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:27:48.774903+0000","last_undegraded":"2024-04-23T18:27:48.774903+0000","last_fullsized":"2024-04-23T18:27:48.774903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:07.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:44.418867+0000","last_change":"2024-04-23T18:22:32.396578+0000","last_active":"2024-04-23T18:24:44.418867+0000","last_peered":"2024-04-23T18:24:44.418867+0000","last_clean":"2024-04-23T18:24:44.418867+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:24:44.418867+0000","last_undegraded":"2024-04-23T18:24:44.418867+0000","last_fullsized":"2024-04-23T18:24:44.418867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:13.972999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'339","reported_seq":359,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.657146+0000","last_change":"2024-04-23T18:22:37.416993+0000","last_active":"2024-04-23T18:27:47.657146+0000","last_peered":"2024-04-23T18:27:47.657146+0000","last_clean":"2024-04-23T18:27:47.657146+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:27:47.657146+0000","last_undegraded":"2024-04-23T18:27:47.657146+0000","last_fullsized":"2024-04-23T18:27:47.657146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:17:18.749220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.850965+0000","last_change":"2024-04-23T18:22:33.360395+0000","last_active":"2024-04-23T18:27:48.850965+0000","last_peered":"2024-04-23T18:27:48.850965+0000","last_clean":"2024-04-23T18:27:48.850965+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:27:48.850965+0000","last_undegraded":"2024-04-23T18:27:48.850965+0000","last_fullsized":"2024-04-23T18:27:48.850965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:26:54.478851+0000","last_change":"2024-04-23T18:22:32.392132+0000","last_active":"2024-04-23T18:26:54.478851+0000","last_peered":"2024-04-23T18:26:54.478851+0000","last_clean":"2024-04-23T18:26:54.478851+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:26:54.478851+0000","last_undegraded":"2024-04-23T18:26:54.478851+0000","last_fullsized":"2024-04-23T18:26:54.478851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'306","reported_seq":326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.652805+0000","last_change":"2024-04-23T18:22:37.723423+0000","last_active":"2024-04-23T18:27:47.652805+0000","last_peered":"2024-04-23T18:27:47.652805+0000","last_clean":"2024-04-23T18:27:47.652805+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:27:47.652805+0000","last_undegraded":"2024-04-23T18:27:47.652805+0000","last_fullsized":"2024-04-23T18:27:47.652805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.852960+0000","last_change":"2024-04-23T18:22:33.380670+0000","last_active":"2024-04-23T18:27:48.852960+0000","last_peered":"2024-04-23T18:27:48.852960+0000","last_clean":"2024-04-23T18:27:48.852960+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:27:48.852960+0000","last_undegraded":"2024-04-23T18:27:48.852960+0000","last_fullsized":"2024-04-23T18:27:48.852960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'26","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:49.450193+0000","last_change":"2024-04-23T18:22:32.372852+0000","last_active":"2024-04-23T18:27:49.450193+0000","last_peered":"2024-04-23T18:27:49.450193+0000","last_clean":"2024-04-23T18:27:49.450193+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:27:49.450193+0000","last_undegraded":"2024-04-23T18:27:49.450193+0000","last_fullsized":"2024-04-23T18:27:49.450193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'328","reported_seq":349,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.615548+0000","last_change":"2024-04-23T18:22:37.711418+0000","last_active":"2024-04-23T18:27:47.615548+0000","last_peered":"2024-04-23T18:27:47.615548+0000","last_clean":"2024-04-23T18:27:47.615548+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:27:47.615548+0000","last_undegraded":"2024-04-23T18:27:47.615548+0000","last_fullsized":"2024-04-23T18:27:47.615548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'9","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.857655+0000","last_change":"2024-04-23T18:22:33.368328+0000","last_active":"2024-04-23T18:27:48.857655+0000","last_peered":"2024-04-23T18:27:48.857655+0000","last_clean":"2024-04-23T18:27:48.857655+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:27:48.857655+0000","last_undegraded":"2024-04-23T18:27:48.857655+0000","last_fullsized":"2024-04-23T18:27:48.857655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.418044+0000","last_change":"2024-04-23T18:22:32.400705+0000","last_active":"2024-04-23T18:24:39.418044+0000","last_peered":"2024-04-23T18:24:39.418044+0000","last_clean":"2024-04-23T18:24:39.418044+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:24:39.418044+0000","last_undegraded":"2024-04-23T18:24:39.418044+0000","last_fullsized":"2024-04-23T18:24:39.418044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:07:34.822498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'297","reported_seq":318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.657842+0000","last_change":"2024-04-23T18:22:37.712692+0000","last_active":"2024-04-23T18:27:47.657842+0000","last_peered":"2024-04-23T18:27:47.657842+0000","last_clean":"2024-04-23T18:27:47.657842+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:27:47.657842+0000","last_undegraded":"2024-04-23T18:27:47.657842+0000","last_fullsized":"2024-04-23T18:27:47.657842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.864508+0000","last_change":"2024-04-23T18:22:33.396051+0000","last_active":"2024-04-23T18:27:48.864508+0000","last_peered":"2024-04-23T18:27:48.864508+0000","last_clean":"2024-04-23T18:27:48.864508+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:27:48.864508+0000","last_undegraded":"2024-04-23T18:27:48.864508+0000","last_fullsized":"2024-04-23T18:27:48.864508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:13.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:53.417285+0000","last_change":"2024-04-23T18:27:53.417317+0000","last_active":"2024-04-23T18:27:53.417285+0000","last_peered":"2024-04-23T18:27:53.417285+0000","last_clean":"2024-04-23T18:27:53.417285+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:27:53.417285+0000","last_undegraded":"2024-04-23T18:27:53.417285+0000","last_fullsized":"2024-04-23T18:27:53.417285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:27:53.417138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:27:53.417138+0000","last_clean_scrub_stamp":"2024-04-23T18:27:53.417138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:13:05.591897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'320","reported_seq":341,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.364547+0000","last_change":"2024-04-23T18:22:37.434853+0000","last_active":"2024-04-23T18:27:47.364547+0000","last_peered":"2024-04-23T18:27:47.364547+0000","last_clean":"2024-04-23T18:27:47.364547+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:27:47.364547+0000","last_undegraded":"2024-04-23T18:27:47.364547+0000","last_fullsized":"2024-04-23T18:27:47.364547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.826697+0000","last_change":"2024-04-23T18:22:33.371427+0000","last_active":"2024-04-23T18:27:48.826697+0000","last_peered":"2024-04-23T18:27:48.826697+0000","last_clean":"2024-04-23T18:27:48.826697+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:27:48.826697+0000","last_undegraded":"2024-04-23T18:27:48.826697+0000","last_fullsized":"2024-04-23T18:27:48.826697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:25.015356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.419002+0000","last_change":"2024-04-23T18:22:32.390914+0000","last_active":"2024-04-23T18:24:39.419002+0000","last_peered":"2024-04-23T18:24:39.419002+0000","last_clean":"2024-04-23T18:24:39.419002+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:24:39.419002+0000","last_undegraded":"2024-04-23T18:24:39.419002+0000","last_fullsized":"2024-04-23T18:24:39.419002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:43.187829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'301","reported_seq":322,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.657964+0000","last_change":"2024-04-23T18:22:37.416420+0000","last_active":"2024-04-23T18:27:47.657964+0000","last_peered":"2024-04-23T18:27:47.657964+0000","last_clean":"2024-04-23T18:27:47.657964+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:27:47.657964+0000","last_undegraded":"2024-04-23T18:27:47.657964+0000","last_fullsized":"2024-04-23T18:27:47.657964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.845768+0000","last_change":"2024-04-23T18:22:33.367936+0000","last_active":"2024-04-23T18:27:48.845768+0000","last_peered":"2024-04-23T18:27:48.845768+0000","last_clean":"2024-04-23T18:27:48.845768+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:27:48.845768+0000","last_undegraded":"2024-04-23T18:27:48.845768+0000","last_fullsized":"2024-04-23T18:27:48.845768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'12","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:53.950585+0000","last_change":"2024-04-23T18:27:53.950640+0000","last_active":"2024-04-23T18:27:53.950585+0000","last_peered":"2024-04-23T18:27:53.950585+0000","last_clean":"2024-04-23T18:27:53.950585+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:27:53.950585+0000","last_undegraded":"2024-04-23T18:27:53.950585+0000","last_fullsized":"2024-04-23T18:27:53.950585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-04-23T18:27:53.950515+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-04-23T18:27:53.950515+0000","last_clean_scrub_stamp":"2024-04-23T18:27:53.950515+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:17.578547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'319","reported_seq":334,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.606197+0000","last_change":"2024-04-23T18:23:14.730523+0000","last_active":"2024-04-23T18:27:47.606197+0000","last_peered":"2024-04-23T18:27:47.606197+0000","last_clean":"2024-04-23T18:27:47.606197+0000","last_became_active":"2024-04-23T18:23:14.729941+0000","last_became_peered":"2024-04-23T18:23:14.729941+0000","last_unstale":"2024-04-23T18:27:47.606197+0000","last_undegraded":"2024-04-23T18:27:47.606197+0000","last_fullsized":"2024-04-23T18:27:47.606197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"26'5","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.860490+0000","last_change":"2024-04-23T18:22:33.368137+0000","last_active":"2024-04-23T18:27:48.860490+0000","last_peered":"2024-04-23T18:27:48.860490+0000","last_clean":"2024-04-23T18:27:48.860490+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:27:48.860490+0000","last_undegraded":"2024-04-23T18:27:48.860490+0000","last_fullsized":"2024-04-23T18:27:48.860490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:34.417125+0000","last_change":"2024-04-23T18:22:32.397009+0000","last_active":"2024-04-23T18:24:34.417125+0000","last_peered":"2024-04-23T18:24:34.417125+0000","last_clean":"2024-04-23T18:24:34.417125+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:24:34.417125+0000","last_undegraded":"2024-04-23T18:24:34.417125+0000","last_fullsized":"2024-04-23T18:24:34.417125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:21.702160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'378","reported_seq":399,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.616128+0000","last_change":"2024-04-23T18:22:37.714547+0000","last_active":"2024-04-23T18:27:47.616128+0000","last_peered":"2024-04-23T18:27:47.616128+0000","last_clean":"2024-04-23T18:27:47.616128+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:27:47.616128+0000","last_undegraded":"2024-04-23T18:27:47.616128+0000","last_fullsized":"2024-04-23T18:27:47.616128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.851921+0000","last_change":"2024-04-23T18:22:33.397936+0000","last_active":"2024-04-23T18:27:48.851921+0000","last_peered":"2024-04-23T18:27:48.851921+0000","last_clean":"2024-04-23T18:27:48.851921+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:27:48.851921+0000","last_undegraded":"2024-04-23T18:27:48.851921+0000","last_fullsized":"2024-04-23T18:27:48.851921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:39.419025+0000","last_change":"2024-04-23T18:22:32.383131+0000","last_active":"2024-04-23T18:24:39.419025+0000","last_peered":"2024-04-23T18:24:39.419025+0000","last_clean":"2024-04-23T18:24:39.419025+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:24:39.419025+0000","last_undegraded":"2024-04-23T18:24:39.419025+0000","last_fullsized":"2024-04-23T18:24:39.419025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:24.415086+0000","last_change":"2024-04-23T18:22:21.620791+0000","last_active":"2024-04-23T18:24:24.415086+0000","last_peered":"2024-04-23T18:24:24.415086+0000","last_clean":"2024-04-23T18:24:24.415086+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:24:24.415086+0000","last_undegraded":"2024-04-23T18:24:24.415086+0000","last_fullsized":"2024-04-23T18:24:24.415086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:19.978341+0000","last_clean_scrub_stamp":"2024-04-23T18:22:19.978341+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:26.477183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'315","reported_seq":335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.601027+0000","last_change":"2024-04-23T18:22:37.714942+0000","last_active":"2024-04-23T18:27:47.601027+0000","last_peered":"2024-04-23T18:27:47.601027+0000","last_clean":"2024-04-23T18:27:47.601027+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:27:47.601027+0000","last_undegraded":"2024-04-23T18:27:47.601027+0000","last_fullsized":"2024-04-23T18:27:47.601027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:07:56.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.871650+0000","last_change":"2024-04-23T18:22:33.404262+0000","last_active":"2024-04-23T18:27:48.871650+0000","last_peered":"2024-04-23T18:27:48.871650+0000","last_clean":"2024-04-23T18:27:48.871650+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:27:48.871650+0000","last_undegraded":"2024-04-23T18:27:48.871650+0000","last_fullsized":"2024-04-23T18:27:48.871650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:12:45.464933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"24'3","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:04.472592+0000","last_change":"2024-04-23T18:22:32.388161+0000","last_active":"2024-04-23T18:27:04.472592+0000","last_peered":"2024-04-23T18:27:04.472592+0000","last_clean":"2024-04-23T18:27:04.472592+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:27:04.472592+0000","last_undegraded":"2024-04-23T18:27:04.472592+0000","last_fullsized":"2024-04-23T18:27:04.472592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'338","reported_seq":358,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.620514+0000","last_change":"2024-04-23T18:22:37.719434+0000","last_active":"2024-04-23T18:27:47.620514+0000","last_peered":"2024-04-23T18:27:47.620514+0000","last_clean":"2024-04-23T18:27:47.620514+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:27:47.620514+0000","last_undegraded":"2024-04-23T18:27:47.620514+0000","last_fullsized":"2024-04-23T18:27:47.620514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.861914+0000","last_change":"2024-04-23T18:22:33.386385+0000","last_active":"2024-04-23T18:27:48.861914+0000","last_peered":"2024-04-23T18:27:48.861914+0000","last_clean":"2024-04-23T18:27:48.861914+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:27:48.861914+0000","last_undegraded":"2024-04-23T18:27:48.861914+0000","last_fullsized":"2024-04-23T18:27:48.861914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:55.769289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:04.562057+0000","last_change":"2024-04-23T18:22:32.374111+0000","last_active":"2024-04-23T18:27:04.562057+0000","last_peered":"2024-04-23T18:27:04.562057+0000","last_clean":"2024-04-23T18:27:04.562057+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:27:04.562057+0000","last_undegraded":"2024-04-23T18:27:04.562057+0000","last_fullsized":"2024-04-23T18:27:04.562057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'299","reported_seq":327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.652165+0000","last_change":"2024-04-23T18:23:14.728059+0000","last_active":"2024-04-23T18:27:47.652165+0000","last_peered":"2024-04-23T18:27:47.652165+0000","last_clean":"2024-04-23T18:27:47.652165+0000","last_became_active":"2024-04-23T18:23:14.727676+0000","last_became_peered":"2024-04-23T18:23:14.727676+0000","last_unstale":"2024-04-23T18:27:47.652165+0000","last_undegraded":"2024-04-23T18:27:47.652165+0000","last_fullsized":"2024-04-23T18:27:47.652165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.874693+0000","last_change":"2024-04-23T18:22:33.403632+0000","last_active":"2024-04-23T18:27:48.874693+0000","last_peered":"2024-04-23T18:27:48.874693+0000","last_clean":"2024-04-23T18:27:48.874693+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:27:48.874693+0000","last_undegraded":"2024-04-23T18:27:48.874693+0000","last_fullsized":"2024-04-23T18:27:48.874693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:38:26.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:04.472621+0000","last_change":"2024-04-23T18:22:32.358520+0000","last_active":"2024-04-23T18:27:04.472621+0000","last_peered":"2024-04-23T18:27:04.472621+0000","last_clean":"2024-04-23T18:27:04.472621+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:27:04.472621+0000","last_undegraded":"2024-04-23T18:27:04.472621+0000","last_fullsized":"2024-04-23T18:27:04.472621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'365","reported_seq":385,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.629660+0000","last_change":"2024-04-23T18:22:37.715364+0000","last_active":"2024-04-23T18:27:47.629660+0000","last_peered":"2024-04-23T18:27:47.629660+0000","last_clean":"2024-04-23T18:27:47.629660+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:27:47.629660+0000","last_undegraded":"2024-04-23T18:27:47.629660+0000","last_fullsized":"2024-04-23T18:27:47.629660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:19.986928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.872317+0000","last_change":"2024-04-23T18:22:33.402927+0000","last_active":"2024-04-23T18:27:48.872317+0000","last_peered":"2024-04-23T18:27:48.872317+0000","last_clean":"2024-04-23T18:27:48.872317+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:27:48.872317+0000","last_undegraded":"2024-04-23T18:27:48.872317+0000","last_fullsized":"2024-04-23T18:27:48.872317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:47.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:38.665933+0000","last_change":"2024-04-23T18:22:32.373544+0000","last_active":"2024-04-23T18:25:38.665933+0000","last_peered":"2024-04-23T18:25:38.665933+0000","last_clean":"2024-04-23T18:25:38.665933+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:25:38.665933+0000","last_undegraded":"2024-04-23T18:25:38.665933+0000","last_fullsized":"2024-04-23T18:25:38.665933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:37.792834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'302","reported_seq":322,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.652437+0000","last_change":"2024-04-23T18:22:37.421346+0000","last_active":"2024-04-23T18:27:47.652437+0000","last_peered":"2024-04-23T18:27:47.652437+0000","last_clean":"2024-04-23T18:27:47.652437+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:27:47.652437+0000","last_undegraded":"2024-04-23T18:27:47.652437+0000","last_fullsized":"2024-04-23T18:27:47.652437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:24.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'6","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:53.368870+0000","last_change":"2024-04-23T18:23:14.723945+0000","last_active":"2024-04-23T18:27:53.368870+0000","last_peered":"2024-04-23T18:27:53.368870+0000","last_clean":"2024-04-23T18:27:53.368870+0000","last_became_active":"2024-04-23T18:23:14.723676+0000","last_became_peered":"2024-04-23T18:23:14.723676+0000","last_unstale":"2024-04-23T18:27:53.368870+0000","last_undegraded":"2024-04-23T18:27:53.368870+0000","last_fullsized":"2024-04-23T18:27:53.368870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"26'16","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:49.661344+0000","last_change":"2024-04-23T18:22:32.359972+0000","last_active":"2024-04-23T18:27:49.661344+0000","last_peered":"2024-04-23T18:27:49.661344+0000","last_clean":"2024-04-23T18:27:49.661344+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:27:49.661344+0000","last_undegraded":"2024-04-23T18:27:49.661344+0000","last_fullsized":"2024-04-23T18:27:49.661344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'416","reported_seq":437,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.646250+0000","last_change":"2024-04-23T18:22:37.425948+0000","last_active":"2024-04-23T18:27:47.646250+0000","last_peered":"2024-04-23T18:27:47.646250+0000","last_clean":"2024-04-23T18:27:47.646250+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:27:47.646250+0000","last_undegraded":"2024-04-23T18:27:47.646250+0000","last_fullsized":"2024-04-23T18:27:47.646250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.830614+0000","last_change":"2024-04-23T18:22:33.372962+0000","last_active":"2024-04-23T18:27:48.830614+0000","last_peered":"2024-04-23T18:27:48.830614+0000","last_clean":"2024-04-23T18:27:48.830614+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:27:48.830614+0000","last_undegraded":"2024-04-23T18:27:48.830614+0000","last_fullsized":"2024-04-23T18:27:48.830614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:18.210740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'5","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:14.481155+0000","last_change":"2024-04-23T18:22:32.389103+0000","last_active":"2024-04-23T18:27:14.481155+0000","last_peered":"2024-04-23T18:27:14.481155+0000","last_clean":"2024-04-23T18:27:14.481155+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:27:14.481155+0000","last_undegraded":"2024-04-23T18:27:14.481155+0000","last_fullsized":"2024-04-23T18:27:14.481155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:47.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'318","reported_seq":339,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.657235+0000","last_change":"2024-04-23T18:22:37.719627+0000","last_active":"2024-04-23T18:27:47.657235+0000","last_peered":"2024-04-23T18:27:47.657235+0000","last_clean":"2024-04-23T18:27:47.657235+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:27:47.657235+0000","last_undegraded":"2024-04-23T18:27:47.657235+0000","last_fullsized":"2024-04-23T18:27:47.657235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.874944+0000","last_change":"2024-04-23T18:22:33.402943+0000","last_active":"2024-04-23T18:27:48.874944+0000","last_peered":"2024-04-23T18:27:48.874944+0000","last_clean":"2024-04-23T18:27:48.874944+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:27:48.874944+0000","last_undegraded":"2024-04-23T18:27:48.874944+0000","last_fullsized":"2024-04-23T18:27:48.874944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:13.636412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:54.422660+0000","last_change":"2024-04-23T18:22:32.387877+0000","last_active":"2024-04-23T18:24:54.422660+0000","last_peered":"2024-04-23T18:24:54.422660+0000","last_clean":"2024-04-23T18:24:54.422660+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:24:54.422660+0000","last_undegraded":"2024-04-23T18:24:54.422660+0000","last_fullsized":"2024-04-23T18:24:54.422660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:26:57.750687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'316","reported_seq":337,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.656960+0000","last_change":"2024-04-23T18:22:37.711729+0000","last_active":"2024-04-23T18:27:47.656960+0000","last_peered":"2024-04-23T18:27:47.656960+0000","last_clean":"2024-04-23T18:27:47.656960+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:27:47.656960+0000","last_undegraded":"2024-04-23T18:27:47.656960+0000","last_fullsized":"2024-04-23T18:27:47.656960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'10","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.873687+0000","last_change":"2024-04-23T18:22:33.380361+0000","last_active":"2024-04-23T18:27:48.873687+0000","last_peered":"2024-04-23T18:27:48.873687+0000","last_clean":"2024-04-23T18:27:48.873687+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:27:48.873687+0000","last_undegraded":"2024-04-23T18:27:48.873687+0000","last_fullsized":"2024-04-23T18:27:48.873687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'10","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:53.612665+0000","last_change":"2024-04-23T18:27:53.612712+0000","last_active":"2024-04-23T18:27:53.612665+0000","last_peered":"2024-04-23T18:27:53.612665+0000","last_clean":"2024-04-23T18:27:53.612665+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:27:53.612665+0000","last_undegraded":"2024-04-23T18:27:53.612665+0000","last_fullsized":"2024-04-23T18:27:53.612665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-23T18:27:53.612592+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-23T18:27:53.612592+0000","last_clean_scrub_stamp":"2024-04-23T18:27:53.612592+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:53.458825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'378","reported_seq":398,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.626144+0000","last_change":"2024-04-23T18:22:37.716371+0000","last_active":"2024-04-23T18:27:47.626144+0000","last_peered":"2024-04-23T18:27:47.626144+0000","last_clean":"2024-04-23T18:27:47.626144+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:27:47.626144+0000","last_undegraded":"2024-04-23T18:27:47.626144+0000","last_fullsized":"2024-04-23T18:27:47.626144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:12.129842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.866188+0000","last_change":"2024-04-23T18:22:33.382996+0000","last_active":"2024-04-23T18:27:48.866188+0000","last_peered":"2024-04-23T18:27:48.866188+0000","last_clean":"2024-04-23T18:27:48.866188+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:27:48.866188+0000","last_undegraded":"2024-04-23T18:27:48.866188+0000","last_fullsized":"2024-04-23T18:27:48.866188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:07.503768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'1983","reported_seq":2011,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:54.415298+0000","last_change":"2024-04-23T18:22:32.375382+0000","last_active":"2024-04-23T18:27:54.415298+0000","last_peered":"2024-04-23T18:27:54.415298+0000","last_clean":"2024-04-23T18:27:54.415298+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:27:54.415298+0000","last_undegraded":"2024-04-23T18:27:54.415298+0000","last_fullsized":"2024-04-23T18:27:54.415298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:32:12.175491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3968226,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1983,"num_write_kb":4072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'332","reported_seq":346,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.382211+0000","last_change":"2024-04-23T18:23:14.730758+0000","last_active":"2024-04-23T18:27:47.382211+0000","last_peered":"2024-04-23T18:27:47.382211+0000","last_clean":"2024-04-23T18:27:47.382211+0000","last_became_active":"2024-04-23T18:23:14.729264+0000","last_became_peered":"2024-04-23T18:23:14.729264+0000","last_unstale":"2024-04-23T18:27:47.382211+0000","last_undegraded":"2024-04-23T18:27:47.382211+0000","last_fullsized":"2024-04-23T18:27:47.382211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:25:09.741395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"26'11","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.868511+0000","last_change":"2024-04-23T18:22:33.395409+0000","last_active":"2024-04-23T18:27:48.868511+0000","last_peered":"2024-04-23T18:27:48.868511+0000","last_clean":"2024-04-23T18:27:48.868511+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:27:48.868511+0000","last_undegraded":"2024-04-23T18:27:48.868511+0000","last_fullsized":"2024-04-23T18:27:48.868511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:06:03.266991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'10","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:49.664359+0000","last_change":"2024-04-23T18:22:32.404124+0000","last_active":"2024-04-23T18:27:49.664359+0000","last_peered":"2024-04-23T18:27:49.664359+0000","last_clean":"2024-04-23T18:27:49.664359+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:27:49.664359+0000","last_undegraded":"2024-04-23T18:27:49.664359+0000","last_fullsized":"2024-04-23T18:27:49.664359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'353","reported_seq":373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.639169+0000","last_change":"2024-04-23T18:22:37.428819+0000","last_active":"2024-04-23T18:27:47.639169+0000","last_peered":"2024-04-23T18:27:47.639169+0000","last_clean":"2024-04-23T18:27:47.639169+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:27:47.639169+0000","last_undegraded":"2024-04-23T18:27:47.639169+0000","last_fullsized":"2024-04-23T18:27:47.639169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:43.278663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:52.620338+0000","last_change":"2024-04-23T18:27:52.620358+0000","last_active":"2024-04-23T18:27:52.620338+0000","last_peered":"2024-04-23T18:27:52.620338+0000","last_clean":"2024-04-23T18:27:52.620338+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:27:52.620338+0000","last_undegraded":"2024-04-23T18:27:52.620338+0000","last_fullsized":"2024-04-23T18:27:52.620338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-23T18:27:52.620267+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-23T18:27:52.620267+0000","last_clean_scrub_stamp":"2024-04-23T18:27:52.620267+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:36:46.194703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"24'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429662+0000","last_change":"2024-04-23T18:22:32.400946+0000","last_active":"2024-04-23T18:24:59.429662+0000","last_peered":"2024-04-23T18:24:59.429662+0000","last_clean":"2024-04-23T18:24:59.429662+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:24:59.429662+0000","last_undegraded":"2024-04-23T18:24:59.429662+0000","last_fullsized":"2024-04-23T18:24:59.429662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.604544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'344","reported_seq":365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.646389+0000","last_change":"2024-04-23T18:22:37.418155+0000","last_active":"2024-04-23T18:27:47.646389+0000","last_peered":"2024-04-23T18:27:47.646389+0000","last_clean":"2024-04-23T18:27:47.646389+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:27:47.646389+0000","last_undegraded":"2024-04-23T18:27:47.646389+0000","last_fullsized":"2024-04-23T18:27:47.646389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'10","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.862874+0000","last_change":"2024-04-23T18:22:33.396706+0000","last_active":"2024-04-23T18:27:48.862874+0000","last_peered":"2024-04-23T18:27:48.862874+0000","last_clean":"2024-04-23T18:27:48.862874+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:27:48.862874+0000","last_undegraded":"2024-04-23T18:27:48.862874+0000","last_fullsized":"2024-04-23T18:27:48.862874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:19:47.501915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.448017+0000","last_change":"2024-04-23T18:22:32.404977+0000","last_active":"2024-04-23T18:24:59.448017+0000","last_peered":"2024-04-23T18:24:59.448017+0000","last_clean":"2024-04-23T18:24:59.448017+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:24:59.448017+0000","last_undegraded":"2024-04-23T18:24:59.448017+0000","last_fullsized":"2024-04-23T18:24:59.448017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:15.289170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'379","reported_seq":400,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.597203+0000","last_change":"2024-04-23T18:22:37.719611+0000","last_active":"2024-04-23T18:27:47.597203+0000","last_peered":"2024-04-23T18:27:47.597203+0000","last_clean":"2024-04-23T18:27:47.597203+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:27:47.597203+0000","last_undegraded":"2024-04-23T18:27:47.597203+0000","last_fullsized":"2024-04-23T18:27:47.597203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'324","reported_seq":345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.645449+0000","last_change":"2024-04-23T18:22:37.714725+0000","last_active":"2024-04-23T18:27:47.645449+0000","last_peered":"2024-04-23T18:27:47.645449+0000","last_clean":"2024-04-23T18:27:47.645449+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:27:47.645449+0000","last_undegraded":"2024-04-23T18:27:47.645449+0000","last_fullsized":"2024-04-23T18:27:47.645449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'11","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.858276+0000","last_change":"2024-04-23T18:22:33.364336+0000","last_active":"2024-04-23T18:27:48.858276+0000","last_peered":"2024-04-23T18:27:48.858276+0000","last_clean":"2024-04-23T18:27:48.858276+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:27:48.858276+0000","last_undegraded":"2024-04-23T18:27:48.858276+0000","last_fullsized":"2024-04-23T18:27:48.858276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:24:59.429581+0000","last_change":"2024-04-23T18:22:32.383190+0000","last_active":"2024-04-23T18:24:59.429581+0000","last_peered":"2024-04-23T18:24:59.429581+0000","last_clean":"2024-04-23T18:24:59.429581+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:24:59.429581+0000","last_undegraded":"2024-04-23T18:24:59.429581+0000","last_fullsized":"2024-04-23T18:24:59.429581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:00:16.663026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'313","reported_seq":333,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.371528+0000","last_change":"2024-04-23T18:22:37.424412+0000","last_active":"2024-04-23T18:27:47.371528+0000","last_peered":"2024-04-23T18:27:47.371528+0000","last_clean":"2024-04-23T18:27:47.371528+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:27:47.371528+0000","last_undegraded":"2024-04-23T18:27:47.371528+0000","last_fullsized":"2024-04-23T18:27:47.371528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:39.698321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'8","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.843705+0000","last_change":"2024-04-23T18:22:33.363290+0000","last_active":"2024-04-23T18:27:48.843705+0000","last_peered":"2024-04-23T18:27:48.843705+0000","last_clean":"2024-04-23T18:27:48.843705+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:27:48.843705+0000","last_undegraded":"2024-04-23T18:27:48.843705+0000","last_fullsized":"2024-04-23T18:27:48.843705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:24.544791+0000","last_change":"2024-04-23T18:22:32.372570+0000","last_active":"2024-04-23T18:27:24.544791+0000","last_peered":"2024-04-23T18:27:24.544791+0000","last_clean":"2024-04-23T18:27:24.544791+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:27:24.544791+0000","last_undegraded":"2024-04-23T18:27:24.544791+0000","last_fullsized":"2024-04-23T18:27:24.544791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:25:04.448866+0000","last_change":"2024-04-23T18:22:32.380665+0000","last_active":"2024-04-23T18:25:04.448866+0000","last_peered":"2024-04-23T18:25:04.448866+0000","last_clean":"2024-04-23T18:25:04.448866+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:25:04.448866+0000","last_undegraded":"2024-04-23T18:25:04.448866+0000","last_fullsized":"2024-04-23T18:25:04.448866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:02:47.006405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'8","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.855761+0000","last_change":"2024-04-23T18:22:33.375774+0000","last_active":"2024-04-23T18:27:48.855761+0000","last_peered":"2024-04-23T18:27:48.855761+0000","last_clean":"2024-04-23T18:27:48.855761+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:27:48.855761+0000","last_undegraded":"2024-04-23T18:27:48.855761+0000","last_fullsized":"2024-04-23T18:27:48.855761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'338","reported_seq":359,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.651963+0000","last_change":"2024-04-23T18:22:37.422892+0000","last_active":"2024-04-23T18:27:47.651963+0000","last_peered":"2024-04-23T18:27:47.651963+0000","last_clean":"2024-04-23T18:27:47.651963+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:27:47.651963+0000","last_undegraded":"2024-04-23T18:27:47.651963+0000","last_fullsized":"2024-04-23T18:27:47.651963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:34.546006+0000","last_change":"2024-04-23T18:22:32.379165+0000","last_active":"2024-04-23T18:27:34.546006+0000","last_peered":"2024-04-23T18:27:34.546006+0000","last_clean":"2024-04-23T18:27:34.546006+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:27:34.546006+0000","last_undegraded":"2024-04-23T18:27:34.546006+0000","last_fullsized":"2024-04-23T18:27:34.546006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:31.329999+0000","last_clean_scrub_stamp":"2024-04-23T18:22:31.329999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.860003+0000","last_change":"2024-04-23T18:22:33.388529+0000","last_active":"2024-04-23T18:27:48.860003+0000","last_peered":"2024-04-23T18:27:48.860003+0000","last_clean":"2024-04-23T18:27:48.860003+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:27:48.860003+0000","last_undegraded":"2024-04-23T18:27:48.860003+0000","last_fullsized":"2024-04-23T18:27:48.860003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:18:53.084598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'361","reported_seq":382,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:47.642538+0000","last_change":"2024-04-23T18:22:37.426515+0000","last_active":"2024-04-23T18:27:47.642538+0000","last_peered":"2024-04-23T18:27:47.642538+0000","last_clean":"2024-04-23T18:27:47.642538+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:27:47.642538+0000","last_undegraded":"2024-04-23T18:27:47.642538+0000","last_fullsized":"2024-04-23T18:27:47.642538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:36.376251+0000","last_clean_scrub_stamp":"2024-04-23T18:22:36.376251+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.864159+0000","last_change":"2024-04-23T18:22:33.373047+0000","last_active":"2024-04-23T18:27:48.864159+0000","last_peered":"2024-04-23T18:27:48.864159+0000","last_clean":"2024-04-23T18:27:48.864159+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:27:48.864159+0000","last_undegraded":"2024-04-23T18:27:48.864159+0000","last_fullsized":"2024-04-23T18:27:48.864159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:26:56.220000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'12","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.864670+0000","last_change":"2024-04-23T18:22:33.397970+0000","last_active":"2024-04-23T18:27:48.864670+0000","last_peered":"2024-04-23T18:27:48.864670+0000","last_clean":"2024-04-23T18:27:48.864670+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:27:48.864670+0000","last_undegraded":"2024-04-23T18:27:48.864670+0000","last_fullsized":"2024-04-23T18:27:48.864670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.854413+0000","last_change":"2024-04-23T18:22:33.380137+0000","last_active":"2024-04-23T18:27:48.854413+0000","last_peered":"2024-04-23T18:27:48.854413+0000","last_clean":"2024-04-23T18:27:48.854413+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:27:48.854413+0000","last_undegraded":"2024-04-23T18:27:48.854413+0000","last_fullsized":"2024-04-23T18:27:48.854413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:38.319243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.844850+0000","last_change":"2024-04-23T18:22:33.367037+0000","last_active":"2024-04-23T18:27:48.844850+0000","last_peered":"2024-04-23T18:27:48.844850+0000","last_clean":"2024-04-23T18:27:48.844850+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:27:48.844850+0000","last_undegraded":"2024-04-23T18:27:48.844850+0000","last_fullsized":"2024-04-23T18:27:48.844850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:54.202897+0000","last_change":"2024-04-23T18:27:54.202936+0000","last_active":"2024-04-23T18:27:54.202897+0000","last_peered":"2024-04-23T18:27:54.202897+0000","last_clean":"2024-04-23T18:27:54.202897+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:27:54.202897+0000","last_undegraded":"2024-04-23T18:27:54.202897+0000","last_fullsized":"2024-04-23T18:27:54.202897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-23T18:27:54.202796+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-23T18:27:54.202796+0000","last_clean_scrub_stamp":"2024-04-23T18:27:54.202796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:49.035190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'6","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.843523+0000","last_change":"2024-04-23T18:22:33.364711+0000","last_active":"2024-04-23T18:27:48.843523+0000","last_peered":"2024-04-23T18:27:48.843523+0000","last_clean":"2024-04-23T18:27:48.843523+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:27:48.843523+0000","last_undegraded":"2024-04-23T18:27:48.843523+0000","last_fullsized":"2024-04-23T18:27:48.843523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.864562+0000","last_change":"2024-04-23T18:22:33.379627+0000","last_active":"2024-04-23T18:27:48.864562+0000","last_peered":"2024-04-23T18:27:48.864562+0000","last_clean":"2024-04-23T18:27:48.864562+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:27:48.864562+0000","last_undegraded":"2024-04-23T18:27:48.864562+0000","last_fullsized":"2024-04-23T18:27:48.864562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:51.718348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'2","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.843063+0000","last_change":"2024-04-23T18:22:33.374414+0000","last_active":"2024-04-23T18:27:48.843063+0000","last_peered":"2024-04-23T18:27:48.843063+0000","last_clean":"2024-04-23T18:27:48.843063+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:27:48.843063+0000","last_undegraded":"2024-04-23T18:27:48.843063+0000","last_fullsized":"2024-04-23T18:27:48.843063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.863991+0000","last_change":"2024-04-23T18:22:33.386105+0000","last_active":"2024-04-23T18:27:48.863991+0000","last_peered":"2024-04-23T18:27:48.863991+0000","last_clean":"2024-04-23T18:27:48.863991+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:27:48.863991+0000","last_undegraded":"2024-04-23T18:27:48.863991+0000","last_fullsized":"2024-04-23T18:27:48.863991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:12:49.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'8","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.847716+0000","last_change":"2024-04-23T18:22:33.374179+0000","last_active":"2024-04-23T18:27:48.847716+0000","last_peered":"2024-04-23T18:27:48.847716+0000","last_clean":"2024-04-23T18:27:48.847716+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:27:48.847716+0000","last_undegraded":"2024-04-23T18:27:48.847716+0000","last_fullsized":"2024-04-23T18:27:48.847716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'10","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:49.436184+0000","last_change":"2024-04-23T18:23:14.787713+0000","last_active":"2024-04-23T18:27:49.436184+0000","last_peered":"2024-04-23T18:27:49.436184+0000","last_clean":"2024-04-23T18:27:49.436184+0000","last_became_active":"2024-04-23T18:23:14.787340+0000","last_became_peered":"2024-04-23T18:23:14.787340+0000","last_unstale":"2024-04-23T18:27:49.436184+0000","last_undegraded":"2024-04-23T18:27:49.436184+0000","last_fullsized":"2024-04-23T18:27:49.436184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"26'11","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.873951+0000","last_change":"2024-04-23T18:22:33.382640+0000","last_active":"2024-04-23T18:27:48.873951+0000","last_peered":"2024-04-23T18:27:48.873951+0000","last_clean":"2024-04-23T18:27:48.873951+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:27:48.873951+0000","last_undegraded":"2024-04-23T18:27:48.873951+0000","last_fullsized":"2024-04-23T18:27:48.873951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.864314+0000","last_change":"2024-04-23T18:22:33.401192+0000","last_active":"2024-04-23T18:27:48.864314+0000","last_peered":"2024-04-23T18:27:48.864314+0000","last_clean":"2024-04-23T18:27:48.864314+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:27:48.864314+0000","last_undegraded":"2024-04-23T18:27:48.864314+0000","last_fullsized":"2024-04-23T18:27:48.864314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:30.915616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.843996+0000","last_change":"2024-04-23T18:22:33.384137+0000","last_active":"2024-04-23T18:27:48.843996+0000","last_peered":"2024-04-23T18:27:48.843996+0000","last_clean":"2024-04-23T18:27:48.843996+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:27:48.843996+0000","last_undegraded":"2024-04-23T18:27:48.843996+0000","last_fullsized":"2024-04-23T18:27:48.843996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:47.050079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'10","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.867767+0000","last_change":"2024-04-23T18:22:33.376844+0000","last_active":"2024-04-23T18:27:48.867767+0000","last_peered":"2024-04-23T18:27:48.867767+0000","last_clean":"2024-04-23T18:27:48.867767+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:27:48.867767+0000","last_undegraded":"2024-04-23T18:27:48.867767+0000","last_fullsized":"2024-04-23T18:27:48.867767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.869236+0000","last_change":"2024-04-23T18:22:33.396433+0000","last_active":"2024-04-23T18:27:48.869236+0000","last_peered":"2024-04-23T18:27:48.869236+0000","last_clean":"2024-04-23T18:27:48.869236+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:27:48.869236+0000","last_undegraded":"2024-04-23T18:27:48.869236+0000","last_fullsized":"2024-04-23T18:27:48.869236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.713136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.864112+0000","last_change":"2024-04-23T18:22:33.379343+0000","last_active":"2024-04-23T18:27:48.864112+0000","last_peered":"2024-04-23T18:27:48.864112+0000","last_clean":"2024-04-23T18:27:48.864112+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:27:48.864112+0000","last_undegraded":"2024-04-23T18:27:48.864112+0000","last_fullsized":"2024-04-23T18:27:48.864112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:59.601947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.847811+0000","last_change":"2024-04-23T18:22:33.374451+0000","last_active":"2024-04-23T18:27:48.847811+0000","last_peered":"2024-04-23T18:27:48.847811+0000","last_clean":"2024-04-23T18:27:48.847811+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:27:48.847811+0000","last_undegraded":"2024-04-23T18:27:48.847811+0000","last_fullsized":"2024-04-23T18:27:48.847811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'8","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.852148+0000","last_change":"2024-04-23T18:22:33.359146+0000","last_active":"2024-04-23T18:27:48.852148+0000","last_peered":"2024-04-23T18:27:48.852148+0000","last_clean":"2024-04-23T18:27:48.852148+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:27:48.852148+0000","last_undegraded":"2024-04-23T18:27:48.852148+0000","last_fullsized":"2024-04-23T18:27:48.852148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'10","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.864558+0000","last_change":"2024-04-23T18:22:33.373214+0000","last_active":"2024-04-23T18:27:48.864558+0000","last_peered":"2024-04-23T18:27:48.864558+0000","last_clean":"2024-04-23T18:27:48.864558+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:27:48.864558+0000","last_undegraded":"2024-04-23T18:27:48.864558+0000","last_fullsized":"2024-04-23T18:27:48.864558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.868169+0000","last_change":"2024-04-23T18:22:33.394875+0000","last_active":"2024-04-23T18:27:48.868169+0000","last_peered":"2024-04-23T18:27:48.868169+0000","last_clean":"2024-04-23T18:27:48.868169+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:27:48.868169+0000","last_undegraded":"2024-04-23T18:27:48.868169+0000","last_fullsized":"2024-04-23T18:27:48.868169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:50.559764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.866882+0000","last_change":"2024-04-23T18:22:33.398530+0000","last_active":"2024-04-23T18:27:48.866882+0000","last_peered":"2024-04-23T18:27:48.866882+0000","last_clean":"2024-04-23T18:27:48.866882+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:27:48.866882+0000","last_undegraded":"2024-04-23T18:27:48.866882+0000","last_fullsized":"2024-04-23T18:27:48.866882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:42.907451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'16","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.858159+0000","last_change":"2024-04-23T18:22:33.394503+0000","last_active":"2024-04-23T18:27:48.858159+0000","last_peered":"2024-04-23T18:27:48.858159+0000","last_clean":"2024-04-23T18:27:48.858159+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:27:48.858159+0000","last_undegraded":"2024-04-23T18:27:48.858159+0000","last_fullsized":"2024-04-23T18:27:48.858159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:20.085343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'11","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.872199+0000","last_change":"2024-04-23T18:22:33.404919+0000","last_active":"2024-04-23T18:27:48.872199+0000","last_peered":"2024-04-23T18:27:48.872199+0000","last_clean":"2024-04-23T18:27:48.872199+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:27:48.872199+0000","last_undegraded":"2024-04-23T18:27:48.872199+0000","last_fullsized":"2024-04-23T18:27:48.872199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:40.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'9","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.852074+0000","last_change":"2024-04-23T18:23:14.787765+0000","last_active":"2024-04-23T18:27:48.852074+0000","last_peered":"2024-04-23T18:27:48.852074+0000","last_clean":"2024-04-23T18:27:48.852074+0000","last_became_active":"2024-04-23T18:23:14.787444+0000","last_became_peered":"2024-04-23T18:23:14.787444+0000","last_unstale":"2024-04-23T18:27:48.852074+0000","last_undegraded":"2024-04-23T18:27:48.852074+0000","last_fullsized":"2024-04-23T18:27:48.852074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.827993+0000","last_change":"2024-04-23T18:22:33.382144+0000","last_active":"2024-04-23T18:27:48.827993+0000","last_peered":"2024-04-23T18:27:48.827993+0000","last_clean":"2024-04-23T18:27:48.827993+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:27:48.827993+0000","last_undegraded":"2024-04-23T18:27:48.827993+0000","last_fullsized":"2024-04-23T18:27:48.827993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:39.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.857867+0000","last_change":"2024-04-23T18:22:33.385546+0000","last_active":"2024-04-23T18:27:48.857867+0000","last_peered":"2024-04-23T18:27:48.857867+0000","last_clean":"2024-04-23T18:27:48.857867+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:27:48.857867+0000","last_undegraded":"2024-04-23T18:27:48.857867+0000","last_fullsized":"2024-04-23T18:27:48.857867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:51.893100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.865999+0000","last_change":"2024-04-23T18:22:33.381453+0000","last_active":"2024-04-23T18:27:48.865999+0000","last_peered":"2024-04-23T18:27:48.865999+0000","last_clean":"2024-04-23T18:27:48.865999+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:27:48.865999+0000","last_undegraded":"2024-04-23T18:27:48.865999+0000","last_fullsized":"2024-04-23T18:27:48.865999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:26.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.871552+0000","last_change":"2024-04-23T18:22:33.386679+0000","last_active":"2024-04-23T18:27:48.871552+0000","last_peered":"2024-04-23T18:27:48.871552+0000","last_clean":"2024-04-23T18:27:48.871552+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:27:48.871552+0000","last_undegraded":"2024-04-23T18:27:48.871552+0000","last_fullsized":"2024-04-23T18:27:48.871552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:06.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'7","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.850955+0000","last_change":"2024-04-23T18:22:33.366875+0000","last_active":"2024-04-23T18:27:48.850955+0000","last_peered":"2024-04-23T18:27:48.850955+0000","last_clean":"2024-04-23T18:27:48.850955+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:27:48.850955+0000","last_undegraded":"2024-04-23T18:27:48.850955+0000","last_fullsized":"2024-04-23T18:27:48.850955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'4","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.857802+0000","last_change":"2024-04-23T18:22:33.363340+0000","last_active":"2024-04-23T18:27:48.857802+0000","last_peered":"2024-04-23T18:27:48.857802+0000","last_clean":"2024-04-23T18:27:48.857802+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:27:48.857802+0000","last_undegraded":"2024-04-23T18:27:48.857802+0000","last_fullsized":"2024-04-23T18:27:48.857802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:48.872950+0000","last_change":"2024-04-23T18:22:33.384851+0000","last_active":"2024-04-23T18:27:48.872950+0000","last_peered":"2024-04-23T18:27:48.872950+0000","last_clean":"2024-04-23T18:27:48.872950+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:27:48.872950+0000","last_undegraded":"2024-04-23T18:27:48.872950+0000","last_fullsized":"2024-04-23T18:27:48.872950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:22:32.337166+0000","last_clean_scrub_stamp":"2024-04-23T18:22:32.337166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:16:40.573556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10755,"ondisk_log_size":10755,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3972764,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2161,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8101888,"data_stored":7945528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2135,"ondisk_log_size":2135,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45936,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325904,"statfs":{"total":96636764160,"available":96589725696,"internally_reserved":0,"allocated":892928,"data_stored":706045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79692,"kb_used_data":4164,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94292148,"statfs":{"total":96636764160,"available":96555159552,"internally_reserved":0,"allocated":4263936,"data_stored":4083065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57836,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94314004,"statfs":{"total":96636764160,"available":96577540096,"internally_reserved":0,"allocated":299008,"data_stored":115739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49512,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":294912,"data_stored":115474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574918,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89428,"kb_used_data":4172,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94282412,"statfs":{"total":96636764160,"available":96545189888,"internally_reserved":0,"allocated":4272128,"data_stored":4083229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57840,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94314000,"statfs":{"total":96636764160,"available":96577536000,"internally_reserved":0,"allocated":303104,"data_stored":115708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75824,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94296016,"statfs":{"total":96636764160,"available":96559120384,"internally_reserved":0,"allocated":303104,"data_stored":115305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45932,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325908,"statfs":{"total":96636764160,"available":96589729792,"internally_reserved":0,"allocated":888832,"data_stored":705389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3993600,"data_stored":3969467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3985408,"data_stored":3969303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:27:56.497 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.497 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.497 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.497 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.497 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.497 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.498 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.498 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.498 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.498 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.498 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.498 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.498 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.498 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.498 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.499 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.499 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.499 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.499 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.499 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.499 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.499 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.499 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.499 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.499 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.500 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.500 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.500 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.500 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.500 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.500 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.500 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.500 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.500 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.500 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.501 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.501 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.501 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.501 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.501 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.501 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.501 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.501 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.501 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.502 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-23T18:22:19.978341+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=19, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.502 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.502 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.502 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.502 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.502 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.502 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.502 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.502 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.503 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.503 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.503 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.503 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.503 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.503 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.503 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.503 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.503 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.503 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.503 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.504 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.504 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.504 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.504 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.504 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.504 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.504 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.504 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.504 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.505 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.505 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.505 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.505 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.505 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.505 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.505 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.505 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.505 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.505 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.506 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.506 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.506 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.506 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.506 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.506 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.506 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-23T18:22:31.329999+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=31, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.506 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.506 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-23T18:22:36.376251+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=36, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.506 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.507 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.507 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.507 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.507 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.507 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.507 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.507 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.507 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.507 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.508 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.508 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.508 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.508 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.508 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.508 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.508 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.508 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.508 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.508 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.509 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.509 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.509 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.509 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.509 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.509 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.509 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.509 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.509 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.510 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.510 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-23T18:22:32.337166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=22, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=27, tm_sec=50, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:27:56.510 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T18:27:58.776 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:27:58.780 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:28:16.511 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:28:16.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.669+0000 7ff89c600640 1 Processor -- start 2024-04-23T18:28:16.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.669+0000 7ff89c600640 1 -- start start 2024-04-23T18:28:16.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff89c600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff8940c9a00 0x7ff894158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:16.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff89c600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8940c3bc0 con 0x7ff8940c9e70 2024-04-23T18:28:16.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff89c600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8940c4940 con 0x7ff8941531a0 2024-04-23T18:28:16.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff89c600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff8940c6790 con 0x7ff8940c9a00 2024-04-23T18:28:16.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff89a600640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff8940c9e70 0x7ff894072f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43462/0 (socket says 172.21.15.28:43462) 2024-04-23T18:28:16.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff89a600640 1 -- 172.21.15.28:0/2484879380 learned_addr learned my addr 172.21.15.28:0/2484879380 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:28:16.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff899200640 1 --2- 172.21.15.28:0/2484879380 >> v2:172.21.15.137:3300/0 conn(0x7ff8940c9a00 0x7ff894158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:16.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3795797080 0 0) 0x7ff8940c3bc0 con 0x7ff8940c9e70 2024-04-23T18:28:16.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff87c003530 con 0x7ff8940c9e70 2024-04-23T18:28:16.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 231713187 0 0) 0x7ff87c003530 con 0x7ff8940c9e70 2024-04-23T18:28:16.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 >> v2:172.21.15.137:3300/0 conn(0x7ff8940c9a00 msgr2=0x7ff894158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:16.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 --2- 172.21.15.28:0/2484879380 >> v2:172.21.15.137:3300/0 conn(0x7ff8940c9a00 0x7ff894158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:16.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 >> v1:172.21.15.137:6789/0 conn(0x7ff8941531a0 legacy=0x7ff8940c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8940c6a70 con 0x7ff8940c9e70 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7ff88c001a00 con 0x7ff8940c9e70 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 >> v1:172.21.15.28:6789/0 conn(0x7ff8940c9e70 legacy=0x7ff894072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 0x7ff87c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff87c004810 0x7ff87c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff87c0051d0 0x7ff87c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff8940c6790 con 0x7ff87c0039c0 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c00c080 con 0x7ff87c0051d0 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff87c00c280 con 0x7ff87c004810 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff899c00640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 0x7ff87c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff89a600640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff87c0051d0 0x7ff87c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff899200640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff87c004810 0x7ff87c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff899c00640 1 -- 172.21.15.28:0/2484879380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff87c004810 msgr2=0x7ff87c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:16.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff899c00640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff87c004810 0x7ff87c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff899c00640 1 -- 172.21.15.28:0/2484879380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff87c0051d0 msgr2=0x7ff87c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff899c00640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff87c0051d0 0x7ff87c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff899c00640 1 -- 172.21.15.28:0/2484879380 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c003530 con 0x7ff87c0039c0 2024-04-23T18:28:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff89a600640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff87c0051d0 0x7ff87c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:28:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.673+0000 7ff89a600640 1 -- 172.21.15.28:0/2484879380 reap_dead start 2024-04-23T18:28:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.677+0000 7ff899c00640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 0x7ff87c003de0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff888001780 tx=0x7ff88801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e64d2a3e0f036d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:16.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.677+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8880013a0 con 0x7ff87c0039c0 2024-04-23T18:28:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.677+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8880052f0 con 0x7ff87c0039c0 2024-04-23T18:28:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.677+0000 7ff893e00640 1 -- 172.21.15.28:0/2484879380 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888003840 con 0x7ff87c0039c0 2024-04-23T18:28:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.677+0000 7ff89c600640 1 -- 172.21.15.28:0/2484879380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 msgr2=0x7ff87c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.677+0000 7ff89c600640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 0x7ff87c003de0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff888001780 tx=0x7ff88801c400 comp rx=0 tx=0).stop 2024-04-23T18:28:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.677+0000 7ff89c600640 1 -- 172.21.15.28:0/2484879380 shutdown_connections 2024-04-23T18:28:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.677+0000 7ff89c600640 1 --2- 172.21.15.28:0/2484879380 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 0x7ff87c003de0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:16.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.677+0000 7ff89c600640 1 -- 172.21.15.28:0/2484879380 >> 172.21.15.28:0/2484879380 conn(0x7ff89406d0a0 msgr2=0x7ff8940676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.677+0000 7ff89c600640 1 -- 172.21.15.28:0/2484879380 shutdown_connections 2024-04-23T18:28:16.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.677+0000 7ff89c600640 1 -- 172.21.15.28:0/2484879380 wait complete. 2024-04-23T18:28:16.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89c600640 1 Processor -- start 2024-04-23T18:28:16.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89c600640 1 -- start start 2024-04-23T18:28:16.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89c600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 0x7ff8940721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:16.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89c600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8941e1590 0x7ff8941e19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:16.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff8941485a0 0x7ff894148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:16.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89c600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff8940c4420 con 0x7ff87c0039c0 2024-04-23T18:28:16.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89c600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff8940c4140 con 0x7ff8941e1590 2024-04-23T18:28:16.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff894153580 con 0x7ff8941485a0 2024-04-23T18:28:16.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff899c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 0x7ff8940721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:16.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff899c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 0x7ff8940721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41964/0 (socket says 172.21.15.28:41964) 2024-04-23T18:28:16.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff899c00640 1 -- 172.21.15.28:0/2735633126 learned_addr learned my addr 172.21.15.28:0/2735633126 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff899200640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8941e1590 0x7ff8941e19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89a600640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff8941485a0 0x7ff894148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff899c00640 1 -- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff8941485a0 msgr2=0x7ff894148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff899c00640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff8941485a0 0x7ff894148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff899c00640 1 -- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8941e1590 msgr2=0x7ff8941e19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff899c00640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8941e1590 0x7ff8941e19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff899c00640 1 -- 172.21.15.28:0/2735633126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8941f1140 con 0x7ff87c0039c0 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff899c00640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 0x7ff8940721a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff88801c230 tx=0x7ff87c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff891600640 1 -- 172.21.15.28:0/2735633126 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8880b8020 con 0x7ff87c0039c0 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff891600640 1 -- 172.21.15.28:0/2735633126 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff888007230 con 0x7ff87c0039c0 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89c600640 1 -- 172.21.15.28:0/2735633126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8941e5c20 con 0x7ff87c0039c0 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff891600640 1 -- 172.21.15.28:0/2735633126 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8880013a0 con 0x7ff87c0039c0 2024-04-23T18:28:16.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89c600640 1 -- 172.21.15.28:0/2735633126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8941e61e0 con 0x7ff87c0039c0 2024-04-23T18:28:16.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.681+0000 7ff89c600640 1 -- 172.21.15.28:0/2735633126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff894068cd0 con 0x7ff87c0039c0 2024-04-23T18:28:16.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.685+0000 7ff891600640 1 -- 172.21.15.28:0/2735633126 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8880bb020 con 0x7ff87c0039c0 2024-04-23T18:28:16.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.685+0000 7ff891600640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff874068380 0x7ff87406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:16.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.685+0000 7ff891600640 1 -- 172.21.15.28:0/2735633126 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff888120ff0 con 0x7ff87c0039c0 2024-04-23T18:28:16.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.685+0000 7ff899200640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff874068380 0x7ff87406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:16.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.685+0000 7ff899200640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff874068380 0x7ff87406a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff8940c9210 tx=0x7ff880008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:16.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.689+0000 7ff891600640 1 -- 172.21.15.28:0/2735633126 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff8880c2030 con 0x7ff87c0039c0 2024-04-23T18:28:16.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.849+0000 7ff89c600640 1 -- 172.21.15.28:0/2735633126 --> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff894068460 con 0x7ff874068380 2024-04-23T18:28:16.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.873+0000 7ff891600640 1 -- 172.21.15.28:0/2735633126 <== mgr.4114 v2:172.21.15.137:6832/2489193639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333769 (secure 0 0 0) 0x7ff894068460 con 0x7ff874068380 2024-04-23T18:28:16.872 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:28:16.874 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-04-23T18:28:16.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 -- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff874068380 msgr2=0x7ff87406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:16.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff874068380 0x7ff87406a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff8940c9210 tx=0x7ff880008040 comp rx=0 tx=0).stop 2024-04-23T18:28:16.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 -- 172.21.15.28:0/2735633126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 msgr2=0x7ff8940721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:16.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 0x7ff8940721a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff88801c230 tx=0x7ff87c005840 comp rx=0 tx=0).stop 2024-04-23T18:28:16.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 -- 172.21.15.28:0/2735633126 shutdown_connections 2024-04-23T18:28:16.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff874068380 0x7ff87406a840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:16.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff8941485a0 0x7ff894148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:16.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff8941e1590 0x7ff8941e19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:16.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 --2- 172.21.15.28:0/2735633126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff87c0039c0 0x7ff8940721a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:16.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 -- 172.21.15.28:0/2735633126 >> 172.21.15.28:0/2735633126 conn(0x7ff89406d0a0 msgr2=0x7ff8940c6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:16.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 -- 172.21.15.28:0/2735633126 shutdown_connections 2024-04-23T18:28:16.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:16.877+0000 7ff89c600640 1 -- 172.21.15.28:0/2735633126 wait complete. 2024-04-23T18:28:16.891 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-04-23T18:28:15.452859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4563132,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":121,"num_read_kb":105,"num_write":11536,"num_write_kb":25172377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13560,"ondisk_log_size":13560,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":502000,"kb_used_data":11248,"kb_used_omap":12,"kb_used_meta":490675,"kb_avail":754472720,"statfs":{"total":773094113280,"available":772580065280,"internally_reserved":0,"allocated":11517952,"data_stored":10041152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":502451760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004672"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:54.587949+0000","last_change":"2024-04-23T18:27:54.587975+0000","last_active":"2024-04-23T18:27:54.587949+0000","last_peered":"2024-04-23T18:27:54.587949+0000","last_clean":"2024-04-23T18:27:54.587949+0000","last_became_active":"2024-04-23T18:22:32.386296+0000","last_became_peered":"2024-04-23T18:22:32.386296+0000","last_unstale":"2024-04-23T18:27:54.587949+0000","last_undegraded":"2024-04-23T18:27:54.587949+0000","last_fullsized":"2024-04-23T18:27:54.587949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'13","last_scrub_stamp":"2024-04-23T18:27:54.587892+0000","last_deep_scrub":"26'13","last_deep_scrub_stamp":"2024-04-23T18:27:54.587892+0000","last_clean_scrub_stamp":"2024-04-23T18:27:54.587892+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:59.527732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:00.955822+0000","last_change":"2024-04-23T18:28:00.955848+0000","last_active":"2024-04-23T18:28:00.955822+0000","last_peered":"2024-04-23T18:28:00.955822+0000","last_clean":"2024-04-23T18:28:00.955822+0000","last_became_active":"2024-04-23T18:23:14.723423+0000","last_became_peered":"2024-04-23T18:23:14.723423+0000","last_unstale":"2024-04-23T18:28:00.955822+0000","last_undegraded":"2024-04-23T18:28:00.955822+0000","last_fullsized":"2024-04-23T18:28:00.955822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-23T18:28:00.955739+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-23T18:28:00.955739+0000","last_clean_scrub_stamp":"2024-04-23T18:28:00.955739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:18.386863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"26'360","reported_seq":389,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:12.470754+0000","last_change":"2024-04-23T18:28:12.470782+0000","last_active":"2024-04-23T18:28:12.470754+0000","last_peered":"2024-04-23T18:28:12.470754+0000","last_clean":"2024-04-23T18:28:12.470754+0000","last_became_active":"2024-04-23T18:22:37.722154+0000","last_became_peered":"2024-04-23T18:22:37.722154+0000","last_unstale":"2024-04-23T18:28:12.470754+0000","last_undegraded":"2024-04-23T18:28:12.470754+0000","last_fullsized":"2024-04-23T18:28:12.470754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'360","last_scrub_stamp":"2024-04-23T18:28:12.470653+0000","last_deep_scrub":"26'360","last_deep_scrub_stamp":"2024-04-23T18:28:12.470653+0000","last_clean_scrub_stamp":"2024-04-23T18:28:12.470653+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:49:00.488745+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:58.296033+0000","last_change":"2024-04-23T18:27:58.296058+0000","last_active":"2024-04-23T18:27:58.296033+0000","last_peered":"2024-04-23T18:27:58.296033+0000","last_clean":"2024-04-23T18:27:58.296033+0000","last_became_active":"2024-04-23T18:22:32.368714+0000","last_became_peered":"2024-04-23T18:22:32.368714+0000","last_unstale":"2024-04-23T18:27:58.296033+0000","last_undegraded":"2024-04-23T18:27:58.296033+0000","last_fullsized":"2024-04-23T18:27:58.296033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-04-23T18:27:58.295949+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-04-23T18:27:58.295949+0000","last_clean_scrub_stamp":"2024-04-23T18:27:58.295949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:21.452203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:01.698555+0000","last_change":"2024-04-23T18:28:01.698599+0000","last_active":"2024-04-23T18:28:01.698555+0000","last_peered":"2024-04-23T18:28:01.698555+0000","last_clean":"2024-04-23T18:28:01.698555+0000","last_became_active":"2024-04-23T18:22:33.379511+0000","last_became_peered":"2024-04-23T18:22:33.379511+0000","last_unstale":"2024-04-23T18:28:01.698555+0000","last_undegraded":"2024-04-23T18:28:01.698555+0000","last_fullsized":"2024-04-23T18:28:01.698555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:28:01.698445+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:28:01.698445+0000","last_clean_scrub_stamp":"2024-04-23T18:28:01.698445+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:04.393043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'377","reported_seq":406,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:07.188471+0000","last_change":"2024-04-23T18:28:07.188592+0000","last_active":"2024-04-23T18:28:07.188471+0000","last_peered":"2024-04-23T18:28:07.188471+0000","last_clean":"2024-04-23T18:28:07.188471+0000","last_became_active":"2024-04-23T18:22:37.427904+0000","last_became_peered":"2024-04-23T18:22:37.427904+0000","last_unstale":"2024-04-23T18:28:07.188471+0000","last_undegraded":"2024-04-23T18:28:07.188471+0000","last_fullsized":"2024-04-23T18:28:07.188471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'377","last_scrub_stamp":"2024-04-23T18:28:07.188232+0000","last_deep_scrub":"26'377","last_deep_scrub_stamp":"2024-04-23T18:28:07.188232+0000","last_clean_scrub_stamp":"2024-04-23T18:28:07.188232+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:33:14.036793+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:00.235159+0000","last_change":"2024-04-23T18:28:00.235279+0000","last_active":"2024-04-23T18:28:00.235159+0000","last_peered":"2024-04-23T18:28:00.235159+0000","last_clean":"2024-04-23T18:28:00.235159+0000","last_became_active":"2024-04-23T18:22:32.399541+0000","last_became_peered":"2024-04-23T18:22:32.399541+0000","last_unstale":"2024-04-23T18:28:00.235159+0000","last_undegraded":"2024-04-23T18:28:00.235159+0000","last_fullsized":"2024-04-23T18:28:00.235159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:28:00.234941+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:28:00.234941+0000","last_clean_scrub_stamp":"2024-04-23T18:28:00.234941+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:06.925484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:06.673797+0000","last_change":"2024-04-23T18:28:06.673858+0000","last_active":"2024-04-23T18:28:06.673797+0000","last_peered":"2024-04-23T18:28:06.673797+0000","last_clean":"2024-04-23T18:28:06.673797+0000","last_became_active":"2024-04-23T18:22:33.392318+0000","last_became_peered":"2024-04-23T18:22:33.392318+0000","last_unstale":"2024-04-23T18:28:06.673797+0000","last_undegraded":"2024-04-23T18:28:06.673797+0000","last_fullsized":"2024-04-23T18:28:06.673797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-23T18:28:06.673640+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-23T18:28:06.673640+0000","last_clean_scrub_stamp":"2024-04-23T18:28:06.673640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:39:40.871364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'324","reported_seq":353,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:01.084048+0000","last_change":"2024-04-23T18:28:01.084137+0000","last_active":"2024-04-23T18:28:01.084048+0000","last_peered":"2024-04-23T18:28:01.084048+0000","last_clean":"2024-04-23T18:28:01.084048+0000","last_became_active":"2024-04-23T18:22:37.415407+0000","last_became_peered":"2024-04-23T18:22:37.415407+0000","last_unstale":"2024-04-23T18:28:01.084048+0000","last_undegraded":"2024-04-23T18:28:01.084048+0000","last_fullsized":"2024-04-23T18:28:01.084048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'324","last_scrub_stamp":"2024-04-23T18:28:01.083848+0000","last_deep_scrub":"26'324","last_deep_scrub_stamp":"2024-04-23T18:28:01.083848+0000","last_clean_scrub_stamp":"2024-04-23T18:28:01.083848+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:02:41.579743+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'3","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:03.282852+0000","last_change":"2024-04-23T18:28:03.282916+0000","last_active":"2024-04-23T18:28:03.282852+0000","last_peered":"2024-04-23T18:28:03.282852+0000","last_clean":"2024-04-23T18:28:03.282852+0000","last_became_active":"2024-04-23T18:22:32.402968+0000","last_became_peered":"2024-04-23T18:22:32.402968+0000","last_unstale":"2024-04-23T18:28:03.282852+0000","last_undegraded":"2024-04-23T18:28:03.282852+0000","last_fullsized":"2024-04-23T18:28:03.282852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-23T18:28:03.282679+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-23T18:28:03.282679+0000","last_clean_scrub_stamp":"2024-04-23T18:28:03.282679+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:21.621497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'15","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:07.653446+0000","last_change":"2024-04-23T18:28:07.653503+0000","last_active":"2024-04-23T18:28:07.653446+0000","last_peered":"2024-04-23T18:28:07.653446+0000","last_clean":"2024-04-23T18:28:07.653446+0000","last_became_active":"2024-04-23T18:22:33.392517+0000","last_became_peered":"2024-04-23T18:22:33.392517+0000","last_unstale":"2024-04-23T18:28:07.653446+0000","last_undegraded":"2024-04-23T18:28:07.653446+0000","last_fullsized":"2024-04-23T18:28:07.653446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'15","last_scrub_stamp":"2024-04-23T18:28:07.653287+0000","last_deep_scrub":"26'15","last_deep_scrub_stamp":"2024-04-23T18:28:07.653287+0000","last_clean_scrub_stamp":"2024-04-23T18:28:07.653287+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:49:59.478005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'298","reported_seq":327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:08.180951+0000","last_change":"2024-04-23T18:28:08.181017+0000","last_active":"2024-04-23T18:28:08.180951+0000","last_peered":"2024-04-23T18:28:08.180951+0000","last_clean":"2024-04-23T18:28:08.180951+0000","last_became_active":"2024-04-23T18:22:37.434073+0000","last_became_peered":"2024-04-23T18:22:37.434073+0000","last_unstale":"2024-04-23T18:28:08.180951+0000","last_undegraded":"2024-04-23T18:28:08.180951+0000","last_fullsized":"2024-04-23T18:28:08.180951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'298","last_scrub_stamp":"2024-04-23T18:28:08.180770+0000","last_deep_scrub":"26'298","last_deep_scrub_stamp":"2024-04-23T18:28:08.180770+0000","last_clean_scrub_stamp":"2024-04-23T18:28:08.180770+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:51.807623+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:04.162463+0000","last_change":"2024-04-23T18:28:04.162525+0000","last_active":"2024-04-23T18:28:04.162463+0000","last_peered":"2024-04-23T18:28:04.162463+0000","last_clean":"2024-04-23T18:28:04.162463+0000","last_became_active":"2024-04-23T18:22:33.390598+0000","last_became_peered":"2024-04-23T18:22:33.390598+0000","last_unstale":"2024-04-23T18:28:04.162463+0000","last_undegraded":"2024-04-23T18:28:04.162463+0000","last_fullsized":"2024-04-23T18:28:04.162463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-23T18:28:04.162286+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-23T18:28:04.162286+0000","last_clean_scrub_stamp":"2024-04-23T18:28:04.162286+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:52.238279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:02.311201+0000","last_change":"2024-04-23T18:28:02.311278+0000","last_active":"2024-04-23T18:28:02.311201+0000","last_peered":"2024-04-23T18:28:02.311201+0000","last_clean":"2024-04-23T18:28:02.311201+0000","last_became_active":"2024-04-23T18:22:32.400001+0000","last_became_peered":"2024-04-23T18:22:32.400001+0000","last_unstale":"2024-04-23T18:28:02.311201+0000","last_undegraded":"2024-04-23T18:28:02.311201+0000","last_fullsized":"2024-04-23T18:28:02.311201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:28:02.311003+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:28:02.311003+0000","last_clean_scrub_stamp":"2024-04-23T18:28:02.311003+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:29.805924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'366","reported_seq":395,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:05.143686+0000","last_change":"2024-04-23T18:28:05.143762+0000","last_active":"2024-04-23T18:28:05.143686+0000","last_peered":"2024-04-23T18:28:05.143686+0000","last_clean":"2024-04-23T18:28:05.143686+0000","last_became_active":"2024-04-23T18:22:37.415884+0000","last_became_peered":"2024-04-23T18:22:37.415884+0000","last_unstale":"2024-04-23T18:28:05.143686+0000","last_undegraded":"2024-04-23T18:28:05.143686+0000","last_fullsized":"2024-04-23T18:28:05.143686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'366","last_scrub_stamp":"2024-04-23T18:28:05.143490+0000","last_deep_scrub":"26'366","last_deep_scrub_stamp":"2024-04-23T18:28:05.143490+0000","last_clean_scrub_stamp":"2024-04-23T18:28:05.143490+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:13:26.310907+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:03.292500+0000","last_change":"2024-04-23T18:28:03.292527+0000","last_active":"2024-04-23T18:28:03.292500+0000","last_peered":"2024-04-23T18:28:03.292500+0000","last_clean":"2024-04-23T18:28:03.292500+0000","last_became_active":"2024-04-23T18:22:33.370413+0000","last_became_peered":"2024-04-23T18:22:33.370413+0000","last_unstale":"2024-04-23T18:28:03.292500+0000","last_undegraded":"2024-04-23T18:28:03.292500+0000","last_fullsized":"2024-04-23T18:28:03.292500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:28:03.292384+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:28:03.292384+0000","last_clean_scrub_stamp":"2024-04-23T18:28:03.292384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:37:36.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'2","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:54.370442+0000","last_change":"2024-04-23T18:27:54.370483+0000","last_active":"2024-04-23T18:27:54.370442+0000","last_peered":"2024-04-23T18:27:54.370442+0000","last_clean":"2024-04-23T18:27:54.370442+0000","last_became_active":"2024-04-23T18:22:32.367513+0000","last_became_peered":"2024-04-23T18:22:32.367513+0000","last_unstale":"2024-04-23T18:27:54.370442+0000","last_undegraded":"2024-04-23T18:27:54.370442+0000","last_fullsized":"2024-04-23T18:27:54.370442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-23T18:27:54.370351+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-23T18:27:54.370351+0000","last_clean_scrub_stamp":"2024-04-23T18:27:54.370351+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:47:57.883732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'330","reported_seq":359,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:04.149755+0000","last_change":"2024-04-23T18:28:04.149818+0000","last_active":"2024-04-23T18:28:04.149755+0000","last_peered":"2024-04-23T18:28:04.149755+0000","last_clean":"2024-04-23T18:28:04.149755+0000","last_became_active":"2024-04-23T18:22:37.421083+0000","last_became_peered":"2024-04-23T18:22:37.421083+0000","last_unstale":"2024-04-23T18:28:04.149755+0000","last_undegraded":"2024-04-23T18:28:04.149755+0000","last_fullsized":"2024-04-23T18:28:04.149755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'330","last_scrub_stamp":"2024-04-23T18:28:04.149554+0000","last_deep_scrub":"26'330","last_deep_scrub_stamp":"2024-04-23T18:28:04.149554+0000","last_clean_scrub_stamp":"2024-04-23T18:28:04.149554+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:19.709811+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:01.327581+0000","last_change":"2024-04-23T18:28:01.327605+0000","last_active":"2024-04-23T18:28:01.327581+0000","last_peered":"2024-04-23T18:28:01.327581+0000","last_clean":"2024-04-23T18:28:01.327581+0000","last_became_active":"2024-04-23T18:22:33.361739+0000","last_became_peered":"2024-04-23T18:22:33.361739+0000","last_unstale":"2024-04-23T18:28:01.327581+0000","last_undegraded":"2024-04-23T18:28:01.327581+0000","last_fullsized":"2024-04-23T18:28:01.327581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-23T18:28:01.327493+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-23T18:28:01.327493+0000","last_clean_scrub_stamp":"2024-04-23T18:28:01.327493+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:56:39.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:57.385553+0000","last_change":"2024-04-23T18:27:57.385584+0000","last_active":"2024-04-23T18:27:57.385553+0000","last_peered":"2024-04-23T18:27:57.385553+0000","last_clean":"2024-04-23T18:27:57.385553+0000","last_became_active":"2024-04-23T18:22:32.378905+0000","last_became_peered":"2024-04-23T18:22:32.378905+0000","last_unstale":"2024-04-23T18:27:57.385553+0000","last_undegraded":"2024-04-23T18:27:57.385553+0000","last_fullsized":"2024-04-23T18:27:57.385553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-23T18:27:57.385477+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-23T18:27:57.385477+0000","last_clean_scrub_stamp":"2024-04-23T18:27:57.385477+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:29.083164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'321","reported_seq":350,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:07.500515+0000","last_change":"2024-04-23T18:28:07.500543+0000","last_active":"2024-04-23T18:28:07.500515+0000","last_peered":"2024-04-23T18:28:07.500515+0000","last_clean":"2024-04-23T18:28:07.500515+0000","last_became_active":"2024-04-23T18:22:37.713229+0000","last_became_peered":"2024-04-23T18:22:37.713229+0000","last_unstale":"2024-04-23T18:28:07.500515+0000","last_undegraded":"2024-04-23T18:28:07.500515+0000","last_fullsized":"2024-04-23T18:28:07.500515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'321","last_scrub_stamp":"2024-04-23T18:28:07.500417+0000","last_deep_scrub":"26'321","last_deep_scrub_stamp":"2024-04-23T18:28:07.500417+0000","last_clean_scrub_stamp":"2024-04-23T18:28:07.500417+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:51:59.834421+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'2","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:55.989637+0000","last_change":"2024-04-23T18:27:55.989785+0000","last_active":"2024-04-23T18:27:55.989637+0000","last_peered":"2024-04-23T18:27:55.989637+0000","last_clean":"2024-04-23T18:27:55.989637+0000","last_became_active":"2024-04-23T18:22:33.366356+0000","last_became_peered":"2024-04-23T18:22:33.366356+0000","last_unstale":"2024-04-23T18:27:55.989637+0000","last_undegraded":"2024-04-23T18:27:55.989637+0000","last_fullsized":"2024-04-23T18:27:55.989637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-23T18:27:55.989409+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-23T18:27:55.989409+0000","last_clean_scrub_stamp":"2024-04-23T18:27:55.989409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:50:29.515633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'3","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:58.210950+0000","last_change":"2024-04-23T18:27:58.211021+0000","last_active":"2024-04-23T18:27:58.210950+0000","last_peered":"2024-04-23T18:27:58.210950+0000","last_clean":"2024-04-23T18:27:58.210950+0000","last_became_active":"2024-04-23T18:22:32.395194+0000","last_became_peered":"2024-04-23T18:22:32.395194+0000","last_unstale":"2024-04-23T18:27:58.210950+0000","last_undegraded":"2024-04-23T18:27:58.210950+0000","last_fullsized":"2024-04-23T18:27:58.210950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-23T18:27:58.210780+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-23T18:27:58.210780+0000","last_clean_scrub_stamp":"2024-04-23T18:27:58.210780+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:15:53.164528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'339","reported_seq":368,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:02.072947+0000","last_change":"2024-04-23T18:28:02.073015+0000","last_active":"2024-04-23T18:28:02.072947+0000","last_peered":"2024-04-23T18:28:02.072947+0000","last_clean":"2024-04-23T18:28:02.072947+0000","last_became_active":"2024-04-23T18:22:37.415693+0000","last_became_peered":"2024-04-23T18:22:37.415693+0000","last_unstale":"2024-04-23T18:28:02.072947+0000","last_undegraded":"2024-04-23T18:28:02.072947+0000","last_fullsized":"2024-04-23T18:28:02.072947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'339","last_scrub_stamp":"2024-04-23T18:28:02.072757+0000","last_deep_scrub":"26'339","last_deep_scrub_stamp":"2024-04-23T18:28:02.072757+0000","last_clean_scrub_stamp":"2024-04-23T18:28:02.072757+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:46.720986+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:56.608723+0000","last_change":"2024-04-23T18:27:56.608744+0000","last_active":"2024-04-23T18:27:56.608723+0000","last_peered":"2024-04-23T18:27:56.608723+0000","last_clean":"2024-04-23T18:27:56.608723+0000","last_became_active":"2024-04-23T18:22:33.360129+0000","last_became_peered":"2024-04-23T18:22:33.360129+0000","last_unstale":"2024-04-23T18:27:56.608723+0000","last_undegraded":"2024-04-23T18:27:56.608723+0000","last_fullsized":"2024-04-23T18:27:56.608723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:27:56.608656+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:27:56.608656+0000","last_clean_scrub_stamp":"2024-04-23T18:27:56.608656+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:31:49.976725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:59.134213+0000","last_change":"2024-04-23T18:27:59.134279+0000","last_active":"2024-04-23T18:27:59.134213+0000","last_peered":"2024-04-23T18:27:59.134213+0000","last_clean":"2024-04-23T18:27:59.134213+0000","last_became_active":"2024-04-23T18:22:32.391275+0000","last_became_peered":"2024-04-23T18:22:32.391275+0000","last_unstale":"2024-04-23T18:27:59.134213+0000","last_undegraded":"2024-04-23T18:27:59.134213+0000","last_fullsized":"2024-04-23T18:27:59.134213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:27:59.134040+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:27:59.134040+0000","last_clean_scrub_stamp":"2024-04-23T18:27:59.134040+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:31.644251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'306","reported_seq":335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:09.185928+0000","last_change":"2024-04-23T18:28:09.185998+0000","last_active":"2024-04-23T18:28:09.185928+0000","last_peered":"2024-04-23T18:28:09.185928+0000","last_clean":"2024-04-23T18:28:09.185928+0000","last_became_active":"2024-04-23T18:22:37.722300+0000","last_became_peered":"2024-04-23T18:22:37.722300+0000","last_unstale":"2024-04-23T18:28:09.185928+0000","last_undegraded":"2024-04-23T18:28:09.185928+0000","last_fullsized":"2024-04-23T18:28:09.185928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'306","last_scrub_stamp":"2024-04-23T18:28:09.185714+0000","last_deep_scrub":"26'306","last_deep_scrub_stamp":"2024-04-23T18:28:09.185714+0000","last_clean_scrub_stamp":"2024-04-23T18:28:09.185714+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:33:50.348126+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:55.221722+0000","last_change":"2024-04-23T18:27:55.221745+0000","last_active":"2024-04-23T18:27:55.221722+0000","last_peered":"2024-04-23T18:27:55.221722+0000","last_clean":"2024-04-23T18:27:55.221722+0000","last_became_active":"2024-04-23T18:22:33.380250+0000","last_became_peered":"2024-04-23T18:22:33.380250+0000","last_unstale":"2024-04-23T18:27:55.221722+0000","last_undegraded":"2024-04-23T18:27:55.221722+0000","last_fullsized":"2024-04-23T18:27:55.221722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-23T18:27:55.221645+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-23T18:27:55.221645+0000","last_clean_scrub_stamp":"2024-04-23T18:27:55.221645+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:04:26.496695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'27","reported_seq":64,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:55.339129+0000","last_change":"2024-04-23T18:27:55.339153+0000","last_active":"2024-04-23T18:27:55.339129+0000","last_peered":"2024-04-23T18:27:55.339129+0000","last_clean":"2024-04-23T18:27:55.339129+0000","last_became_active":"2024-04-23T18:22:32.372584+0000","last_became_peered":"2024-04-23T18:22:32.372584+0000","last_unstale":"2024-04-23T18:27:55.339129+0000","last_undegraded":"2024-04-23T18:27:55.339129+0000","last_fullsized":"2024-04-23T18:27:55.339129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'27","last_scrub_stamp":"2024-04-23T18:27:55.339069+0000","last_deep_scrub":"26'27","last_deep_scrub_stamp":"2024-04-23T18:27:55.339069+0000","last_clean_scrub_stamp":"2024-04-23T18:27:55.339069+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:47.275318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'328","reported_seq":357,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:08.374592+0000","last_change":"2024-04-23T18:28:08.374620+0000","last_active":"2024-04-23T18:28:08.374592+0000","last_peered":"2024-04-23T18:28:08.374592+0000","last_clean":"2024-04-23T18:28:08.374592+0000","last_became_active":"2024-04-23T18:22:37.710566+0000","last_became_peered":"2024-04-23T18:22:37.710566+0000","last_unstale":"2024-04-23T18:28:08.374592+0000","last_undegraded":"2024-04-23T18:28:08.374592+0000","last_fullsized":"2024-04-23T18:28:08.374592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'328","last_scrub_stamp":"2024-04-23T18:28:08.374490+0000","last_deep_scrub":"26'328","last_deep_scrub_stamp":"2024-04-23T18:28:08.374490+0000","last_clean_scrub_stamp":"2024-04-23T18:28:08.374490+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:05.320069+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:03.401000+0000","last_change":"2024-04-23T18:28:03.401024+0000","last_active":"2024-04-23T18:28:03.401000+0000","last_peered":"2024-04-23T18:28:03.401000+0000","last_clean":"2024-04-23T18:28:03.401000+0000","last_became_active":"2024-04-23T18:22:33.365982+0000","last_became_peered":"2024-04-23T18:22:33.365982+0000","last_unstale":"2024-04-23T18:28:03.401000+0000","last_undegraded":"2024-04-23T18:28:03.401000+0000","last_fullsized":"2024-04-23T18:28:03.401000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-23T18:28:03.400915+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-23T18:28:03.400915+0000","last_clean_scrub_stamp":"2024-04-23T18:28:03.400915+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:33:25.102378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'2","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:01.264903+0000","last_change":"2024-04-23T18:28:01.264964+0000","last_active":"2024-04-23T18:28:01.264903+0000","last_peered":"2024-04-23T18:28:01.264903+0000","last_clean":"2024-04-23T18:28:01.264903+0000","last_became_active":"2024-04-23T18:22:32.399689+0000","last_became_peered":"2024-04-23T18:22:32.399689+0000","last_unstale":"2024-04-23T18:28:01.264903+0000","last_undegraded":"2024-04-23T18:28:01.264903+0000","last_fullsized":"2024-04-23T18:28:01.264903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-23T18:28:01.264734+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-23T18:28:01.264734+0000","last_clean_scrub_stamp":"2024-04-23T18:28:01.264734+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:18:58.716215+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'297","reported_seq":326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:05.706257+0000","last_change":"2024-04-23T18:28:05.706309+0000","last_active":"2024-04-23T18:28:05.706257+0000","last_peered":"2024-04-23T18:28:05.706257+0000","last_clean":"2024-04-23T18:28:05.706257+0000","last_became_active":"2024-04-23T18:22:37.712124+0000","last_became_peered":"2024-04-23T18:22:37.712124+0000","last_unstale":"2024-04-23T18:28:05.706257+0000","last_undegraded":"2024-04-23T18:28:05.706257+0000","last_fullsized":"2024-04-23T18:28:05.706257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'297","last_scrub_stamp":"2024-04-23T18:28:05.706143+0000","last_deep_scrub":"26'297","last_deep_scrub_stamp":"2024-04-23T18:28:05.706143+0000","last_clean_scrub_stamp":"2024-04-23T18:28:05.706143+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:05:22.115689+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:08.618775+0000","last_change":"2024-04-23T18:28:08.618831+0000","last_active":"2024-04-23T18:28:08.618775+0000","last_peered":"2024-04-23T18:28:08.618775+0000","last_clean":"2024-04-23T18:28:08.618775+0000","last_became_active":"2024-04-23T18:22:33.392777+0000","last_became_peered":"2024-04-23T18:22:33.392777+0000","last_unstale":"2024-04-23T18:28:08.618775+0000","last_undegraded":"2024-04-23T18:28:08.618775+0000","last_fullsized":"2024-04-23T18:28:08.618775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-23T18:28:08.618598+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-23T18:28:08.618598+0000","last_clean_scrub_stamp":"2024-04-23T18:28:08.618598+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:01:44.431460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:53.417285+0000","last_change":"2024-04-23T18:27:53.417317+0000","last_active":"2024-04-23T18:27:53.417285+0000","last_peered":"2024-04-23T18:27:53.417285+0000","last_clean":"2024-04-23T18:27:53.417285+0000","last_became_active":"2024-04-23T18:22:32.370108+0000","last_became_peered":"2024-04-23T18:22:32.370108+0000","last_unstale":"2024-04-23T18:27:53.417285+0000","last_undegraded":"2024-04-23T18:27:53.417285+0000","last_fullsized":"2024-04-23T18:27:53.417285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:27:53.417138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:27:53.417138+0000","last_clean_scrub_stamp":"2024-04-23T18:27:53.417138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:13:05.591897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'320","reported_seq":349,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:06.502226+0000","last_change":"2024-04-23T18:28:06.502254+0000","last_active":"2024-04-23T18:28:06.502226+0000","last_peered":"2024-04-23T18:28:06.502226+0000","last_clean":"2024-04-23T18:28:06.502226+0000","last_became_active":"2024-04-23T18:22:37.434383+0000","last_became_peered":"2024-04-23T18:22:37.434383+0000","last_unstale":"2024-04-23T18:28:06.502226+0000","last_undegraded":"2024-04-23T18:28:06.502226+0000","last_fullsized":"2024-04-23T18:28:06.502226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'320","last_scrub_stamp":"2024-04-23T18:28:06.502128+0000","last_deep_scrub":"26'320","last_deep_scrub_stamp":"2024-04-23T18:28:06.502128+0000","last_clean_scrub_stamp":"2024-04-23T18:28:06.502128+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:12.706858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:57.004222+0000","last_change":"2024-04-23T18:27:57.004282+0000","last_active":"2024-04-23T18:27:57.004222+0000","last_peered":"2024-04-23T18:27:57.004222+0000","last_clean":"2024-04-23T18:27:57.004222+0000","last_became_active":"2024-04-23T18:22:33.365238+0000","last_became_peered":"2024-04-23T18:22:33.365238+0000","last_unstale":"2024-04-23T18:27:57.004222+0000","last_undegraded":"2024-04-23T18:27:57.004222+0000","last_fullsized":"2024-04-23T18:27:57.004222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:27:57.004037+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:27:57.004037+0000","last_clean_scrub_stamp":"2024-04-23T18:27:57.004037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:36:09.782147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:01.746355+0000","last_change":"2024-04-23T18:28:01.746421+0000","last_active":"2024-04-23T18:28:01.746355+0000","last_peered":"2024-04-23T18:28:01.746355+0000","last_clean":"2024-04-23T18:28:01.746355+0000","last_became_active":"2024-04-23T18:22:32.387142+0000","last_became_peered":"2024-04-23T18:22:32.387142+0000","last_unstale":"2024-04-23T18:28:01.746355+0000","last_undegraded":"2024-04-23T18:28:01.746355+0000","last_fullsized":"2024-04-23T18:28:01.746355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-04-23T18:28:01.746178+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-04-23T18:28:01.746178+0000","last_clean_scrub_stamp":"2024-04-23T18:28:01.746178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:40:17.742180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'301","reported_seq":330,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:05.453886+0000","last_change":"2024-04-23T18:28:05.453916+0000","last_active":"2024-04-23T18:28:05.453886+0000","last_peered":"2024-04-23T18:28:05.453886+0000","last_clean":"2024-04-23T18:28:05.453886+0000","last_became_active":"2024-04-23T18:22:37.415944+0000","last_became_peered":"2024-04-23T18:22:37.415944+0000","last_unstale":"2024-04-23T18:28:05.453886+0000","last_undegraded":"2024-04-23T18:28:05.453886+0000","last_fullsized":"2024-04-23T18:28:05.453886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'301","last_scrub_stamp":"2024-04-23T18:28:05.453780+0000","last_deep_scrub":"26'301","last_deep_scrub_stamp":"2024-04-23T18:28:05.453780+0000","last_clean_scrub_stamp":"2024-04-23T18:28:05.453780+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:23:48.075675+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:02.407978+0000","last_change":"2024-04-23T18:28:02.408001+0000","last_active":"2024-04-23T18:28:02.407978+0000","last_peered":"2024-04-23T18:28:02.407978+0000","last_clean":"2024-04-23T18:28:02.407978+0000","last_became_active":"2024-04-23T18:22:33.367694+0000","last_became_peered":"2024-04-23T18:22:33.367694+0000","last_unstale":"2024-04-23T18:28:02.407978+0000","last_undegraded":"2024-04-23T18:28:02.407978+0000","last_fullsized":"2024-04-23T18:28:02.407978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:28:02.407900+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:28:02.407900+0000","last_clean_scrub_stamp":"2024-04-23T18:28:02.407900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:29:59.555579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'12","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:53.950585+0000","last_change":"2024-04-23T18:27:53.950640+0000","last_active":"2024-04-23T18:27:53.950585+0000","last_peered":"2024-04-23T18:27:53.950585+0000","last_clean":"2024-04-23T18:27:53.950585+0000","last_became_active":"2024-04-23T18:22:32.357171+0000","last_became_peered":"2024-04-23T18:22:32.357171+0000","last_unstale":"2024-04-23T18:27:53.950585+0000","last_undegraded":"2024-04-23T18:27:53.950585+0000","last_fullsized":"2024-04-23T18:27:53.950585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-04-23T18:27:53.950515+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-04-23T18:27:53.950515+0000","last_clean_scrub_stamp":"2024-04-23T18:27:53.950515+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:17.578547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'319","reported_seq":342,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:03.028753+0000","last_change":"2024-04-23T18:28:03.028783+0000","last_active":"2024-04-23T18:28:03.028753+0000","last_peered":"2024-04-23T18:28:03.028753+0000","last_clean":"2024-04-23T18:28:03.028753+0000","last_became_active":"2024-04-23T18:23:14.729941+0000","last_became_peered":"2024-04-23T18:23:14.729941+0000","last_unstale":"2024-04-23T18:28:03.028753+0000","last_undegraded":"2024-04-23T18:28:03.028753+0000","last_fullsized":"2024-04-23T18:28:03.028753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'319","last_scrub_stamp":"2024-04-23T18:28:03.028646+0000","last_deep_scrub":"26'319","last_deep_scrub_stamp":"2024-04-23T18:28:03.028646+0000","last_clean_scrub_stamp":"2024-04-23T18:28:03.028646+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:05:11.463003+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:59.679653+0000","last_change":"2024-04-23T18:27:59.679676+0000","last_active":"2024-04-23T18:27:59.679653+0000","last_peered":"2024-04-23T18:27:59.679653+0000","last_clean":"2024-04-23T18:27:59.679653+0000","last_became_active":"2024-04-23T18:22:33.367158+0000","last_became_peered":"2024-04-23T18:22:33.367158+0000","last_unstale":"2024-04-23T18:27:59.679653+0000","last_undegraded":"2024-04-23T18:27:59.679653+0000","last_fullsized":"2024-04-23T18:27:59.679653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-23T18:27:59.679568+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-23T18:27:59.679568+0000","last_clean_scrub_stamp":"2024-04-23T18:27:59.679568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:17:10.881052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:59.222206+0000","last_change":"2024-04-23T18:27:59.222330+0000","last_active":"2024-04-23T18:27:59.222206+0000","last_peered":"2024-04-23T18:27:59.222206+0000","last_clean":"2024-04-23T18:27:59.222206+0000","last_became_active":"2024-04-23T18:22:32.395948+0000","last_became_peered":"2024-04-23T18:22:32.395948+0000","last_unstale":"2024-04-23T18:27:59.222206+0000","last_undegraded":"2024-04-23T18:27:59.222206+0000","last_fullsized":"2024-04-23T18:27:59.222206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-23T18:27:59.222006+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-23T18:27:59.222006+0000","last_clean_scrub_stamp":"2024-04-23T18:27:59.222006+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:08:51.378639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'378","reported_seq":407,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:06.669549+0000","last_change":"2024-04-23T18:28:06.669580+0000","last_active":"2024-04-23T18:28:06.669549+0000","last_peered":"2024-04-23T18:28:06.669549+0000","last_clean":"2024-04-23T18:28:06.669549+0000","last_became_active":"2024-04-23T18:22:37.714150+0000","last_became_peered":"2024-04-23T18:22:37.714150+0000","last_unstale":"2024-04-23T18:28:06.669549+0000","last_undegraded":"2024-04-23T18:28:06.669549+0000","last_fullsized":"2024-04-23T18:28:06.669549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'378","last_scrub_stamp":"2024-04-23T18:28:06.669440+0000","last_deep_scrub":"26'378","last_deep_scrub_stamp":"2024-04-23T18:28:06.669440+0000","last_clean_scrub_stamp":"2024-04-23T18:28:06.669440+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:37.337853+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:56.243989+0000","last_change":"2024-04-23T18:27:56.244009+0000","last_active":"2024-04-23T18:27:56.243989+0000","last_peered":"2024-04-23T18:27:56.243989+0000","last_clean":"2024-04-23T18:27:56.243989+0000","last_became_active":"2024-04-23T18:22:33.397642+0000","last_became_peered":"2024-04-23T18:22:33.397642+0000","last_unstale":"2024-04-23T18:27:56.243989+0000","last_undegraded":"2024-04-23T18:27:56.243989+0000","last_fullsized":"2024-04-23T18:27:56.243989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:27:56.243926+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:27:56.243926+0000","last_clean_scrub_stamp":"2024-04-23T18:27:56.243926+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:15:48.472793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:58.730468+0000","last_change":"2024-04-23T18:27:58.730537+0000","last_active":"2024-04-23T18:27:58.730468+0000","last_peered":"2024-04-23T18:27:58.730468+0000","last_clean":"2024-04-23T18:27:58.730468+0000","last_became_active":"2024-04-23T18:22:32.382313+0000","last_became_peered":"2024-04-23T18:22:32.382313+0000","last_unstale":"2024-04-23T18:27:58.730468+0000","last_undegraded":"2024-04-23T18:27:58.730468+0000","last_fullsized":"2024-04-23T18:27:58.730468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:27:58.730294+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:27:58.730294+0000","last_clean_scrub_stamp":"2024-04-23T18:27:58.730294+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:39.858282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":195,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:57.179317+0000","last_change":"2024-04-23T18:27:57.179392+0000","last_active":"2024-04-23T18:27:57.179317+0000","last_peered":"2024-04-23T18:27:57.179317+0000","last_clean":"2024-04-23T18:27:57.179317+0000","last_became_active":"2024-04-23T18:22:21.618103+0000","last_became_peered":"2024-04-23T18:22:21.618103+0000","last_unstale":"2024-04-23T18:27:57.179317+0000","last_undegraded":"2024-04-23T18:27:57.179317+0000","last_fullsized":"2024-04-23T18:27:57.179317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-23T18:27:57.179166+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-23T18:27:57.179166+0000","last_clean_scrub_stamp":"2024-04-23T18:27:57.179166+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:31.030508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'315","reported_seq":344,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:09.191031+0000","last_change":"2024-04-23T18:28:09.191094+0000","last_active":"2024-04-23T18:28:09.191031+0000","last_peered":"2024-04-23T18:28:09.191031+0000","last_clean":"2024-04-23T18:28:09.191031+0000","last_became_active":"2024-04-23T18:22:37.714011+0000","last_became_peered":"2024-04-23T18:22:37.714011+0000","last_unstale":"2024-04-23T18:28:09.191031+0000","last_undegraded":"2024-04-23T18:28:09.191031+0000","last_fullsized":"2024-04-23T18:28:09.191031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'315","last_scrub_stamp":"2024-04-23T18:28:09.190830+0000","last_deep_scrub":"26'315","last_deep_scrub_stamp":"2024-04-23T18:28:09.190830+0000","last_clean_scrub_stamp":"2024-04-23T18:28:09.190830+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:24:49.797351+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:11.283360+0000","last_change":"2024-04-23T18:28:11.283475+0000","last_active":"2024-04-23T18:28:11.283360+0000","last_peered":"2024-04-23T18:28:11.283360+0000","last_clean":"2024-04-23T18:28:11.283360+0000","last_became_active":"2024-04-23T18:22:33.403890+0000","last_became_peered":"2024-04-23T18:22:33.403890+0000","last_unstale":"2024-04-23T18:28:11.283360+0000","last_undegraded":"2024-04-23T18:28:11.283360+0000","last_fullsized":"2024-04-23T18:28:11.283360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:28:11.283158+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:28:11.283158+0000","last_clean_scrub_stamp":"2024-04-23T18:28:11.283158+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:37:59.298168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'5","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:56.970248+0000","last_change":"2024-04-23T18:27:56.970274+0000","last_active":"2024-04-23T18:27:56.970248+0000","last_peered":"2024-04-23T18:27:56.970248+0000","last_clean":"2024-04-23T18:27:56.970248+0000","last_became_active":"2024-04-23T18:22:32.387863+0000","last_became_peered":"2024-04-23T18:22:32.387863+0000","last_unstale":"2024-04-23T18:27:56.970248+0000","last_undegraded":"2024-04-23T18:27:56.970248+0000","last_fullsized":"2024-04-23T18:27:56.970248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-23T18:27:56.970179+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-23T18:27:56.970179+0000","last_clean_scrub_stamp":"2024-04-23T18:27:56.970179+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:17:59.453121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'338","reported_seq":367,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:10.176712+0000","last_change":"2024-04-23T18:28:10.176843+0000","last_active":"2024-04-23T18:28:10.176712+0000","last_peered":"2024-04-23T18:28:10.176712+0000","last_clean":"2024-04-23T18:28:10.176712+0000","last_became_active":"2024-04-23T18:22:37.718154+0000","last_became_peered":"2024-04-23T18:22:37.718154+0000","last_unstale":"2024-04-23T18:28:10.176712+0000","last_undegraded":"2024-04-23T18:28:10.176712+0000","last_fullsized":"2024-04-23T18:28:10.176712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'338","last_scrub_stamp":"2024-04-23T18:28:10.176396+0000","last_deep_scrub":"26'338","last_deep_scrub_stamp":"2024-04-23T18:28:10.176396+0000","last_clean_scrub_stamp":"2024-04-23T18:28:10.176396+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:58:59.756915+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:55.708398+0000","last_change":"2024-04-23T18:27:55.708461+0000","last_active":"2024-04-23T18:27:55.708398+0000","last_peered":"2024-04-23T18:27:55.708398+0000","last_clean":"2024-04-23T18:27:55.708398+0000","last_became_active":"2024-04-23T18:22:33.385953+0000","last_became_peered":"2024-04-23T18:22:33.385953+0000","last_unstale":"2024-04-23T18:27:55.708398+0000","last_undegraded":"2024-04-23T18:27:55.708398+0000","last_fullsized":"2024-04-23T18:27:55.708398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:27:55.708212+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:27:55.708212+0000","last_clean_scrub_stamp":"2024-04-23T18:27:55.708212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:31:34.355905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'2","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:56.366021+0000","last_change":"2024-04-23T18:27:56.366064+0000","last_active":"2024-04-23T18:27:56.366021+0000","last_peered":"2024-04-23T18:27:56.366021+0000","last_clean":"2024-04-23T18:27:56.366021+0000","last_became_active":"2024-04-23T18:22:32.373809+0000","last_became_peered":"2024-04-23T18:22:32.373809+0000","last_unstale":"2024-04-23T18:27:56.366021+0000","last_undegraded":"2024-04-23T18:27:56.366021+0000","last_fullsized":"2024-04-23T18:27:56.366021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-23T18:27:56.365917+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-23T18:27:56.365917+0000","last_clean_scrub_stamp":"2024-04-23T18:27:56.365917+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:12:23.425936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'299","reported_seq":335,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:08.654345+0000","last_change":"2024-04-23T18:28:08.654371+0000","last_active":"2024-04-23T18:28:08.654345+0000","last_peered":"2024-04-23T18:28:08.654345+0000","last_clean":"2024-04-23T18:28:08.654345+0000","last_became_active":"2024-04-23T18:23:14.727676+0000","last_became_peered":"2024-04-23T18:23:14.727676+0000","last_unstale":"2024-04-23T18:28:08.654345+0000","last_undegraded":"2024-04-23T18:28:08.654345+0000","last_fullsized":"2024-04-23T18:28:08.654345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'299","last_scrub_stamp":"2024-04-23T18:28:08.654241+0000","last_deep_scrub":"26'299","last_deep_scrub_stamp":"2024-04-23T18:28:08.654241+0000","last_clean_scrub_stamp":"2024-04-23T18:28:08.654241+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:06.684621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:10.257729+0000","last_change":"2024-04-23T18:28:10.257795+0000","last_active":"2024-04-23T18:28:10.257729+0000","last_peered":"2024-04-23T18:28:10.257729+0000","last_clean":"2024-04-23T18:28:10.257729+0000","last_became_active":"2024-04-23T18:22:33.402525+0000","last_became_peered":"2024-04-23T18:22:33.402525+0000","last_unstale":"2024-04-23T18:28:10.257729+0000","last_undegraded":"2024-04-23T18:28:10.257729+0000","last_fullsized":"2024-04-23T18:28:10.257729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-23T18:28:10.257524+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-23T18:28:10.257524+0000","last_clean_scrub_stamp":"2024-04-23T18:28:10.257524+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:38:57.420649+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'3","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:54.944194+0000","last_change":"2024-04-23T18:27:54.944238+0000","last_active":"2024-04-23T18:27:54.944194+0000","last_peered":"2024-04-23T18:27:54.944194+0000","last_clean":"2024-04-23T18:27:54.944194+0000","last_became_active":"2024-04-23T18:22:32.358192+0000","last_became_peered":"2024-04-23T18:22:32.358192+0000","last_unstale":"2024-04-23T18:27:54.944194+0000","last_undegraded":"2024-04-23T18:27:54.944194+0000","last_fullsized":"2024-04-23T18:27:54.944194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-23T18:27:54.944110+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-23T18:27:54.944110+0000","last_clean_scrub_stamp":"2024-04-23T18:27:54.944110+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:15.738111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'365","reported_seq":394,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:11.606107+0000","last_change":"2024-04-23T18:28:11.606171+0000","last_active":"2024-04-23T18:28:11.606107+0000","last_peered":"2024-04-23T18:28:11.606107+0000","last_clean":"2024-04-23T18:28:11.606107+0000","last_became_active":"2024-04-23T18:22:37.714219+0000","last_became_peered":"2024-04-23T18:22:37.714219+0000","last_unstale":"2024-04-23T18:28:11.606107+0000","last_undegraded":"2024-04-23T18:28:11.606107+0000","last_fullsized":"2024-04-23T18:28:11.606107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'365","last_scrub_stamp":"2024-04-23T18:28:11.605907+0000","last_deep_scrub":"26'365","last_deep_scrub_stamp":"2024-04-23T18:28:11.605907+0000","last_clean_scrub_stamp":"2024-04-23T18:28:11.605907+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:52.722099+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:08.272536+0000","last_change":"2024-04-23T18:28:08.272601+0000","last_active":"2024-04-23T18:28:08.272536+0000","last_peered":"2024-04-23T18:28:08.272536+0000","last_clean":"2024-04-23T18:28:08.272536+0000","last_became_active":"2024-04-23T18:22:33.402379+0000","last_became_peered":"2024-04-23T18:22:33.402379+0000","last_unstale":"2024-04-23T18:28:08.272536+0000","last_undegraded":"2024-04-23T18:28:08.272536+0000","last_fullsized":"2024-04-23T18:28:08.272536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-23T18:28:08.272369+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-23T18:28:08.272369+0000","last_clean_scrub_stamp":"2024-04-23T18:28:08.272369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:35:58.989105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'6","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:54.992533+0000","last_change":"2024-04-23T18:27:54.992600+0000","last_active":"2024-04-23T18:27:54.992533+0000","last_peered":"2024-04-23T18:27:54.992533+0000","last_clean":"2024-04-23T18:27:54.992533+0000","last_became_active":"2024-04-23T18:22:32.372338+0000","last_became_peered":"2024-04-23T18:22:32.372338+0000","last_unstale":"2024-04-23T18:27:54.992533+0000","last_undegraded":"2024-04-23T18:27:54.992533+0000","last_fullsized":"2024-04-23T18:27:54.992533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:27:54.992359+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:27:54.992359+0000","last_clean_scrub_stamp":"2024-04-23T18:27:54.992359+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:44.869456+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'302","reported_seq":331,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:03.111900+0000","last_change":"2024-04-23T18:28:03.112018+0000","last_active":"2024-04-23T18:28:03.111900+0000","last_peered":"2024-04-23T18:28:03.111900+0000","last_clean":"2024-04-23T18:28:03.111900+0000","last_became_active":"2024-04-23T18:22:37.420095+0000","last_became_peered":"2024-04-23T18:22:37.420095+0000","last_unstale":"2024-04-23T18:28:03.111900+0000","last_undegraded":"2024-04-23T18:28:03.111900+0000","last_fullsized":"2024-04-23T18:28:03.111900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'302","last_scrub_stamp":"2024-04-23T18:28:03.111673+0000","last_deep_scrub":"26'302","last_deep_scrub_stamp":"2024-04-23T18:28:03.111673+0000","last_clean_scrub_stamp":"2024-04-23T18:28:03.111673+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:36.915965+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'6","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:01.979686+0000","last_change":"2024-04-23T18:28:01.979709+0000","last_active":"2024-04-23T18:28:01.979686+0000","last_peered":"2024-04-23T18:28:01.979686+0000","last_clean":"2024-04-23T18:28:01.979686+0000","last_became_active":"2024-04-23T18:23:14.723676+0000","last_became_peered":"2024-04-23T18:23:14.723676+0000","last_unstale":"2024-04-23T18:28:01.979686+0000","last_undegraded":"2024-04-23T18:28:01.979686+0000","last_fullsized":"2024-04-23T18:28:01.979686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:28:01.979612+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:28:01.979612+0000","last_clean_scrub_stamp":"2024-04-23T18:28:01.979612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:49:56.532338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"26'24","reported_seq":61,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:55.940727+0000","last_change":"2024-04-23T18:27:55.940767+0000","last_active":"2024-04-23T18:27:55.940727+0000","last_peered":"2024-04-23T18:27:55.940727+0000","last_clean":"2024-04-23T18:27:55.940727+0000","last_became_active":"2024-04-23T18:22:32.359646+0000","last_became_peered":"2024-04-23T18:22:32.359646+0000","last_unstale":"2024-04-23T18:27:55.940727+0000","last_undegraded":"2024-04-23T18:27:55.940727+0000","last_fullsized":"2024-04-23T18:27:55.940727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'24","last_scrub_stamp":"2024-04-23T18:27:55.940666+0000","last_deep_scrub":"26'24","last_deep_scrub_stamp":"2024-04-23T18:27:55.940666+0000","last_clean_scrub_stamp":"2024-04-23T18:27:55.940666+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:02:48.379326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'416","reported_seq":445,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:04.688425+0000","last_change":"2024-04-23T18:28:04.688456+0000","last_active":"2024-04-23T18:28:04.688425+0000","last_peered":"2024-04-23T18:28:04.688425+0000","last_clean":"2024-04-23T18:28:04.688425+0000","last_became_active":"2024-04-23T18:22:37.423434+0000","last_became_peered":"2024-04-23T18:22:37.423434+0000","last_unstale":"2024-04-23T18:28:04.688425+0000","last_undegraded":"2024-04-23T18:28:04.688425+0000","last_fullsized":"2024-04-23T18:28:04.688425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'416","last_scrub_stamp":"2024-04-23T18:28:04.688319+0000","last_deep_scrub":"26'416","last_deep_scrub_stamp":"2024-04-23T18:28:04.688319+0000","last_clean_scrub_stamp":"2024-04-23T18:28:04.688319+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:35:55.986174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:01.120541+0000","last_change":"2024-04-23T18:28:01.120602+0000","last_active":"2024-04-23T18:28:01.120541+0000","last_peered":"2024-04-23T18:28:01.120541+0000","last_clean":"2024-04-23T18:28:01.120541+0000","last_became_active":"2024-04-23T18:22:33.371462+0000","last_became_peered":"2024-04-23T18:22:33.371462+0000","last_unstale":"2024-04-23T18:28:01.120541+0000","last_undegraded":"2024-04-23T18:28:01.120541+0000","last_fullsized":"2024-04-23T18:28:01.120541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:28:01.120368+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:28:01.120368+0000","last_clean_scrub_stamp":"2024-04-23T18:28:01.120368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:02.824954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:58.107176+0000","last_change":"2024-04-23T18:27:58.107243+0000","last_active":"2024-04-23T18:27:58.107176+0000","last_peered":"2024-04-23T18:27:58.107176+0000","last_clean":"2024-04-23T18:27:58.107176+0000","last_became_active":"2024-04-23T18:22:32.384372+0000","last_became_peered":"2024-04-23T18:22:32.384372+0000","last_unstale":"2024-04-23T18:27:58.107176+0000","last_undegraded":"2024-04-23T18:27:58.107176+0000","last_fullsized":"2024-04-23T18:27:58.107176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:27:58.106993+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:27:58.106993+0000","last_clean_scrub_stamp":"2024-04-23T18:27:58.106993+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:34:33.835407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'318","reported_seq":347,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:11.451685+0000","last_change":"2024-04-23T18:28:11.451716+0000","last_active":"2024-04-23T18:28:11.451685+0000","last_peered":"2024-04-23T18:28:11.451685+0000","last_clean":"2024-04-23T18:28:11.451685+0000","last_became_active":"2024-04-23T18:22:37.719200+0000","last_became_peered":"2024-04-23T18:22:37.719200+0000","last_unstale":"2024-04-23T18:28:11.451685+0000","last_undegraded":"2024-04-23T18:28:11.451685+0000","last_fullsized":"2024-04-23T18:28:11.451685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'318","last_scrub_stamp":"2024-04-23T18:28:11.451577+0000","last_deep_scrub":"26'318","last_deep_scrub_stamp":"2024-04-23T18:28:11.451577+0000","last_clean_scrub_stamp":"2024-04-23T18:28:11.451577+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:18:54.398410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'15","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:09.231983+0000","last_change":"2024-04-23T18:28:09.232047+0000","last_active":"2024-04-23T18:28:09.231983+0000","last_peered":"2024-04-23T18:28:09.231983+0000","last_clean":"2024-04-23T18:28:09.231983+0000","last_became_active":"2024-04-23T18:22:33.402376+0000","last_became_peered":"2024-04-23T18:22:33.402376+0000","last_unstale":"2024-04-23T18:28:09.231983+0000","last_undegraded":"2024-04-23T18:28:09.231983+0000","last_fullsized":"2024-04-23T18:28:09.231983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'15","last_scrub_stamp":"2024-04-23T18:28:09.231806+0000","last_deep_scrub":"26'15","last_deep_scrub_stamp":"2024-04-23T18:28:09.231806+0000","last_clean_scrub_stamp":"2024-04-23T18:28:09.231806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:56.078447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'4","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:00.704581+0000","last_change":"2024-04-23T18:28:00.704730+0000","last_active":"2024-04-23T18:28:00.704581+0000","last_peered":"2024-04-23T18:28:00.704581+0000","last_clean":"2024-04-23T18:28:00.704581+0000","last_became_active":"2024-04-23T18:22:32.386003+0000","last_became_peered":"2024-04-23T18:22:32.386003+0000","last_unstale":"2024-04-23T18:28:00.704581+0000","last_undegraded":"2024-04-23T18:28:00.704581+0000","last_fullsized":"2024-04-23T18:28:00.704581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-23T18:28:00.704374+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-23T18:28:00.704374+0000","last_clean_scrub_stamp":"2024-04-23T18:28:00.704374+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:20:23.542044+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'316","reported_seq":345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:09.409767+0000","last_change":"2024-04-23T18:28:09.409797+0000","last_active":"2024-04-23T18:28:09.409767+0000","last_peered":"2024-04-23T18:28:09.409767+0000","last_clean":"2024-04-23T18:28:09.409767+0000","last_became_active":"2024-04-23T18:22:37.710495+0000","last_became_peered":"2024-04-23T18:22:37.710495+0000","last_unstale":"2024-04-23T18:28:09.409767+0000","last_undegraded":"2024-04-23T18:28:09.409767+0000","last_fullsized":"2024-04-23T18:28:09.409767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'316","last_scrub_stamp":"2024-04-23T18:28:09.409671+0000","last_deep_scrub":"26'316","last_deep_scrub_stamp":"2024-04-23T18:28:09.409671+0000","last_clean_scrub_stamp":"2024-04-23T18:28:09.409671+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:52.830510+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:02.657383+0000","last_change":"2024-04-23T18:28:02.657409+0000","last_active":"2024-04-23T18:28:02.657383+0000","last_peered":"2024-04-23T18:28:02.657383+0000","last_clean":"2024-04-23T18:28:02.657383+0000","last_became_active":"2024-04-23T18:22:33.380132+0000","last_became_peered":"2024-04-23T18:22:33.380132+0000","last_unstale":"2024-04-23T18:28:02.657383+0000","last_undegraded":"2024-04-23T18:28:02.657383+0000","last_fullsized":"2024-04-23T18:28:02.657383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-23T18:28:02.657298+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-23T18:28:02.657298+0000","last_clean_scrub_stamp":"2024-04-23T18:28:02.657298+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:05.558299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'10","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:53.612665+0000","last_change":"2024-04-23T18:27:53.612712+0000","last_active":"2024-04-23T18:27:53.612665+0000","last_peered":"2024-04-23T18:27:53.612665+0000","last_clean":"2024-04-23T18:27:53.612665+0000","last_became_active":"2024-04-23T18:22:32.380328+0000","last_became_peered":"2024-04-23T18:22:32.380328+0000","last_unstale":"2024-04-23T18:27:53.612665+0000","last_undegraded":"2024-04-23T18:27:53.612665+0000","last_fullsized":"2024-04-23T18:27:53.612665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-23T18:27:53.612592+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-23T18:27:53.612592+0000","last_clean_scrub_stamp":"2024-04-23T18:27:53.612592+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:53.458825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'378","reported_seq":407,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:12.616986+0000","last_change":"2024-04-23T18:28:12.617050+0000","last_active":"2024-04-23T18:28:12.616986+0000","last_peered":"2024-04-23T18:28:12.616986+0000","last_clean":"2024-04-23T18:28:12.616986+0000","last_became_active":"2024-04-23T18:22:37.714401+0000","last_became_peered":"2024-04-23T18:22:37.714401+0000","last_unstale":"2024-04-23T18:28:12.616986+0000","last_undegraded":"2024-04-23T18:28:12.616986+0000","last_fullsized":"2024-04-23T18:28:12.616986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'378","last_scrub_stamp":"2024-04-23T18:28:12.616788+0000","last_deep_scrub":"26'378","last_deep_scrub_stamp":"2024-04-23T18:28:12.616788+0000","last_clean_scrub_stamp":"2024-04-23T18:28:12.616788+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:06:56.167912+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:05.258766+0000","last_change":"2024-04-23T18:28:05.258889+0000","last_active":"2024-04-23T18:28:05.258766+0000","last_peered":"2024-04-23T18:28:05.258766+0000","last_clean":"2024-04-23T18:28:05.258766+0000","last_became_active":"2024-04-23T18:22:33.382230+0000","last_became_peered":"2024-04-23T18:22:33.382230+0000","last_unstale":"2024-04-23T18:28:05.258766+0000","last_undegraded":"2024-04-23T18:28:05.258766+0000","last_fullsized":"2024-04-23T18:28:05.258766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:28:05.258540+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:28:05.258540+0000","last_clean_scrub_stamp":"2024-04-23T18:28:05.258540+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:41:21.675848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'1986","reported_seq":2023,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:56.155795+0000","last_change":"2024-04-23T18:27:56.155907+0000","last_active":"2024-04-23T18:27:56.155795+0000","last_peered":"2024-04-23T18:27:56.155795+0000","last_clean":"2024-04-23T18:27:56.155795+0000","last_became_active":"2024-04-23T18:22:32.371001+0000","last_became_peered":"2024-04-23T18:22:32.371001+0000","last_unstale":"2024-04-23T18:27:56.155795+0000","last_undegraded":"2024-04-23T18:27:56.155795+0000","last_fullsized":"2024-04-23T18:27:56.155795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1986","last_scrub_stamp":"2024-04-23T18:27:56.155633+0000","last_deep_scrub":"26'1986","last_deep_scrub_stamp":"2024-04-23T18:27:56.155633+0000","last_clean_scrub_stamp":"2024-04-23T18:27:56.155633+0000","objects_scrubbed":5,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:48.745654+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3968226,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1983,"num_write_kb":4072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'332","reported_seq":355,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:13.618517+0000","last_change":"2024-04-23T18:28:13.618644+0000","last_active":"2024-04-23T18:28:13.618517+0000","last_peered":"2024-04-23T18:28:13.618517+0000","last_clean":"2024-04-23T18:28:13.618517+0000","last_became_active":"2024-04-23T18:23:14.729264+0000","last_became_peered":"2024-04-23T18:23:14.729264+0000","last_unstale":"2024-04-23T18:28:13.618517+0000","last_undegraded":"2024-04-23T18:28:13.618517+0000","last_fullsized":"2024-04-23T18:28:13.618517+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'332","last_scrub_stamp":"2024-04-23T18:28:13.618287+0000","last_deep_scrub":"26'332","last_deep_scrub_stamp":"2024-04-23T18:28:13.618287+0000","last_clean_scrub_stamp":"2024-04-23T18:28:13.618287+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:17.715594+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"26'11","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:00.046870+0000","last_change":"2024-04-23T18:28:00.046930+0000","last_active":"2024-04-23T18:28:00.046870+0000","last_peered":"2024-04-23T18:28:00.046870+0000","last_clean":"2024-04-23T18:28:00.046870+0000","last_became_active":"2024-04-23T18:22:33.394229+0000","last_became_peered":"2024-04-23T18:22:33.394229+0000","last_unstale":"2024-04-23T18:28:00.046870+0000","last_undegraded":"2024-04-23T18:28:00.046870+0000","last_fullsized":"2024-04-23T18:28:00.046870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-23T18:28:00.046695+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-23T18:28:00.046695+0000","last_clean_scrub_stamp":"2024-04-23T18:28:00.046695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:09.858317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'12","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:58.390229+0000","last_change":"2024-04-23T18:27:58.390263+0000","last_active":"2024-04-23T18:27:58.390229+0000","last_peered":"2024-04-23T18:27:58.390229+0000","last_clean":"2024-04-23T18:27:58.390229+0000","last_became_active":"2024-04-23T18:22:32.403875+0000","last_became_peered":"2024-04-23T18:22:32.403875+0000","last_unstale":"2024-04-23T18:27:58.390229+0000","last_undegraded":"2024-04-23T18:27:58.390229+0000","last_fullsized":"2024-04-23T18:27:58.390229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-04-23T18:27:58.390151+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-04-23T18:27:58.390151+0000","last_clean_scrub_stamp":"2024-04-23T18:27:58.390151+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:48.341527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'353","reported_seq":382,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:06.182454+0000","last_change":"2024-04-23T18:28:06.182519+0000","last_active":"2024-04-23T18:28:06.182454+0000","last_peered":"2024-04-23T18:28:06.182454+0000","last_clean":"2024-04-23T18:28:06.182454+0000","last_became_active":"2024-04-23T18:22:37.427749+0000","last_became_peered":"2024-04-23T18:22:37.427749+0000","last_unstale":"2024-04-23T18:28:06.182454+0000","last_undegraded":"2024-04-23T18:28:06.182454+0000","last_fullsized":"2024-04-23T18:28:06.182454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'353","last_scrub_stamp":"2024-04-23T18:28:06.182264+0000","last_deep_scrub":"26'353","last_deep_scrub_stamp":"2024-04-23T18:28:06.182264+0000","last_clean_scrub_stamp":"2024-04-23T18:28:06.182264+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:10.169736+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:52.620338+0000","last_change":"2024-04-23T18:27:52.620358+0000","last_active":"2024-04-23T18:27:52.620338+0000","last_peered":"2024-04-23T18:27:52.620338+0000","last_clean":"2024-04-23T18:27:52.620338+0000","last_became_active":"2024-04-23T18:22:33.379424+0000","last_became_peered":"2024-04-23T18:22:33.379424+0000","last_unstale":"2024-04-23T18:27:52.620338+0000","last_undegraded":"2024-04-23T18:27:52.620338+0000","last_fullsized":"2024-04-23T18:27:52.620338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-23T18:27:52.620267+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-23T18:27:52.620267+0000","last_clean_scrub_stamp":"2024-04-23T18:27:52.620267+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:36:46.194703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'3","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:02.754064+0000","last_change":"2024-04-23T18:28:02.754213+0000","last_active":"2024-04-23T18:28:02.754064+0000","last_peered":"2024-04-23T18:28:02.754064+0000","last_clean":"2024-04-23T18:28:02.754064+0000","last_became_active":"2024-04-23T18:22:32.400246+0000","last_became_peered":"2024-04-23T18:22:32.400246+0000","last_unstale":"2024-04-23T18:28:02.754064+0000","last_undegraded":"2024-04-23T18:28:02.754064+0000","last_fullsized":"2024-04-23T18:28:02.754064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-23T18:28:02.753844+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-23T18:28:02.753844+0000","last_clean_scrub_stamp":"2024-04-23T18:28:02.753844+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:26.402363+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'344","reported_seq":373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:06.352032+0000","last_change":"2024-04-23T18:28:06.352062+0000","last_active":"2024-04-23T18:28:06.352032+0000","last_peered":"2024-04-23T18:28:06.352032+0000","last_clean":"2024-04-23T18:28:06.352032+0000","last_became_active":"2024-04-23T18:22:37.415008+0000","last_became_peered":"2024-04-23T18:22:37.415008+0000","last_unstale":"2024-04-23T18:28:06.352032+0000","last_undegraded":"2024-04-23T18:28:06.352032+0000","last_fullsized":"2024-04-23T18:28:06.352032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'344","last_scrub_stamp":"2024-04-23T18:28:06.351928+0000","last_deep_scrub":"26'344","last_deep_scrub_stamp":"2024-04-23T18:28:06.351928+0000","last_clean_scrub_stamp":"2024-04-23T18:28:06.351928+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:32:18.862560+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:10.606959+0000","last_change":"2024-04-23T18:28:10.607021+0000","last_active":"2024-04-23T18:28:10.606959+0000","last_peered":"2024-04-23T18:28:10.606959+0000","last_clean":"2024-04-23T18:28:10.606959+0000","last_became_active":"2024-04-23T18:22:33.396233+0000","last_became_peered":"2024-04-23T18:22:33.396233+0000","last_unstale":"2024-04-23T18:28:10.606959+0000","last_undegraded":"2024-04-23T18:28:10.606959+0000","last_fullsized":"2024-04-23T18:28:10.606959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-23T18:28:10.606789+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-23T18:28:10.606789+0000","last_clean_scrub_stamp":"2024-04-23T18:28:10.606789+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:55:28.405720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'6","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:00.103797+0000","last_change":"2024-04-23T18:28:00.103866+0000","last_active":"2024-04-23T18:28:00.103797+0000","last_peered":"2024-04-23T18:28:00.103797+0000","last_clean":"2024-04-23T18:28:00.103797+0000","last_became_active":"2024-04-23T18:22:32.403256+0000","last_became_peered":"2024-04-23T18:22:32.403256+0000","last_unstale":"2024-04-23T18:28:00.103797+0000","last_undegraded":"2024-04-23T18:28:00.103797+0000","last_fullsized":"2024-04-23T18:28:00.103797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:28:00.103634+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:28:00.103634+0000","last_clean_scrub_stamp":"2024-04-23T18:28:00.103634+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:45:32.991104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'379","reported_seq":408,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:10.459393+0000","last_change":"2024-04-23T18:28:10.459422+0000","last_active":"2024-04-23T18:28:10.459393+0000","last_peered":"2024-04-23T18:28:10.459393+0000","last_clean":"2024-04-23T18:28:10.459393+0000","last_became_active":"2024-04-23T18:22:37.719258+0000","last_became_peered":"2024-04-23T18:22:37.719258+0000","last_unstale":"2024-04-23T18:28:10.459393+0000","last_undegraded":"2024-04-23T18:28:10.459393+0000","last_fullsized":"2024-04-23T18:28:10.459393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'379","last_scrub_stamp":"2024-04-23T18:28:10.459297+0000","last_deep_scrub":"26'379","last_deep_scrub_stamp":"2024-04-23T18:28:10.459297+0000","last_clean_scrub_stamp":"2024-04-23T18:28:10.459297+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:41.522560+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'324","reported_seq":353,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:07.623659+0000","last_change":"2024-04-23T18:28:07.623686+0000","last_active":"2024-04-23T18:28:07.623659+0000","last_peered":"2024-04-23T18:28:07.623659+0000","last_clean":"2024-04-23T18:28:07.623659+0000","last_became_active":"2024-04-23T18:22:37.714346+0000","last_became_peered":"2024-04-23T18:22:37.714346+0000","last_unstale":"2024-04-23T18:28:07.623659+0000","last_undegraded":"2024-04-23T18:28:07.623659+0000","last_fullsized":"2024-04-23T18:28:07.623659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'324","last_scrub_stamp":"2024-04-23T18:28:07.623560+0000","last_deep_scrub":"26'324","last_deep_scrub_stamp":"2024-04-23T18:28:07.623560+0000","last_clean_scrub_stamp":"2024-04-23T18:28:07.623560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:45.608203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'11","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:00.422700+0000","last_change":"2024-04-23T18:28:00.422744+0000","last_active":"2024-04-23T18:28:00.422700+0000","last_peered":"2024-04-23T18:28:00.422700+0000","last_clean":"2024-04-23T18:28:00.422700+0000","last_became_active":"2024-04-23T18:22:33.364067+0000","last_became_peered":"2024-04-23T18:22:33.364067+0000","last_unstale":"2024-04-23T18:28:00.422700+0000","last_undegraded":"2024-04-23T18:28:00.422700+0000","last_fullsized":"2024-04-23T18:28:00.422700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-23T18:28:00.422607+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-23T18:28:00.422607+0000","last_clean_scrub_stamp":"2024-04-23T18:28:00.422607+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:45:00.254804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"24'1","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:59.722817+0000","last_change":"2024-04-23T18:27:59.722888+0000","last_active":"2024-04-23T18:27:59.722817+0000","last_peered":"2024-04-23T18:27:59.722817+0000","last_clean":"2024-04-23T18:27:59.722817+0000","last_became_active":"2024-04-23T18:22:32.382467+0000","last_became_peered":"2024-04-23T18:22:32.382467+0000","last_unstale":"2024-04-23T18:27:59.722817+0000","last_undegraded":"2024-04-23T18:27:59.722817+0000","last_fullsized":"2024-04-23T18:27:59.722817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-04-23T18:27:59.722611+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-04-23T18:27:59.722611+0000","last_clean_scrub_stamp":"2024-04-23T18:27:59.722611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:09.596131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'313","reported_seq":342,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:08.178157+0000","last_change":"2024-04-23T18:28:08.178226+0000","last_active":"2024-04-23T18:28:08.178157+0000","last_peered":"2024-04-23T18:28:08.178157+0000","last_clean":"2024-04-23T18:28:08.178157+0000","last_became_active":"2024-04-23T18:22:37.423134+0000","last_became_peered":"2024-04-23T18:22:37.423134+0000","last_unstale":"2024-04-23T18:28:08.178157+0000","last_undegraded":"2024-04-23T18:28:08.178157+0000","last_fullsized":"2024-04-23T18:28:08.178157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'313","last_scrub_stamp":"2024-04-23T18:28:08.177934+0000","last_deep_scrub":"26'313","last_deep_scrub_stamp":"2024-04-23T18:28:08.177934+0000","last_clean_scrub_stamp":"2024-04-23T18:28:08.177934+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:37:48.875623+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:02.308909+0000","last_change":"2024-04-23T18:28:02.308936+0000","last_active":"2024-04-23T18:28:02.308909+0000","last_peered":"2024-04-23T18:28:02.308909+0000","last_clean":"2024-04-23T18:28:02.308909+0000","last_became_active":"2024-04-23T18:22:33.363021+0000","last_became_peered":"2024-04-23T18:22:33.363021+0000","last_unstale":"2024-04-23T18:28:02.308909+0000","last_undegraded":"2024-04-23T18:28:02.308909+0000","last_fullsized":"2024-04-23T18:28:02.308909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:28:02.308796+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:28:02.308796+0000","last_clean_scrub_stamp":"2024-04-23T18:28:02.308796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:59.912098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:59.314527+0000","last_change":"2024-04-23T18:27:59.314553+0000","last_active":"2024-04-23T18:27:59.314527+0000","last_peered":"2024-04-23T18:27:59.314527+0000","last_clean":"2024-04-23T18:27:59.314527+0000","last_became_active":"2024-04-23T18:22:32.372166+0000","last_became_peered":"2024-04-23T18:22:32.372166+0000","last_unstale":"2024-04-23T18:27:59.314527+0000","last_undegraded":"2024-04-23T18:27:59.314527+0000","last_fullsized":"2024-04-23T18:27:59.314527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-23T18:27:59.314447+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-23T18:27:59.314447+0000","last_clean_scrub_stamp":"2024-04-23T18:27:59.314447+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:18:39.487491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'4","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:57.120176+0000","last_change":"2024-04-23T18:27:57.120241+0000","last_active":"2024-04-23T18:27:57.120176+0000","last_peered":"2024-04-23T18:27:57.120176+0000","last_clean":"2024-04-23T18:27:57.120176+0000","last_became_active":"2024-04-23T18:22:32.379916+0000","last_became_peered":"2024-04-23T18:22:32.379916+0000","last_unstale":"2024-04-23T18:27:57.120176+0000","last_undegraded":"2024-04-23T18:27:57.120176+0000","last_fullsized":"2024-04-23T18:27:57.120176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-23T18:27:57.119965+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-23T18:27:57.119965+0000","last_clean_scrub_stamp":"2024-04-23T18:27:57.119965+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:04:47.991122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:00.715205+0000","last_change":"2024-04-23T18:28:00.715249+0000","last_active":"2024-04-23T18:28:00.715205+0000","last_peered":"2024-04-23T18:28:00.715205+0000","last_clean":"2024-04-23T18:28:00.715205+0000","last_became_active":"2024-04-23T18:22:33.375484+0000","last_became_peered":"2024-04-23T18:22:33.375484+0000","last_unstale":"2024-04-23T18:28:00.715205+0000","last_undegraded":"2024-04-23T18:28:00.715205+0000","last_fullsized":"2024-04-23T18:28:00.715205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:28:00.715108+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:28:00.715108+0000","last_clean_scrub_stamp":"2024-04-23T18:28:00.715108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:58:02.935459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'338","reported_seq":367,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:59.916123+0000","last_change":"2024-04-23T18:27:59.916151+0000","last_active":"2024-04-23T18:27:59.916123+0000","last_peered":"2024-04-23T18:27:59.916123+0000","last_clean":"2024-04-23T18:27:59.916123+0000","last_became_active":"2024-04-23T18:22:37.421790+0000","last_became_peered":"2024-04-23T18:22:37.421790+0000","last_unstale":"2024-04-23T18:27:59.916123+0000","last_undegraded":"2024-04-23T18:27:59.916123+0000","last_fullsized":"2024-04-23T18:27:59.916123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'338","last_scrub_stamp":"2024-04-23T18:27:59.916017+0000","last_deep_scrub":"26'338","last_deep_scrub_stamp":"2024-04-23T18:27:59.916017+0000","last_clean_scrub_stamp":"2024-04-23T18:27:59.916017+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:39.325084+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'7","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:00.359906+0000","last_change":"2024-04-23T18:28:00.359936+0000","last_active":"2024-04-23T18:28:00.359906+0000","last_peered":"2024-04-23T18:28:00.359906+0000","last_clean":"2024-04-23T18:28:00.359906+0000","last_became_active":"2024-04-23T18:22:32.378787+0000","last_became_peered":"2024-04-23T18:22:32.378787+0000","last_unstale":"2024-04-23T18:28:00.359906+0000","last_undegraded":"2024-04-23T18:28:00.359906+0000","last_fullsized":"2024-04-23T18:28:00.359906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:28:00.359828+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:28:00.359828+0000","last_clean_scrub_stamp":"2024-04-23T18:28:00.359828+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:32:54.460518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:58.034670+0000","last_change":"2024-04-23T18:27:58.034730+0000","last_active":"2024-04-23T18:27:58.034670+0000","last_peered":"2024-04-23T18:27:58.034670+0000","last_clean":"2024-04-23T18:27:58.034670+0000","last_became_active":"2024-04-23T18:22:33.370036+0000","last_became_peered":"2024-04-23T18:22:33.370036+0000","last_unstale":"2024-04-23T18:27:58.034670+0000","last_undegraded":"2024-04-23T18:27:58.034670+0000","last_fullsized":"2024-04-23T18:27:58.034670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:27:58.034500+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:27:58.034500+0000","last_clean_scrub_stamp":"2024-04-23T18:27:58.034500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:24:31.941549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'361","reported_seq":390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:07.322901+0000","last_change":"2024-04-23T18:28:07.322951+0000","last_active":"2024-04-23T18:28:07.322901+0000","last_peered":"2024-04-23T18:28:07.322901+0000","last_clean":"2024-04-23T18:28:07.322901+0000","last_became_active":"2024-04-23T18:22:37.421166+0000","last_became_peered":"2024-04-23T18:22:37.421166+0000","last_unstale":"2024-04-23T18:28:07.322901+0000","last_undegraded":"2024-04-23T18:28:07.322901+0000","last_fullsized":"2024-04-23T18:28:07.322901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'361","last_scrub_stamp":"2024-04-23T18:28:07.322783+0000","last_deep_scrub":"26'361","last_deep_scrub_stamp":"2024-04-23T18:28:07.322783+0000","last_clean_scrub_stamp":"2024-04-23T18:28:07.322783+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:08:14.163551+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:02.131567+0000","last_change":"2024-04-23T18:28:02.131630+0000","last_active":"2024-04-23T18:28:02.131567+0000","last_peered":"2024-04-23T18:28:02.131567+0000","last_clean":"2024-04-23T18:28:02.131567+0000","last_became_active":"2024-04-23T18:22:33.372292+0000","last_became_peered":"2024-04-23T18:22:33.372292+0000","last_unstale":"2024-04-23T18:28:02.131567+0000","last_undegraded":"2024-04-23T18:28:02.131567+0000","last_fullsized":"2024-04-23T18:28:02.131567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-23T18:28:02.131394+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-23T18:28:02.131394+0000","last_clean_scrub_stamp":"2024-04-23T18:28:02.131394+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:33.344816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'12","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:58.911543+0000","last_change":"2024-04-23T18:27:58.911570+0000","last_active":"2024-04-23T18:27:58.911543+0000","last_peered":"2024-04-23T18:27:58.911543+0000","last_clean":"2024-04-23T18:27:58.911543+0000","last_became_active":"2024-04-23T18:22:33.397670+0000","last_became_peered":"2024-04-23T18:22:33.397670+0000","last_unstale":"2024-04-23T18:27:58.911543+0000","last_undegraded":"2024-04-23T18:27:58.911543+0000","last_fullsized":"2024-04-23T18:27:58.911543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2024-04-23T18:27:58.911443+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2024-04-23T18:27:58.911443+0000","last_clean_scrub_stamp":"2024-04-23T18:27:58.911443+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:47:31.371950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:04.698644+0000","last_change":"2024-04-23T18:28:04.698703+0000","last_active":"2024-04-23T18:28:04.698644+0000","last_peered":"2024-04-23T18:28:04.698644+0000","last_clean":"2024-04-23T18:28:04.698644+0000","last_became_active":"2024-04-23T18:22:33.378890+0000","last_became_peered":"2024-04-23T18:22:33.378890+0000","last_unstale":"2024-04-23T18:28:04.698644+0000","last_undegraded":"2024-04-23T18:28:04.698644+0000","last_fullsized":"2024-04-23T18:28:04.698644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:28:04.698477+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:28:04.698477+0000","last_clean_scrub_stamp":"2024-04-23T18:28:04.698477+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:25.840054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:58.648795+0000","last_change":"2024-04-23T18:27:58.648848+0000","last_active":"2024-04-23T18:27:58.648795+0000","last_peered":"2024-04-23T18:27:58.648795+0000","last_clean":"2024-04-23T18:27:58.648795+0000","last_became_active":"2024-04-23T18:22:33.366746+0000","last_became_peered":"2024-04-23T18:22:33.366746+0000","last_unstale":"2024-04-23T18:27:58.648795+0000","last_undegraded":"2024-04-23T18:27:58.648795+0000","last_fullsized":"2024-04-23T18:27:58.648795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:27:58.648715+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:27:58.648715+0000","last_clean_scrub_stamp":"2024-04-23T18:27:58.648715+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:11.248903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:54.202897+0000","last_change":"2024-04-23T18:27:54.202936+0000","last_active":"2024-04-23T18:27:54.202897+0000","last_peered":"2024-04-23T18:27:54.202897+0000","last_clean":"2024-04-23T18:27:54.202897+0000","last_became_active":"2024-04-23T18:22:33.390099+0000","last_became_peered":"2024-04-23T18:22:33.390099+0000","last_unstale":"2024-04-23T18:27:54.202897+0000","last_undegraded":"2024-04-23T18:27:54.202897+0000","last_fullsized":"2024-04-23T18:27:54.202897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-23T18:27:54.202796+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-23T18:27:54.202796+0000","last_clean_scrub_stamp":"2024-04-23T18:27:54.202796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:49.035190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:01.377448+0000","last_change":"2024-04-23T18:28:01.377475+0000","last_active":"2024-04-23T18:28:01.377448+0000","last_peered":"2024-04-23T18:28:01.377448+0000","last_clean":"2024-04-23T18:28:01.377448+0000","last_became_active":"2024-04-23T18:22:33.364467+0000","last_became_peered":"2024-04-23T18:22:33.364467+0000","last_unstale":"2024-04-23T18:28:01.377448+0000","last_undegraded":"2024-04-23T18:28:01.377448+0000","last_fullsized":"2024-04-23T18:28:01.377448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:28:01.377367+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:28:01.377367+0000","last_clean_scrub_stamp":"2024-04-23T18:28:01.377367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:33:45.669974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'15","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:03.158327+0000","last_change":"2024-04-23T18:28:03.158439+0000","last_active":"2024-04-23T18:28:03.158327+0000","last_peered":"2024-04-23T18:28:03.158327+0000","last_clean":"2024-04-23T18:28:03.158327+0000","last_became_active":"2024-04-23T18:22:33.379305+0000","last_became_peered":"2024-04-23T18:22:33.379305+0000","last_unstale":"2024-04-23T18:28:03.158327+0000","last_undegraded":"2024-04-23T18:28:03.158327+0000","last_fullsized":"2024-04-23T18:28:03.158327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'15","last_scrub_stamp":"2024-04-23T18:28:03.158048+0000","last_deep_scrub":"26'15","last_deep_scrub_stamp":"2024-04-23T18:28:03.158048+0000","last_clean_scrub_stamp":"2024-04-23T18:28:03.158048+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:53:06.260201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'2","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:57.262947+0000","last_change":"2024-04-23T18:27:57.262973+0000","last_active":"2024-04-23T18:27:57.262947+0000","last_peered":"2024-04-23T18:27:57.262947+0000","last_clean":"2024-04-23T18:27:57.262947+0000","last_became_active":"2024-04-23T18:22:33.373946+0000","last_became_peered":"2024-04-23T18:22:33.373946+0000","last_unstale":"2024-04-23T18:27:57.262947+0000","last_undegraded":"2024-04-23T18:27:57.262947+0000","last_fullsized":"2024-04-23T18:27:57.262947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-23T18:27:57.262868+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-23T18:27:57.262868+0000","last_clean_scrub_stamp":"2024-04-23T18:27:57.262868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:52.731873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:05.706146+0000","last_change":"2024-04-23T18:28:05.706262+0000","last_active":"2024-04-23T18:28:05.706146+0000","last_peered":"2024-04-23T18:28:05.706146+0000","last_clean":"2024-04-23T18:28:05.706146+0000","last_became_active":"2024-04-23T18:22:33.385556+0000","last_became_peered":"2024-04-23T18:22:33.385556+0000","last_unstale":"2024-04-23T18:28:05.706146+0000","last_undegraded":"2024-04-23T18:28:05.706146+0000","last_fullsized":"2024-04-23T18:28:05.706146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:28:05.705910+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:28:05.705910+0000","last_clean_scrub_stamp":"2024-04-23T18:28:05.705910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:01:38.338315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:05.339213+0000","last_change":"2024-04-23T18:28:05.339238+0000","last_active":"2024-04-23T18:28:05.339213+0000","last_peered":"2024-04-23T18:28:05.339213+0000","last_clean":"2024-04-23T18:28:05.339213+0000","last_became_active":"2024-04-23T18:22:33.373893+0000","last_became_peered":"2024-04-23T18:22:33.373893+0000","last_unstale":"2024-04-23T18:28:05.339213+0000","last_undegraded":"2024-04-23T18:28:05.339213+0000","last_fullsized":"2024-04-23T18:28:05.339213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:28:05.339135+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:28:05.339135+0000","last_clean_scrub_stamp":"2024-04-23T18:28:05.339135+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:41.471413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'10","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:03.994803+0000","last_change":"2024-04-23T18:28:03.994830+0000","last_active":"2024-04-23T18:28:03.994803+0000","last_peered":"2024-04-23T18:28:03.994803+0000","last_clean":"2024-04-23T18:28:03.994803+0000","last_became_active":"2024-04-23T18:23:14.787340+0000","last_became_peered":"2024-04-23T18:23:14.787340+0000","last_unstale":"2024-04-23T18:28:03.994803+0000","last_undegraded":"2024-04-23T18:28:03.994803+0000","last_fullsized":"2024-04-23T18:28:03.994803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-23T18:28:03.994722+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-23T18:28:03.994722+0000","last_clean_scrub_stamp":"2024-04-23T18:28:03.994722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:35.421774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"26'11","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:03.668958+0000","last_change":"2024-04-23T18:28:03.668982+0000","last_active":"2024-04-23T18:28:03.668958+0000","last_peered":"2024-04-23T18:28:03.668958+0000","last_clean":"2024-04-23T18:28:03.668958+0000","last_became_active":"2024-04-23T18:22:33.382292+0000","last_became_peered":"2024-04-23T18:22:33.382292+0000","last_unstale":"2024-04-23T18:28:03.668958+0000","last_undegraded":"2024-04-23T18:28:03.668958+0000","last_fullsized":"2024-04-23T18:28:03.668958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-23T18:28:03.668877+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-23T18:28:03.668877+0000","last_clean_scrub_stamp":"2024-04-23T18:28:03.668877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:05:01.159462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:07.129083+0000","last_change":"2024-04-23T18:28:07.129142+0000","last_active":"2024-04-23T18:28:07.129083+0000","last_peered":"2024-04-23T18:28:07.129083+0000","last_clean":"2024-04-23T18:28:07.129083+0000","last_became_active":"2024-04-23T18:22:33.400874+0000","last_became_peered":"2024-04-23T18:22:33.400874+0000","last_unstale":"2024-04-23T18:28:07.129083+0000","last_undegraded":"2024-04-23T18:28:07.129083+0000","last_fullsized":"2024-04-23T18:28:07.129083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:28:07.128887+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:28:07.128887+0000","last_clean_scrub_stamp":"2024-04-23T18:28:07.128887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:07.546793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:06.217605+0000","last_change":"2024-04-23T18:28:06.217670+0000","last_active":"2024-04-23T18:28:06.217605+0000","last_peered":"2024-04-23T18:28:06.217605+0000","last_clean":"2024-04-23T18:28:06.217605+0000","last_became_active":"2024-04-23T18:22:33.381860+0000","last_became_peered":"2024-04-23T18:22:33.381860+0000","last_unstale":"2024-04-23T18:28:06.217605+0000","last_undegraded":"2024-04-23T18:28:06.217605+0000","last_fullsized":"2024-04-23T18:28:06.217605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:28:06.217409+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:28:06.217409+0000","last_clean_scrub_stamp":"2024-04-23T18:28:06.217409+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:31:50.216837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:57.955599+0000","last_change":"2024-04-23T18:27:57.955623+0000","last_active":"2024-04-23T18:27:57.955599+0000","last_peered":"2024-04-23T18:27:57.955599+0000","last_clean":"2024-04-23T18:27:57.955599+0000","last_became_active":"2024-04-23T18:22:33.376503+0000","last_became_peered":"2024-04-23T18:22:33.376503+0000","last_unstale":"2024-04-23T18:27:57.955599+0000","last_undegraded":"2024-04-23T18:27:57.955599+0000","last_fullsized":"2024-04-23T18:27:57.955599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-23T18:27:57.955507+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-23T18:27:57.955507+0000","last_clean_scrub_stamp":"2024-04-23T18:27:57.955507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:40:42.274522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:09.617099+0000","last_change":"2024-04-23T18:28:09.617223+0000","last_active":"2024-04-23T18:28:09.617099+0000","last_peered":"2024-04-23T18:28:09.617099+0000","last_clean":"2024-04-23T18:28:09.617099+0000","last_became_active":"2024-04-23T18:22:33.396146+0000","last_became_peered":"2024-04-23T18:22:33.396146+0000","last_unstale":"2024-04-23T18:28:09.617099+0000","last_undegraded":"2024-04-23T18:28:09.617099+0000","last_fullsized":"2024-04-23T18:28:09.617099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:28:09.616858+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:28:09.616858+0000","last_clean_scrub_stamp":"2024-04-23T18:28:09.616858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:39:30.776259+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'9","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:03.731596+0000","last_change":"2024-04-23T18:28:03.731661+0000","last_active":"2024-04-23T18:28:03.731596+0000","last_peered":"2024-04-23T18:28:03.731596+0000","last_clean":"2024-04-23T18:28:03.731596+0000","last_became_active":"2024-04-23T18:22:33.377292+0000","last_became_peered":"2024-04-23T18:22:33.377292+0000","last_unstale":"2024-04-23T18:28:03.731596+0000","last_undegraded":"2024-04-23T18:28:03.731596+0000","last_fullsized":"2024-04-23T18:28:03.731596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-23T18:28:03.731399+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-23T18:28:03.731399+0000","last_clean_scrub_stamp":"2024-04-23T18:28:03.731399+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:30:35.387230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:04.405023+0000","last_change":"2024-04-23T18:28:04.405048+0000","last_active":"2024-04-23T18:28:04.405023+0000","last_peered":"2024-04-23T18:28:04.405023+0000","last_clean":"2024-04-23T18:28:04.405023+0000","last_became_active":"2024-04-23T18:22:33.374133+0000","last_became_peered":"2024-04-23T18:22:33.374133+0000","last_unstale":"2024-04-23T18:28:04.405023+0000","last_undegraded":"2024-04-23T18:28:04.405023+0000","last_fullsized":"2024-04-23T18:28:04.405023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:28:04.404938+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:28:04.404938+0000","last_clean_scrub_stamp":"2024-04-23T18:28:04.404938+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:00.223477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:55.588478+0000","last_change":"2024-04-23T18:27:55.588499+0000","last_active":"2024-04-23T18:27:55.588478+0000","last_peered":"2024-04-23T18:27:55.588478+0000","last_clean":"2024-04-23T18:27:55.588478+0000","last_became_active":"2024-04-23T18:22:33.358779+0000","last_became_peered":"2024-04-23T18:22:33.358779+0000","last_unstale":"2024-04-23T18:27:55.588478+0000","last_undegraded":"2024-04-23T18:27:55.588478+0000","last_fullsized":"2024-04-23T18:27:55.588478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:27:55.588413+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:27:55.588413+0000","last_clean_scrub_stamp":"2024-04-23T18:27:55.588413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:54:49.673364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'10","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:04.323506+0000","last_change":"2024-04-23T18:28:04.323530+0000","last_active":"2024-04-23T18:28:04.323506+0000","last_peered":"2024-04-23T18:28:04.323506+0000","last_clean":"2024-04-23T18:28:04.323506+0000","last_became_active":"2024-04-23T18:22:33.372918+0000","last_became_peered":"2024-04-23T18:22:33.372918+0000","last_unstale":"2024-04-23T18:28:04.323506+0000","last_undegraded":"2024-04-23T18:28:04.323506+0000","last_fullsized":"2024-04-23T18:28:04.323506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2024-04-23T18:28:04.323419+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2024-04-23T18:28:04.323419+0000","last_clean_scrub_stamp":"2024-04-23T18:28:04.323419+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:37.892090+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:59.040661+0000","last_change":"2024-04-23T18:27:59.040719+0000","last_active":"2024-04-23T18:27:59.040661+0000","last_peered":"2024-04-23T18:27:59.040661+0000","last_clean":"2024-04-23T18:27:59.040661+0000","last_became_active":"2024-04-23T18:22:33.390325+0000","last_became_peered":"2024-04-23T18:22:33.390325+0000","last_unstale":"2024-04-23T18:27:59.040661+0000","last_undegraded":"2024-04-23T18:27:59.040661+0000","last_fullsized":"2024-04-23T18:27:59.040661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:27:59.040485+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:27:59.040485+0000","last_clean_scrub_stamp":"2024-04-23T18:27:59.040485+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:15:09.501723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:06.173398+0000","last_change":"2024-04-23T18:28:06.173516+0000","last_active":"2024-04-23T18:28:06.173398+0000","last_peered":"2024-04-23T18:28:06.173398+0000","last_clean":"2024-04-23T18:28:06.173398+0000","last_became_active":"2024-04-23T18:22:33.397949+0000","last_became_peered":"2024-04-23T18:22:33.397949+0000","last_unstale":"2024-04-23T18:28:06.173398+0000","last_undegraded":"2024-04-23T18:28:06.173398+0000","last_fullsized":"2024-04-23T18:28:06.173398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:28:06.173165+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:28:06.173165+0000","last_clean_scrub_stamp":"2024-04-23T18:28:06.173165+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:13:27.271338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'16","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:05.135353+0000","last_change":"2024-04-23T18:28:05.135423+0000","last_active":"2024-04-23T18:28:05.135353+0000","last_peered":"2024-04-23T18:28:05.135353+0000","last_clean":"2024-04-23T18:28:05.135353+0000","last_became_active":"2024-04-23T18:22:33.393673+0000","last_became_peered":"2024-04-23T18:22:33.393673+0000","last_unstale":"2024-04-23T18:28:05.135353+0000","last_undegraded":"2024-04-23T18:28:05.135353+0000","last_fullsized":"2024-04-23T18:28:05.135353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2024-04-23T18:28:05.135155+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2024-04-23T18:28:05.135155+0000","last_clean_scrub_stamp":"2024-04-23T18:28:05.135155+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:44:08.172114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'11","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:12.306247+0000","last_change":"2024-04-23T18:28:12.306315+0000","last_active":"2024-04-23T18:28:12.306247+0000","last_peered":"2024-04-23T18:28:12.306247+0000","last_clean":"2024-04-23T18:28:12.306247+0000","last_became_active":"2024-04-23T18:22:33.404447+0000","last_became_peered":"2024-04-23T18:22:33.404447+0000","last_unstale":"2024-04-23T18:28:12.306247+0000","last_undegraded":"2024-04-23T18:28:12.306247+0000","last_fullsized":"2024-04-23T18:28:12.306247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-23T18:28:12.306060+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-23T18:28:12.306060+0000","last_clean_scrub_stamp":"2024-04-23T18:28:12.306060+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:30.739698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'9","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:13.479977+0000","last_change":"2024-04-23T18:28:13.480025+0000","last_active":"2024-04-23T18:28:13.479977+0000","last_peered":"2024-04-23T18:28:13.479977+0000","last_clean":"2024-04-23T18:28:13.479977+0000","last_became_active":"2024-04-23T18:23:14.787444+0000","last_became_peered":"2024-04-23T18:23:14.787444+0000","last_unstale":"2024-04-23T18:28:13.479977+0000","last_undegraded":"2024-04-23T18:28:13.479977+0000","last_fullsized":"2024-04-23T18:28:13.479977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-23T18:28:13.479861+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-23T18:28:13.479861+0000","last_clean_scrub_stamp":"2024-04-23T18:28:13.479861+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:26:07.048362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'5","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:56.215934+0000","last_change":"2024-04-23T18:27:56.215995+0000","last_active":"2024-04-23T18:27:56.215934+0000","last_peered":"2024-04-23T18:27:56.215934+0000","last_clean":"2024-04-23T18:27:56.215934+0000","last_became_active":"2024-04-23T18:22:33.380874+0000","last_became_peered":"2024-04-23T18:22:33.380874+0000","last_unstale":"2024-04-23T18:27:56.215934+0000","last_undegraded":"2024-04-23T18:27:56.215934+0000","last_fullsized":"2024-04-23T18:27:56.215934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-23T18:27:56.215759+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-23T18:27:56.215759+0000","last_clean_scrub_stamp":"2024-04-23T18:27:56.215759+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:37:21.288474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'6","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:57.693590+0000","last_change":"2024-04-23T18:27:57.693712+0000","last_active":"2024-04-23T18:27:57.693590+0000","last_peered":"2024-04-23T18:27:57.693590+0000","last_clean":"2024-04-23T18:27:57.693590+0000","last_became_active":"2024-04-23T18:22:33.379836+0000","last_became_peered":"2024-04-23T18:22:33.379836+0000","last_unstale":"2024-04-23T18:27:57.693590+0000","last_undegraded":"2024-04-23T18:27:57.693590+0000","last_fullsized":"2024-04-23T18:27:57.693590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-23T18:27:57.693296+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-23T18:27:57.693296+0000","last_clean_scrub_stamp":"2024-04-23T18:27:57.693296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:58:45.402198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:04.308815+0000","last_change":"2024-04-23T18:28:04.308873+0000","last_active":"2024-04-23T18:28:04.308815+0000","last_peered":"2024-04-23T18:28:04.308815+0000","last_clean":"2024-04-23T18:28:04.308815+0000","last_became_active":"2024-04-23T18:22:33.381095+0000","last_became_peered":"2024-04-23T18:22:33.381095+0000","last_unstale":"2024-04-23T18:28:04.308815+0000","last_undegraded":"2024-04-23T18:28:04.308815+0000","last_fullsized":"2024-04-23T18:28:04.308815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-23T18:28:04.308644+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-23T18:28:04.308644+0000","last_clean_scrub_stamp":"2024-04-23T18:28:04.308644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:26.877467+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:56.721391+0000","last_change":"2024-04-23T18:27:56.721456+0000","last_active":"2024-04-23T18:27:56.721391+0000","last_peered":"2024-04-23T18:27:56.721391+0000","last_clean":"2024-04-23T18:27:56.721391+0000","last_became_active":"2024-04-23T18:22:33.385863+0000","last_became_peered":"2024-04-23T18:22:33.385863+0000","last_unstale":"2024-04-23T18:27:56.721391+0000","last_undegraded":"2024-04-23T18:27:56.721391+0000","last_fullsized":"2024-04-23T18:27:56.721391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:27:56.721209+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:27:56.721209+0000","last_clean_scrub_stamp":"2024-04-23T18:27:56.721209+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:25.120066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'7","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:57.655996+0000","last_change":"2024-04-23T18:27:57.656023+0000","last_active":"2024-04-23T18:27:57.655996+0000","last_peered":"2024-04-23T18:27:57.655996+0000","last_clean":"2024-04-23T18:27:57.655996+0000","last_became_active":"2024-04-23T18:22:33.366610+0000","last_became_peered":"2024-04-23T18:22:33.366610+0000","last_unstale":"2024-04-23T18:27:57.655996+0000","last_undegraded":"2024-04-23T18:27:57.655996+0000","last_fullsized":"2024-04-23T18:27:57.655996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-23T18:27:57.655911+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-23T18:27:57.655911+0000","last_clean_scrub_stamp":"2024-04-23T18:27:57.655911+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:29:56.980373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'4","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:27:59.434665+0000","last_change":"2024-04-23T18:27:59.434688+0000","last_active":"2024-04-23T18:27:59.434665+0000","last_peered":"2024-04-23T18:27:59.434665+0000","last_clean":"2024-04-23T18:27:59.434665+0000","last_became_active":"2024-04-23T18:22:33.363062+0000","last_became_peered":"2024-04-23T18:22:33.363062+0000","last_unstale":"2024-04-23T18:27:59.434665+0000","last_undegraded":"2024-04-23T18:27:59.434665+0000","last_fullsized":"2024-04-23T18:27:59.434665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-23T18:27:59.434581+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-23T18:27:59.434581+0000","last_clean_scrub_stamp":"2024-04-23T18:27:59.434581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:24.013099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'8","reported_seq":43,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T18:28:07.234801+0000","last_change":"2024-04-23T18:28:07.234862+0000","last_active":"2024-04-23T18:28:07.234801+0000","last_peered":"2024-04-23T18:28:07.234801+0000","last_clean":"2024-04-23T18:28:07.234801+0000","last_became_active":"2024-04-23T18:22:33.384032+0000","last_became_peered":"2024-04-23T18:22:33.384032+0000","last_unstale":"2024-04-23T18:28:07.234801+0000","last_undegraded":"2024-04-23T18:28:07.234801+0000","last_fullsized":"2024-04-23T18:28:07.234801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-23T18:28:07.234623+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-23T18:28:07.234623+0000","last_clean_scrub_stamp":"2024-04-23T18:28:07.234623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:47:15.270491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10755,"ondisk_log_size":10755,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3972764,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2161,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8101888,"data_stored":7945528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2183,"ondisk_log_size":2183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45936,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325904,"statfs":{"total":96636764160,"available":96589725696,"internally_reserved":0,"allocated":892928,"data_stored":706045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79692,"kb_used_data":4164,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94292148,"statfs":{"total":96636764160,"available":96555159552,"internally_reserved":0,"allocated":4263936,"data_stored":4083664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57836,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94314004,"statfs":{"total":96636764160,"available":96577540096,"internally_reserved":0,"allocated":299008,"data_stored":115739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49512,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":294912,"data_stored":115474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89428,"kb_used_data":4172,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94282412,"statfs":{"total":96636764160,"available":96545189888,"internally_reserved":0,"allocated":4272128,"data_stored":4083828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57840,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94314000,"statfs":{"total":96636764160,"available":96577536000,"internally_reserved":0,"allocated":303104,"data_stored":115708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75824,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94296016,"statfs":{"total":96636764160,"available":96559120384,"internally_reserved":0,"allocated":303104,"data_stored":115305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45932,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325908,"statfs":{"total":96636764160,"available":96589729792,"internally_reserved":0,"allocated":888832,"data_stored":705389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3993600,"data_stored":3969467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3985408,"data_stored":3969303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:28:16.898 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-23T18:28:17.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.077+0000 7fbbf6600640 1 Processor -- start 2024-04-23T18:28:17.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.077+0000 7fbbf6600640 1 -- start start 2024-04-23T18:28:17.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbf6600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbbf00c71e0 0x7fbbf0071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbf6600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbf00c75c0 0x7fbbf015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbf6600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbf0071c60 con 0x7fbbf015f2c0 2024-04-23T18:28:17.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbf6600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fbbf015bd50 con 0x7fbbf00c71e0 2024-04-23T18:28:17.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbf6600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf015e8f0 con 0x7fbbf00c75c0 2024-04-23T18:28:17.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbef400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbbf00c71e0 0x7fbbf0071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbefe00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbbf015f2c0 0x7fbbf006d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43476/0 (socket says 172.21.15.28:43476) 2024-04-23T18:28:17.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbefe00640 1 -- 172.21.15.28:0/2132578216 learned_addr learned my addr 172.21.15.28:0/2132578216 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:28:17.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbe6a00640 1 --2- 172.21.15.28:0/2132578216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbf00c75c0 0x7fbbf015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbef400640 1 -- 172.21.15.28:0/2132578216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbf00c75c0 msgr2=0x7fbbf015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:17.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbef400640 1 --2- 172.21.15.28:0/2132578216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbf00c75c0 0x7fbbf015ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbef400640 1 -- 172.21.15.28:0/2132578216 >> v1:172.21.15.28:6789/0 conn(0x7fbbf015f2c0 legacy=0x7fbbf006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.081+0000 7fbbef400640 1 -- 172.21.15.28:0/2132578216 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf015bf90 con 0x7fbbf00c71e0 2024-04-23T18:28:17.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbef400640 1 --2- 172.21.15.28:0/2132578216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbf00c71e0 0x7fbbf0071720 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00097c0 tx=0x7fbbe001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168fb3ae8e7c94bc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:17.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbeea00640 1 -- 172.21.15.28:0/2132578216 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00b0070 con 0x7fbbf00c71e0 2024-04-23T18:28:17.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbeea00640 1 -- 172.21.15.28:0/2132578216 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe00ab600 con 0x7fbbf00c71e0 2024-04-23T18:28:17.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbeea00640 1 -- 172.21.15.28:0/2132578216 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00ab9d0 con 0x7fbbf00c71e0 2024-04-23T18:28:17.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 -- 172.21.15.28:0/2132578216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbf00c71e0 msgr2=0x7fbbf0071720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 --2- 172.21.15.28:0/2132578216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbf00c71e0 0x7fbbf0071720 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00097c0 tx=0x7fbbe001c4a0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 -- 172.21.15.28:0/2132578216 shutdown_connections 2024-04-23T18:28:17.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 --2- 172.21.15.28:0/2132578216 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbf00c75c0 0x7fbbf015ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 --2- 172.21.15.28:0/2132578216 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbf00c71e0 0x7fbbf0071720 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 -- 172.21.15.28:0/2132578216 >> 172.21.15.28:0/2132578216 conn(0x7fbbf006c1d0 msgr2=0x7fbbf00cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:17.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 -- 172.21.15.28:0/2132578216 shutdown_connections 2024-04-23T18:28:17.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 -- 172.21.15.28:0/2132578216 wait complete. 2024-04-23T18:28:17.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 Processor -- start 2024-04-23T18:28:17.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 -- start start 2024-04-23T18:28:17.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbf00c71e0 0x7fbbf015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbf00c75c0 0x7fbbf01431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf015f2c0 0x7fbbf01f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf015c270 con 0x7fbbf00c75c0 2024-04-23T18:28:17.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01447e0 con 0x7fbbf015f2c0 2024-04-23T18:28:17.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbf6600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf0167c90 con 0x7fbbf00c71e0 2024-04-23T18:28:17.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbe6a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbf00c75c0 0x7fbbf01431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbe6a00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbf00c75c0 0x7fbbf01431d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41980/0 (socket says 172.21.15.28:41980) 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbe6a00640 1 -- 172.21.15.28:0/1810871358 learned_addr learned my addr 172.21.15.28:0/1810871358 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbefe00640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf015f2c0 0x7fbbf01f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.085+0000 7fbbef400640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbf00c71e0 0x7fbbf015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe6a00640 1 -- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbf00c71e0 msgr2=0x7fbbf015fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe6a00640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbf00c71e0 0x7fbbf015fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe6a00640 1 -- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf015f2c0 msgr2=0x7fbbf01f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe6a00640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf015f2c0 0x7fbbf01f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe6a00640 1 -- 172.21.15.28:0/1810871358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf015a2f0 con 0x7fbbf00c75c0 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbefe00640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf015f2c0 0x7fbbf01f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe6a00640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbf00c75c0 0x7fbbf01431d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800d830 tx=0x7fbbd800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe7e00640 1 -- 172.21.15.28:0/1810871358 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800b6c0 con 0x7fbbf00c75c0 2024-04-23T18:28:17.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe7e00640 1 -- 172.21.15.28:0/1810871358 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd8019070 con 0x7fbbf00c75c0 2024-04-23T18:28:17.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe7e00640 1 -- 172.21.15.28:0/1810871358 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800ba60 con 0x7fbbf00c75c0 2024-04-23T18:28:17.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbf6600640 1 -- 172.21.15.28:0/1810871358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf015b880 con 0x7fbbf00c75c0 2024-04-23T18:28:17.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbf6600640 1 -- 172.21.15.28:0/1810871358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf015b2c0 con 0x7fbbf00c75c0 2024-04-23T18:28:17.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbf6600640 1 -- 172.21.15.28:0/1810871358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf0068db0 con 0x7fbbf00c75c0 2024-04-23T18:28:17.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe7e00640 1 -- 172.21.15.28:0/1810871358 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbbd801e460 con 0x7fbbf00c75c0 2024-04-23T18:28:17.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe7e00640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 0x7fbbcc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.089+0000 7fbbe7e00640 1 -- 172.21.15.28:0/1810871358 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fbbd8087480 con 0x7fbbf00c75c0 2024-04-23T18:28:17.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.093+0000 7fbbef400640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 0x7fbbcc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.093+0000 7fbbef400640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 0x7fbbcc06a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00ad000 tx=0x7fbbe0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:17.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.097+0000 7fbbe7e00640 1 -- 172.21.15.28:0/1810871358 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbbd80575a0 con 0x7fbbf00c75c0 2024-04-23T18:28:17.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.261+0000 7fbbf6600640 1 -- 172.21.15.28:0/1810871358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbbf00cbd30 con 0x7fbbf00c75c0 2024-04-23T18:28:17.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.261+0000 7fbbe7e00640 1 -- 172.21.15.28:0/1810871358 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fbbd8056ea0 con 0x7fbbf00c75c0 2024-04-23T18:28:17.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbe7e00640 1 -- 172.21.15.28:0/1810871358 <== mon.0 v2:172.21.15.28:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbbd805b250 con 0x7fbbf00c75c0 2024-04-23T18:28:17.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 -- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 msgr2=0x7fbbcc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 0x7fbbcc06a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00ad000 tx=0x7fbbe0008040 comp rx=0 tx=0).stop 2024-04-23T18:28:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 -- 172.21.15.28:0/1810871358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbf00c75c0 msgr2=0x7fbbf01431d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbf00c75c0 0x7fbbf01431d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800d830 tx=0x7fbbd800dcf0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 -- 172.21.15.28:0/1810871358 shutdown_connections 2024-04-23T18:28:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fbbcc068380 0x7fbbcc06a840 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf015f2c0 0x7fbbf01f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbbf00c75c0 0x7fbbf01431d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 --2- 172.21.15.28:0/1810871358 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbbf00c71e0 0x7fbbf015fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 -- 172.21.15.28:0/1810871358 >> 172.21.15.28:0/1810871358 conn(0x7fbbf006c1d0 msgr2=0x7fbbf00c4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 -- 172.21.15.28:0/1810871358 shutdown_connections 2024-04-23T18:28:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.265+0000 7fbbf6600640 1 -- 172.21.15.28:0/1810871358 wait complete. 2024-04-23T18:28:17.279 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-23T18:28:17.279 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:28:17.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ace200640 1 Processor -- start 2024-04-23T18:28:17.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ace200640 1 -- start start 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ace200640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5ac806bc40 0x7f5ac815b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ace200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5ac806c020 0x7f5ac8144070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ace200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac8073250 con 0x7f5ac806c480 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ace200640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac80707e0 con 0x7f5ac806bc40 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ace200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac8073530 con 0x7f5ac806c020 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ac7400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5ac806bc40 0x7f5ac815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ac7400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5ac806bc40 0x7f5ac815b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41990/0 (socket says 172.21.15.28:41990) 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ac7400640 1 -- 172.21.15.28:0/3284679195 learned_addr learned my addr 172.21.15.28:0/3284679195 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5abea00640 1 --2- 172.21.15.28:0/3284679195 >> v2:172.21.15.137:3300/0 conn(0x7f5ac806c020 0x7f5ac8144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ac7400640 1 -- 172.21.15.28:0/3284679195 >> v2:172.21.15.137:3300/0 conn(0x7f5ac806c020 msgr2=0x7f5ac8144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ac7400640 1 --2- 172.21.15.28:0/3284679195 >> v2:172.21.15.137:3300/0 conn(0x7f5ac806c020 0x7f5ac8144070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ac7400640 1 -- 172.21.15.28:0/3284679195 >> v1:172.21.15.137:6789/0 conn(0x7f5ac806c480 legacy=0x7f5ac8070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.429+0000 7f5ac7400640 1 -- 172.21.15.28:0/3284679195 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac8073810 con 0x7f5ac806bc40 2024-04-23T18:28:17.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ac7400640 1 --2- 172.21.15.28:0/3284679195 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ac806bc40 0x7f5ac815b080 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5ac815c210 tx=0x7f5ab801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7629863367e64af server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:17.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ac6a00640 1 -- 172.21.15.28:0/3284679195 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80ab660 con 0x7f5ac806bc40 2024-04-23T18:28:17.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ac6a00640 1 -- 172.21.15.28:0/3284679195 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5ab80b0070 con 0x7f5ac806bc40 2024-04-23T18:28:17.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ac6a00640 1 -- 172.21.15.28:0/3284679195 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80aba40 con 0x7f5ac806bc40 2024-04-23T18:28:17.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ace200640 1 -- 172.21.15.28:0/3284679195 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ac806bc40 msgr2=0x7f5ac815b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ace200640 1 --2- 172.21.15.28:0/3284679195 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ac806bc40 0x7f5ac815b080 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5ac815c210 tx=0x7f5ab801c460 comp rx=0 tx=0).stop 2024-04-23T18:28:17.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ace200640 1 -- 172.21.15.28:0/3284679195 shutdown_connections 2024-04-23T18:28:17.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ace200640 1 --2- 172.21.15.28:0/3284679195 >> v2:172.21.15.137:3300/0 conn(0x7f5ac806c020 0x7f5ac8144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ace200640 1 --2- 172.21.15.28:0/3284679195 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ac806bc40 0x7f5ac815b080 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ace200640 1 -- 172.21.15.28:0/3284679195 >> 172.21.15.28:0/3284679195 conn(0x7f5ac80ce7e0 msgr2=0x7f5ac80cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:17.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ace200640 1 -- 172.21.15.28:0/3284679195 shutdown_connections 2024-04-23T18:28:17.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.433+0000 7f5ace200640 1 -- 172.21.15.28:0/3284679195 wait complete. 2024-04-23T18:28:17.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ace200640 1 Processor -- start 2024-04-23T18:28:17.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ace200640 1 -- start start 2024-04-23T18:28:17.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ace200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac806bc40 0x7f5ac81f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ace200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ac806c020 0x7f5ac815e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ace200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ac80c8d60 0x7f5ac80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ace200640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac80c9c90 con 0x7f5ac80c8d60 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ace200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac80c9b10 con 0x7f5ac806bc40 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ace200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac8168220 con 0x7f5ac806c020 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ac7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ac80c8d60 0x7f5ac80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ac7e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ac80c8d60 0x7f5ac80c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41996/0 (socket says 172.21.15.28:41996) 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ac7e00640 1 -- 172.21.15.28:0/3130725378 learned_addr learned my addr 172.21.15.28:0/3130725378 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5abea00640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ac806c020 0x7f5ac815e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ac7400640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac806bc40 0x7f5ac81f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ac7e00640 1 -- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ac806c020 msgr2=0x7f5ac815e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ac7e00640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ac806c020 0x7f5ac815e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ac7e00640 1 -- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac806bc40 msgr2=0x7f5ac81f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ac7e00640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac806bc40 0x7f5ac81f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ac7e00640 1 -- 172.21.15.28:0/3130725378 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac81f46f0 con 0x7f5ac80c8d60 2024-04-23T18:28:17.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ac7400640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac806bc40 0x7f5ac81f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:28:17.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5abea00640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ac806c020 0x7f5ac815e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:28:17.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ac7e00640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ac80c8d60 0x7f5ac80c6310 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000c7d0 tx=0x7f5ac000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:17.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5abfe00640 1 -- 172.21.15.28:0/3130725378 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0003b80 con 0x7f5ac80c8d60 2024-04-23T18:28:17.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5abfe00640 1 -- 172.21.15.28:0/3130725378 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5ac0003d20 con 0x7f5ac80c8d60 2024-04-23T18:28:17.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5abfe00640 1 -- 172.21.15.28:0/3130725378 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac000aa50 con 0x7f5ac80c8d60 2024-04-23T18:28:17.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ace200640 1 -- 172.21.15.28:0/3130725378 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac81f49b0 con 0x7f5ac80c8d60 2024-04-23T18:28:17.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.437+0000 7f5ace200640 1 -- 172.21.15.28:0/3130725378 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac81f4f70 con 0x7f5ac80c8d60 2024-04-23T18:28:17.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.441+0000 7f5ace200640 1 -- 172.21.15.28:0/3130725378 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac8068cd0 con 0x7f5ac80c8d60 2024-04-23T18:28:17.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.441+0000 7f5abfe00640 1 -- 172.21.15.28:0/3130725378 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ac000abf0 con 0x7f5ac80c8d60 2024-04-23T18:28:17.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.441+0000 7f5abfe00640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5aa40683b0 0x7f5aa406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.441+0000 7f5abfe00640 1 -- 172.21.15.28:0/3130725378 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f5ac0086d90 con 0x7f5ac80c8d60 2024-04-23T18:28:17.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.441+0000 7f5ac7400640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5aa40683b0 0x7f5aa406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.441+0000 7f5ac7400640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5aa40683b0 0x7f5aa406a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80af000 tx=0x7f5ab80a7000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:17.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.445+0000 7f5abfe00640 1 -- 172.21.15.28:0/3130725378 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ac0056e20 con 0x7f5ac80c8d60 2024-04-23T18:28:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.645+0000 7f5ace200640 1 -- 172.21.15.28:0/3130725378 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ac80cb0c0 con 0x7f5ac80c8d60 2024-04-23T18:28:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.645+0000 7f5abfe00640 1 -- 172.21.15.28:0/3130725378 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f5ac0056720 con 0x7f5ac80c8d60 2024-04-23T18:28:17.641 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:28:17.642 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:28:17.642 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:28:17.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 -- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5aa40683b0 msgr2=0x7f5aa406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5aa40683b0 0x7f5aa406a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80af000 tx=0x7f5ab80a7000 comp rx=0 tx=0).stop 2024-04-23T18:28:17.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 -- 172.21.15.28:0/3130725378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ac80c8d60 msgr2=0x7f5ac80c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ac80c8d60 0x7f5ac80c6310 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000c7d0 tx=0x7f5ac000cc90 comp rx=0 tx=0).stop 2024-04-23T18:28:17.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 -- 172.21.15.28:0/3130725378 shutdown_connections 2024-04-23T18:28:17.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f5aa40683b0 0x7f5aa406a870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5ac806c020 0x7f5ac815e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5ac80c8d60 0x7f5ac80c6310 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 --2- 172.21.15.28:0/3130725378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac806bc40 0x7f5ac81f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 -- 172.21.15.28:0/3130725378 >> 172.21.15.28:0/3130725378 conn(0x7f5ac80ce7e0 msgr2=0x7f5ac80cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:17.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 -- 172.21.15.28:0/3130725378 shutdown_connections 2024-04-23T18:28:17.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.649+0000 7f5ace200640 1 -- 172.21.15.28:0/3130725378 wait complete. 2024-04-23T18:28:17.663 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T18:28:17.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.809+0000 7fe950600640 1 Processor -- start 2024-04-23T18:28:17.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.809+0000 7fe950600640 1 -- start start 2024-04-23T18:28:17.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.809+0000 7fe950600640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe9481531a0 0x7fe9480c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.809+0000 7fe950600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9480c9a00 0x7fe948158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.809+0000 7fe950600640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9480c3bc0 con 0x7fe9480c9e40 2024-04-23T18:28:17.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.809+0000 7fe950600640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7fe9480c4940 con 0x7fe9481531a0 2024-04-23T18:28:17.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.809+0000 7fe950600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe9480c6790 con 0x7fe9480c9a00 2024-04-23T18:28:17.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.809+0000 7fe94dc00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe9481531a0 0x7fe9480c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.809+0000 7fe94e600640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe9480c9e40 0x7fe948072f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43480/0 (socket says 172.21.15.28:43480) 2024-04-23T18:28:17.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.813+0000 7fe94e600640 1 -- 172.21.15.28:0/3542828253 learned_addr learned my addr 172.21.15.28:0/3542828253 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:28:17.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.813+0000 7fe94d200640 1 --2- 172.21.15.28:0/3542828253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9480c9a00 0x7fe948158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.813+0000 7fe94dc00640 1 -- 172.21.15.28:0/3542828253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9480c9a00 msgr2=0x7fe948158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:17.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.813+0000 7fe94dc00640 1 --2- 172.21.15.28:0/3542828253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9480c9a00 0x7fe948158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.813+0000 7fe94dc00640 1 -- 172.21.15.28:0/3542828253 >> v1:172.21.15.28:6789/0 conn(0x7fe9480c9e40 legacy=0x7fe948072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.813+0000 7fe947e00640 1 -- 172.21.15.28:0/3542828253 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2232004782 0 0) 0x7fe9480c3bc0 con 0x7fe9480c9e40 2024-04-23T18:28:17.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.813+0000 7fe94dc00640 1 -- 172.21.15.28:0/3542828253 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9480c6a70 con 0x7fe9481531a0 2024-04-23T18:28:17.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.813+0000 7fe94dc00640 1 --2- 172.21.15.28:0/3542828253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9481531a0 0x7fe9480c5ec0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0097c0 tx=0x7fe93c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac666da33fb8d825 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:17.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.813+0000 7fe947e00640 1 -- 172.21.15.28:0/3542828253 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0b5070 con 0x7fe9481531a0 2024-04-23T18:28:17.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.813+0000 7fe947e00640 1 -- 172.21.15.28:0/3542828253 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe93c0a8990 con 0x7fe9481531a0 2024-04-23T18:28:17.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.813+0000 7fe947e00640 1 -- 172.21.15.28:0/3542828253 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0a8d80 con 0x7fe9481531a0 2024-04-23T18:28:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 -- 172.21.15.28:0/3542828253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9481531a0 msgr2=0x7fe9480c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 --2- 172.21.15.28:0/3542828253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9481531a0 0x7fe9480c5ec0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0097c0 tx=0x7fe93c01ec90 comp rx=0 tx=0).stop 2024-04-23T18:28:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 -- 172.21.15.28:0/3542828253 shutdown_connections 2024-04-23T18:28:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 --2- 172.21.15.28:0/3542828253 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9480c9a00 0x7fe948158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 --2- 172.21.15.28:0/3542828253 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9481531a0 0x7fe9480c5ec0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 -- 172.21.15.28:0/3542828253 >> 172.21.15.28:0/3542828253 conn(0x7fe94806d0a0 msgr2=0x7fe9480676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 -- 172.21.15.28:0/3542828253 shutdown_connections 2024-04-23T18:28:17.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 -- 172.21.15.28:0/3542828253 wait complete. 2024-04-23T18:28:17.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 Processor -- start 2024-04-23T18:28:17.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 -- start start 2024-04-23T18:28:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9480c9a00 0x7fe9480cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9480c9e40 0x7fe948150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9481531a0 0x7fe948150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe9480c4420 con 0x7fe9480c9a00 2024-04-23T18:28:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe9480c4140 con 0x7fe9481531a0 2024-04-23T18:28:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe950600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fe948153580 con 0x7fe9480c9e40 2024-04-23T18:28:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe94dc00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9480c9a00 0x7fe9480cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe94dc00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9480c9a00 0x7fe9480cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42020/0 (socket says 172.21.15.28:42020) 2024-04-23T18:28:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe94dc00640 1 -- 172.21.15.28:0/2696491852 learned_addr learned my addr 172.21.15.28:0/2696491852 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe94d200640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9480c9e40 0x7fe948150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe94e600640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9481531a0 0x7fe948150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe94dc00640 1 -- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9480c9e40 msgr2=0x7fe948150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe94dc00640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9480c9e40 0x7fe948150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe94dc00640 1 -- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9481531a0 msgr2=0x7fe948150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe94dc00640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9481531a0 0x7fe948150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe94dc00640 1 -- 172.21.15.28:0/2696491852 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9480cb610 con 0x7fe9480c9a00 2024-04-23T18:28:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.817+0000 7fe94dc00640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9480c9a00 0x7fe9480cc320 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe93c01c8c0 tx=0x7fe93c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.821+0000 7fe945600640 1 -- 172.21.15.28:0/2696491852 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0bf070 con 0x7fe9480c9a00 2024-04-23T18:28:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.821+0000 7fe945600640 1 -- 172.21.15.28:0/2696491852 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe93c0b0820 con 0x7fe9480c9a00 2024-04-23T18:28:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.821+0000 7fe945600640 1 -- 172.21.15.28:0/2696491852 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0b5040 con 0x7fe9480c9a00 2024-04-23T18:28:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.821+0000 7fe950600640 1 -- 172.21.15.28:0/2696491852 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9480cb8f0 con 0x7fe9480c9a00 2024-04-23T18:28:17.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.821+0000 7fe950600640 1 -- 172.21.15.28:0/2696491852 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe948143850 con 0x7fe9480c9a00 2024-04-23T18:28:17.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.821+0000 7fe950600640 1 -- 172.21.15.28:0/2696491852 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe948068cd0 con 0x7fe9480c9a00 2024-04-23T18:28:17.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.821+0000 7fe945600640 1 -- 172.21.15.28:0/2696491852 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe93c0b0c30 con 0x7fe9480c9a00 2024-04-23T18:28:17.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.821+0000 7fe945600640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe928068380 0x7fe92806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:17.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.821+0000 7fe945600640 1 -- 172.21.15.28:0/2696491852 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fe93c123810 con 0x7fe9480c9a00 2024-04-23T18:28:17.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.821+0000 7fe94d200640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe928068380 0x7fe92806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:17.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.825+0000 7fe94d200640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe928068380 0x7fe92806a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe948072ed0 tx=0x7fe934008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:17.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:17.825+0000 7fe945600640 1 -- 172.21.15.28:0/2696491852 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe93c0187f0 con 0x7fe9480c9a00 2024-04-23T18:28:18.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 -- 172.21.15.28:0/2696491852 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe948068460 con 0x7fe9480c9a00 2024-04-23T18:28:18.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe945600640 1 -- 172.21.15.28:0/2696491852 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7fe93c0f38b0 con 0x7fe9480c9a00 2024-04-23T18:28:18.023 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:28:18.023 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2747326910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2747326910},{"type":"v1","addr":"172.21.15.137:6835","nonce":2747326910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6834/236797956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":236797956},{"type":"v1","addr":"172.21.15.28:6834","nonce":236797956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1702848661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1702848661},{"type":"v1","addr":"172.21.15.28:6835","nonce":1702848661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T18:22:32.759537+0000","modified":"2024-04-23T18:23:05.612086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4297,"mds_1":4294,"mds_2":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.28:6837/1362691862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6836","nonce":1362691862},{"type":"v1","addr":"172.21.15.28:6837","nonce":1362691862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.137:6838/1110609151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":1110609151},{"type":"v1","addr":"172.21.15.137:6838","nonce":1110609151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.137:6839/1022932690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":1022932690},{"type":"v1","addr":"172.21.15.137:6839","nonce":1022932690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4281,4294,4297]},"id":1}]} 2024-04-23T18:28:18.023 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 15 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 -- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe928068380 msgr2=0x7fe92806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe928068380 0x7fe92806a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe948072ed0 tx=0x7fe934008040 comp rx=0 tx=0).stop 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 -- 172.21.15.28:0/2696491852 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9480c9a00 msgr2=0x7fe9480cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9480c9a00 0x7fe9480cc320 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe93c01c8c0 tx=0x7fe93c01ba30 comp rx=0 tx=0).stop 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 -- 172.21.15.28:0/2696491852 shutdown_connections 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fe928068380 0x7fe92806a840 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe9480c9e40 0x7fe948150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9481531a0 0x7fe948150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 --2- 172.21.15.28:0/2696491852 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9480c9a00 0x7fe9480cc320 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 -- 172.21.15.28:0/2696491852 >> 172.21.15.28:0/2696491852 conn(0x7fe94806d0a0 msgr2=0x7fe9480c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 -- 172.21.15.28:0/2696491852 shutdown_connections 2024-04-23T18:28:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.029+0000 7fe950600640 1 -- 172.21.15.28:0/2696491852 wait complete. 2024-04-23T18:28:18.045 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:28:18.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.189+0000 7ff51fe00640 1 Processor -- start 2024-04-23T18:28:18.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.189+0000 7ff51fe00640 1 -- start start 2024-04-23T18:28:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff51fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 0x7ff5180718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff51fe00640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5180c9de0 con 0x7ff518151f90 2024-04-23T18:28:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff51fe00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff518158cf0 con 0x7ff518152370 2024-04-23T18:28:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff51fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff5180ca080 con 0x7ff518072080 2024-04-23T18:28:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff51d400640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff518151f90 0x7ff51815b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43488/0 (socket says 172.21.15.28:43488) 2024-04-23T18:28:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff51d400640 1 -- 172.21.15.28:0/3256866272 learned_addr learned my addr 172.21.15.28:0/3256866272 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:28:18.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff51ca00640 1 --2- 172.21.15.28:0/3256866272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 0x7ff5180718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff517e00640 1 -- 172.21.15.28:0/3256866272 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 497961423 0 0) 0x7ff5180c9de0 con 0x7ff518151f90 2024-04-23T18:28:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff517e00640 1 -- 172.21.15.28:0/3256866272 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff500003530 con 0x7ff518151f90 2024-04-23T18:28:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff51ca00640 1 -- 172.21.15.28:0/3256866272 >> v1:172.21.15.137:6789/0 conn(0x7ff518152370 legacy=0x7ff5180c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff517e00640 1 -- 172.21.15.28:0/3256866272 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 66944074 0 0) 0x7ff500003530 con 0x7ff518151f90 2024-04-23T18:28:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff51ca00640 1 -- 172.21.15.28:0/3256866272 >> v1:172.21.15.28:6789/0 conn(0x7ff518151f90 legacy=0x7ff51815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.193+0000 7ff51ca00640 1 -- 172.21.15.28:0/3256866272 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff518157f30 con 0x7ff518072080 2024-04-23T18:28:18.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.197+0000 7ff51ca00640 1 --2- 172.21.15.28:0/3256866272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 0x7ff5180718d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff504009770 tx=0x7ff50401c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaee3e2252ad1ef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:18.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.197+0000 7ff517e00640 1 -- 172.21.15.28:0/3256866272 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5040b0070 con 0x7ff518072080 2024-04-23T18:28:18.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.197+0000 7ff517e00640 1 -- 172.21.15.28:0/3256866272 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff5040ab400 con 0x7ff518072080 2024-04-23T18:28:18.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.197+0000 7ff517e00640 1 -- 172.21.15.28:0/3256866272 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0016a0 con 0x7ff518072080 2024-04-23T18:28:18.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.197+0000 7ff51fe00640 1 -- 172.21.15.28:0/3256866272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 msgr2=0x7ff5180718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.197+0000 7ff51fe00640 1 --2- 172.21.15.28:0/3256866272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 0x7ff5180718d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff504009770 tx=0x7ff50401c2c0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.197+0000 7ff51fe00640 1 -- 172.21.15.28:0/3256866272 shutdown_connections 2024-04-23T18:28:18.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.197+0000 7ff51fe00640 1 --2- 172.21.15.28:0/3256866272 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 0x7ff5180718d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.197+0000 7ff51fe00640 1 -- 172.21.15.28:0/3256866272 >> 172.21.15.28:0/3256866272 conn(0x7ff51806d0a0 msgr2=0x7ff5180676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:18.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.197+0000 7ff51fe00640 1 -- 172.21.15.28:0/3256866272 shutdown_connections 2024-04-23T18:28:18.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.197+0000 7ff51fe00640 1 -- 172.21.15.28:0/3256866272 wait complete. 2024-04-23T18:28:18.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51fe00640 1 Processor -- start 2024-04-23T18:28:18.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51fe00640 1 -- start start 2024-04-23T18:28:18.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51fe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 0x7ff518152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51fe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff518151f90 0x7ff51814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff518152370 0x7ff5180c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51fe00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181587d0 con 0x7ff518151f90 2024-04-23T18:28:18.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181584f0 con 0x7ff518152370 2024-04-23T18:28:18.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51fe00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7ff51815baa0 con 0x7ff518072080 2024-04-23T18:28:18.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51ca00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff518151f90 0x7ff51814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51ca00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff518151f90 0x7ff51814f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42028/0 (socket says 172.21.15.28:42028) 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51ca00640 1 -- 172.21.15.28:0/3208063312 learned_addr learned my addr 172.21.15.28:0/3208063312 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51d400640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 0x7ff518152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51de00640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff518152370 0x7ff5180c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51ca00640 1 -- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 msgr2=0x7ff518152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51ca00640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 0x7ff518152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51ca00640 1 -- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff518152370 msgr2=0x7ff5180c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51ca00640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff518152370 0x7ff5180c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51ca00640 1 -- 172.21.15.28:0/3208063312 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51814f8f0 con 0x7ff518151f90 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51de00640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff518152370 0x7ff5180c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51d400640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 0x7ff518152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51ca00640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff518151f90 0x7ff51814f3b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff50401a970 tx=0x7ff504019060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff515600640 1 -- 172.21.15.28:0/3208063312 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5040b0040 con 0x7ff518151f90 2024-04-23T18:28:18.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff515600640 1 -- 172.21.15.28:0/3208063312 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff5040aa4e0 con 0x7ff518151f90 2024-04-23T18:28:18.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51fe00640 1 -- 172.21.15.28:0/3208063312 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5181e6000 con 0x7ff518151f90 2024-04-23T18:28:18.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff515600640 1 -- 172.21.15.28:0/3208063312 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5040aa8b0 con 0x7ff518151f90 2024-04-23T18:28:18.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51fe00640 1 -- 172.21.15.28:0/3208063312 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5181e0c40 con 0x7ff518151f90 2024-04-23T18:28:18.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.201+0000 7ff51fe00640 1 -- 172.21.15.28:0/3208063312 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff518068cd0 con 0x7ff518151f90 2024-04-23T18:28:18.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.205+0000 7ff515600640 1 -- 172.21.15.28:0/3208063312 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff5040bd030 con 0x7ff518151f90 2024-04-23T18:28:18.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.205+0000 7ff515600640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4f8068380 0x7ff4f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.205+0000 7ff515600640 1 -- 172.21.15.28:0/3208063312 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff5041206f0 con 0x7ff518151f90 2024-04-23T18:28:18.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.205+0000 7ff51d400640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4f8068380 0x7ff4f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.205+0000 7ff51d400640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4f8068380 0x7ff4f806a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff50c001ec0 tx=0x7ff50c001d50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:18.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.209+0000 7ff515600640 1 -- 172.21.15.28:0/3208063312 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff5040c4060 con 0x7ff518151f90 2024-04-23T18:28:18.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.373+0000 7ff51fe00640 1 -- 172.21.15.28:0/3208063312 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff518155f10 con 0x7ff518151f90 2024-04-23T18:28:18.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff515600640 1 -- 172.21.15.28:0/3208063312 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18891 (secure 0 0 0) 0x7ff504015f70 con 0x7ff518151f90 2024-04-23T18:28:18.371 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-04-23T18:28:18.371 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":26,"fsid":"d84cc156-ceaf-4cae-a89c-ee7e55af72c5","created":"2024-04-23T18:22:07.860123+0000","modified":"2024-04-23T18:23:14.705611+0000","last_up_change":"2024-04-23T18:22:18.975905+0000","last_in_change":"2024-04-23T18:22:10.134910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:22:19.363864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T18:22:31.040656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T18:22:31.703845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T18:22:35.387908+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c9f5ce8-6604-4da1-9495-97f7a03ee9c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6801","nonce":1141872294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6803","nonce":1141872294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6807","nonce":1141872294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1141872294},{"type":"v1","addr":"172.21.15.28:6805","nonce":1141872294}]},"public_addr":"172.21.15.28:6801/1141872294","cluster_addr":"172.21.15.28:6803/1141872294","heartbeat_back_addr":"172.21.15.28:6807/1141872294","heartbeat_front_addr":"172.21.15.28:6805/1141872294","state":["exists","up"]},{"osd":1,"uuid":"9d312ff9-1642-4ef5-b6d7-84253976620b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6809","nonce":3900609679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3900609679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6815","nonce":3900609679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3900609679},{"type":"v1","addr":"172.21.15.28:6813","nonce":3900609679}]},"public_addr":"172.21.15.28:6809/3900609679","cluster_addr":"172.21.15.28:6811/3900609679","heartbeat_back_addr":"172.21.15.28:6815/3900609679","heartbeat_front_addr":"172.21.15.28:6813/3900609679","state":["exists","up"]},{"osd":2,"uuid":"3a82acae-e6e9-4c74-9c0c-ae3f6e3b8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6825","nonce":769511597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6827","nonce":769511597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6831","nonce":769511597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":769511597},{"type":"v1","addr":"172.21.15.28:6829","nonce":769511597}]},"public_addr":"172.21.15.28:6825/769511597","cluster_addr":"172.21.15.28:6827/769511597","heartbeat_back_addr":"172.21.15.28:6831/769511597","heartbeat_front_addr":"172.21.15.28:6829/769511597","state":["exists","up"]},{"osd":3,"uuid":"3ee92e5b-66ce-4e58-b4a6-110de2f8bbda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6817","nonce":1483415769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6819","nonce":1483415769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6823","nonce":1483415769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":1483415769},{"type":"v1","addr":"172.21.15.28:6821","nonce":1483415769}]},"public_addr":"172.21.15.28:6817/1483415769","cluster_addr":"172.21.15.28:6819/1483415769","heartbeat_back_addr":"172.21.15.28:6823/1483415769","heartbeat_front_addr":"172.21.15.28:6821/1483415769","state":["exists","up"]},{"osd":4,"uuid":"f495a288-0985-466d-8737-f306ddfe04b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6808","nonce":3497527296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6811","nonce":3497527296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6815","nonce":3497527296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":3497527296},{"type":"v1","addr":"172.21.15.137:6813","nonce":3497527296}]},"public_addr":"172.21.15.137:6808/3497527296","cluster_addr":"172.21.15.137:6811/3497527296","heartbeat_back_addr":"172.21.15.137:6815/3497527296","heartbeat_front_addr":"172.21.15.137:6813/3497527296","state":["exists","up"]},{"osd":5,"uuid":"8012096c-b6d4-4a49-b43e-e879e2829526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6825","nonce":1206756250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6827","nonce":1206756250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6831","nonce":1206756250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1206756250},{"type":"v1","addr":"172.21.15.137:6829","nonce":1206756250}]},"public_addr":"172.21.15.137:6825/1206756250","cluster_addr":"172.21.15.137:6827/1206756250","heartbeat_back_addr":"172.21.15.137:6831/1206756250","heartbeat_front_addr":"172.21.15.137:6829/1206756250","state":["exists","up"]},{"osd":6,"uuid":"72a499db-d416-419a-a102-58eaf66bd7f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6817","nonce":276934842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6819","nonce":276934842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6823","nonce":276934842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":276934842},{"type":"v1","addr":"172.21.15.137:6821","nonce":276934842}]},"public_addr":"172.21.15.137:6817/276934842","cluster_addr":"172.21.15.137:6819/276934842","heartbeat_back_addr":"172.21.15.137:6823/276934842","heartbeat_front_addr":"172.21.15.137:6821/276934842","state":["exists","up"]},{"osd":7,"uuid":"22b5f227-7ed6-46ad-adfa-39c1a5ffb777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6801","nonce":2261796983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6803","nonce":2261796983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6809","nonce":2261796983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2261796983},{"type":"v1","addr":"172.21.15.137:6805","nonce":2261796983}]},"public_addr":"172.21.15.137:6801/2261796983","cluster_addr":"172.21.15.137:6803/2261796983","heartbeat_back_addr":"172.21.15.137:6809/2261796983","heartbeat_front_addr":"172.21.15.137:6805/2261796983","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.724703+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.938985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:16.026256+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.946410+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.769344+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.732874+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.825271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:22:15.819933+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 -- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4f8068380 msgr2=0x7ff4f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4f8068380 0x7ff4f806a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff50c001ec0 tx=0x7ff50c001d50 comp rx=0 tx=0).stop 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 -- 172.21.15.28:0/3208063312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff518151f90 msgr2=0x7ff51814f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff518151f90 0x7ff51814f3b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff50401a970 tx=0x7ff504019060 comp rx=0 tx=0).stop 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 -- 172.21.15.28:0/3208063312 shutdown_connections 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7ff4f8068380 0x7ff4f806a840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff518152370 0x7ff5180c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff518151f90 0x7ff51814f3b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 --2- 172.21.15.28:0/3208063312 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff518072080 0x7ff518152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 -- 172.21.15.28:0/3208063312 >> 172.21.15.28:0/3208063312 conn(0x7ff51806d0a0 msgr2=0x7ff51815b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 -- 172.21.15.28:0/3208063312 shutdown_connections 2024-04-23T18:28:18.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.377+0000 7ff51fe00640 1 -- 172.21.15.28:0/3208063312 wait complete. 2024-04-23T18:28:18.393 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-23T18:28:18.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9db9e00640 1 Processor -- start 2024-04-23T18:28:18.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9db9e00640 1 -- start start 2024-04-23T18:28:18.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9db9e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9db4158f80 0x7f9db4073c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9db9e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9db40c9850 0x7f9db40c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9db9e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9db40c71f0 con 0x7f9db4071940 2024-04-23T18:28:18.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9db9e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9db4070d40 con 0x7f9db40c9850 2024-04-23T18:28:18.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9db9e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9db4071d20 con 0x7f9db4158f80 2024-04-23T18:28:18.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9db3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9db40c9850 0x7f9db40c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9db3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9db40c9850 0x7f9db40c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.28:49926/0 (socket says 172.21.15.28:49926) 2024-04-23T18:28:18.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9db3400640 1 -- 172.21.15.28:0/2514559730 learned_addr learned my addr 172.21.15.28:0/2514559730 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:18.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9daa000640 1 --2- 172.21.15.28:0/2514559730 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9db4158f80 0x7f9db4073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.541+0000 7f9db2a00640 1 --1- 172.21.15.28:0/2514559730 >> v1:172.21.15.137:6789/0 conn(0x7f9db4071940 0x7f9db40ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:53128/0 (socket says 172.21.15.28:53128) 2024-04-23T18:28:18.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.545+0000 7f9daa000640 1 -- 172.21.15.28:0/2514559730 >> v2:172.21.15.137:3300/0 conn(0x7f9db40c9850 msgr2=0x7f9db40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:18.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.545+0000 7f9daa000640 1 --2- 172.21.15.28:0/2514559730 >> v2:172.21.15.137:3300/0 conn(0x7f9db40c9850 0x7f9db40c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.545+0000 7f9daa000640 1 -- 172.21.15.28:0/2514559730 >> v1:172.21.15.137:6789/0 conn(0x7f9db4071940 legacy=0x7f9db40ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.545+0000 7f9daa000640 1 -- 172.21.15.28:0/2514559730 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db4159410 con 0x7f9db4158f80 2024-04-23T18:28:18.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.545+0000 7f9db3400640 1 --2- 172.21.15.28:0/2514559730 >> v2:172.21.15.137:3300/0 conn(0x7f9db40c9850 0x7f9db40c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:28:18.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.545+0000 7f9daa000640 1 --2- 172.21.15.28:0/2514559730 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9db4158f80 0x7f9db4073c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0097c0 tx=0x7f9d9c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa24901f64548352 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:18.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.545+0000 7f9db2000640 1 -- 172.21.15.28:0/2514559730 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0b5070 con 0x7f9db4158f80 2024-04-23T18:28:18.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.545+0000 7f9db2000640 1 -- 172.21.15.28:0/2514559730 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d9c0a8990 con 0x7f9db4158f80 2024-04-23T18:28:18.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.545+0000 7f9db2000640 1 -- 172.21.15.28:0/2514559730 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0a8d80 con 0x7f9db4158f80 2024-04-23T18:28:18.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 -- 172.21.15.28:0/2514559730 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9db4158f80 msgr2=0x7f9db4073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 --2- 172.21.15.28:0/2514559730 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9db4158f80 0x7f9db4073c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0097c0 tx=0x7f9d9c01ec90 comp rx=0 tx=0).stop 2024-04-23T18:28:18.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 -- 172.21.15.28:0/2514559730 shutdown_connections 2024-04-23T18:28:18.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 --2- 172.21.15.28:0/2514559730 >> v2:172.21.15.137:3300/0 conn(0x7f9db40c9850 0x7f9db40c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 --2- 172.21.15.28:0/2514559730 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9db4158f80 0x7f9db4073c70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 -- 172.21.15.28:0/2514559730 >> 172.21.15.28:0/2514559730 conn(0x7f9db4075e30 msgr2=0x7f9db40676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:18.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 -- 172.21.15.28:0/2514559730 shutdown_connections 2024-04-23T18:28:18.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 -- 172.21.15.28:0/2514559730 wait complete. 2024-04-23T18:28:18.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 Processor -- start 2024-04-23T18:28:18.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 -- start start 2024-04-23T18:28:18.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9db4071940 0x7f9db40c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9db40c9850 0x7f9db415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9db415cf10 0x7f9db415bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9db4159cb0 con 0x7f9db40c9850 2024-04-23T18:28:18.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9db41599d0 con 0x7f9db415cf10 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db9e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f9db40cc680 con 0x7f9db4071940 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9daa000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9db40c9850 0x7f9db415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9daa000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9db40c9850 0x7f9db415ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42036/0 (socket says 172.21.15.28:42036) 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9daa000640 1 -- 172.21.15.28:0/3122645487 learned_addr learned my addr 172.21.15.28:0/3122645487 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db2a00640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9db4071940 0x7f9db40c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9db3400640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9db415cf10 0x7f9db415bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9daa000640 1 -- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9db4071940 msgr2=0x7f9db40c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9daa000640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9db4071940 0x7f9db40c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9daa000640 1 -- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9db415cf10 msgr2=0x7f9db415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9daa000640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9db415cf10 0x7f9db415bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.549+0000 7f9daa000640 1 -- 172.21.15.28:0/3122645487 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db41f1230 con 0x7f9db40c9850 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.553+0000 7f9daa000640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9db40c9850 0x7f9db415ba40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0b3040 tx=0x7f9d9c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:18.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.553+0000 7f9dabe00640 1 -- 172.21.15.28:0/3122645487 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0be070 con 0x7f9db40c9850 2024-04-23T18:28:18.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.553+0000 7f9dabe00640 1 -- 172.21.15.28:0/3122645487 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d9c0b0700 con 0x7f9db40c9850 2024-04-23T18:28:18.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.553+0000 7f9dabe00640 1 -- 172.21.15.28:0/3122645487 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0b5040 con 0x7f9db40c9850 2024-04-23T18:28:18.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.553+0000 7f9db9e00640 1 -- 172.21.15.28:0/3122645487 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db41f14f0 con 0x7f9db40c9850 2024-04-23T18:28:18.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.553+0000 7f9db9e00640 1 -- 172.21.15.28:0/3122645487 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db41f1ab0 con 0x7f9db40c9850 2024-04-23T18:28:18.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.553+0000 7f9db9e00640 1 -- 172.21.15.28:0/3122645487 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db4068db0 con 0x7f9db40c9850 2024-04-23T18:28:18.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.553+0000 7f9dabe00640 1 -- 172.21.15.28:0/3122645487 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d9c0b0b10 con 0x7f9db40c9850 2024-04-23T18:28:18.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.553+0000 7f9dabe00640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d90068380 0x7f9d9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.553+0000 7f9dabe00640 1 -- 172.21.15.28:0/3122645487 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f9d9c123800 con 0x7f9db40c9850 2024-04-23T18:28:18.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.553+0000 7f9db2a00640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d90068380 0x7f9d9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.557+0000 7f9db2a00640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d90068380 0x7f9d9006a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9da4000f70 tx=0x7f9da4007e90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:18.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.557+0000 7f9dabe00640 1 -- 172.21.15.28:0/3122645487 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9d9c0187f0 con 0x7f9db40c9850 2024-04-23T18:28:18.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.757+0000 7f9db9e00640 1 -- 172.21.15.28:0/3122645487 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9db40c79b0 con 0x7f9db40c9850 2024-04-23T18:28:18.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9dabe00640 1 -- 172.21.15.28:0/3122645487 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7f9d9c0f3240 con 0x7f9db40c9850 2024-04-23T18:28:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-23T18:28:18.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 -- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d90068380 msgr2=0x7f9d9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d90068380 0x7f9d9006a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9da4000f70 tx=0x7f9da4007e90 comp rx=0 tx=0).stop 2024-04-23T18:28:18.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 -- 172.21.15.28:0/3122645487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9db40c9850 msgr2=0x7f9db415ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9db40c9850 0x7f9db415ba40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0b3040 tx=0x7f9d9c01ba30 comp rx=0 tx=0).stop 2024-04-23T18:28:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 -- 172.21.15.28:0/3122645487 shutdown_connections 2024-04-23T18:28:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f9d90068380 0x7f9d9006a840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9db415cf10 0x7f9db415bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9db40c9850 0x7f9db415ba40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 --2- 172.21.15.28:0/3122645487 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9db4071940 0x7f9db40c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 -- 172.21.15.28:0/3122645487 >> 172.21.15.28:0/3122645487 conn(0x7f9db4075e30 msgr2=0x7f9db4157770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 -- 172.21.15.28:0/3122645487 shutdown_connections 2024-04-23T18:28:18.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.761+0000 7f9db9e00640 1 -- 172.21.15.28:0/3122645487 wait complete. 2024-04-23T18:28:18.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-23T18:28:18.832 INFO:tasks.ceph.mds.e.smithi028.stdout:starting mds.e at 2024-04-23T18:28:18.838 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-04-23T18:28:18.850 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-04-23T18:28:18.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.937+0000 7f107d400640 1 Processor -- start 2024-04-23T18:28:18.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.937+0000 7f107d400640 1 -- start start 2024-04-23T18:28:18.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f107d400640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1078155310 0x7f10780d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f107d400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f10780d0c90 0x7f107815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f107d400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107815f420 con 0x7f107815efb0 2024-04-23T18:28:18.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f107d400640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 -- 0x7f107815b290 con 0x7f1078155310 2024-04-23T18:28:18.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f107d400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f107815b550 con 0x7f10780d0c90 2024-04-23T18:28:18.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f1077e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1078155310 0x7f10780d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f1077e00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1078155310 0x7f10780d0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53254/0 (socket says 172.21.15.28:53254) 2024-04-23T18:28:18.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f1077e00640 1 -- 172.21.15.28:0/1748684408 learned_addr learned my addr 172.21.15.28:0/1748684408 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:18.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f106f400640 1 --2- 172.21.15.28:0/1748684408 >> v2:172.21.15.137:3300/0 conn(0x7f10780d0c90 0x7f107815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f1077e00640 1 -- 172.21.15.28:0/1748684408 >> v2:172.21.15.137:3300/0 conn(0x7f10780d0c90 msgr2=0x7f107815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:18.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f1077e00640 1 --2- 172.21.15.28:0/1748684408 >> v2:172.21.15.137:3300/0 conn(0x7f10780d0c90 0x7f107815ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f1077e00640 1 -- 172.21.15.28:0/1748684408 >> v1:172.21.15.137:6789/0 conn(0x7f107815efb0 legacy=0x7f10780c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f1077e00640 1 -- 172.21.15.28:0/1748684408 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107815b830 con 0x7f1078155310 2024-04-23T18:28:18.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.941+0000 7f106f400640 1 --2- 172.21.15.28:0/1748684408 >> v2:172.21.15.137:3300/0 conn(0x7f10780d0c90 0x7f107815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:28:18.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f1077e00640 1 --2- 172.21.15.28:0/1748684408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1078155310 0x7f10780d0750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f10780cc1c0 tx=0x7f106801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e23ab7c57119e3d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:18.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f1077400640 1 -- 172.21.15.28:0/1748684408 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10680a5730 con 0x7f1078155310 2024-04-23T18:28:18.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f1077400640 1 -- 172.21.15.28:0/1748684408 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f10680a58d0 con 0x7f1078155310 2024-04-23T18:28:18.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f1077400640 1 -- 172.21.15.28:0/1748684408 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10680a5cc0 con 0x7f1078155310 2024-04-23T18:28:18.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 -- 172.21.15.28:0/1748684408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1078155310 msgr2=0x7f10780d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 --2- 172.21.15.28:0/1748684408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1078155310 0x7f10780d0750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f10780cc1c0 tx=0x7f106801c960 comp rx=0 tx=0).stop 2024-04-23T18:28:18.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 -- 172.21.15.28:0/1748684408 shutdown_connections 2024-04-23T18:28:18.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 --2- 172.21.15.28:0/1748684408 >> v2:172.21.15.137:3300/0 conn(0x7f10780d0c90 0x7f107815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 --2- 172.21.15.28:0/1748684408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1078155310 0x7f10780d0750 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 -- 172.21.15.28:0/1748684408 >> 172.21.15.28:0/1748684408 conn(0x7f10780759a0 msgr2=0x7f1078072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:18.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 -- 172.21.15.28:0/1748684408 shutdown_connections 2024-04-23T18:28:18.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 -- 172.21.15.28:0/1748684408 wait complete. 2024-04-23T18:28:18.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 Processor -- start 2024-04-23T18:28:18.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 -- start start 2024-04-23T18:28:18.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10780d0c90 0x7f10781f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1078155310 0x7f107815a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f107815efb0 0x7f10781f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1078155870 con 0x7f10780d0c90 2024-04-23T18:28:18.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10781556f0 con 0x7f1078155310 2024-04-23T18:28:18.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f107d400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f1078168240 con 0x7f107815efb0 2024-04-23T18:28:18.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f1077e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10780d0c90 0x7f10781f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f1077e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10780d0c90 0x7f10781f54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53266/0 (socket says 172.21.15.28:53266) 2024-04-23T18:28:18.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.945+0000 7f1077e00640 1 -- 172.21.15.28:0/4178566027 learned_addr learned my addr 172.21.15.28:0/4178566027 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:18.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f107ca00640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f107815efb0 0x7f10781f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f106f400640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1078155310 0x7f107815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f1077e00640 1 -- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f107815efb0 msgr2=0x7f10781f7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f1077e00640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f107815efb0 0x7f10781f7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f1077e00640 1 -- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1078155310 msgr2=0x7f107815a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f1077e00640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1078155310 0x7f107815a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f1077e00640 1 -- 172.21.15.28:0/4178566027 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10781f82c0 con 0x7f10780d0c90 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f106f400640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1078155310 0x7f107815a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f1077e00640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10780d0c90 0x7f10781f54d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1068019570 tx=0x7f1068019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f1074c00640 1 -- 172.21.15.28:0/4178566027 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10680bc020 con 0x7f10780d0c90 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f1074c00640 1 -- 172.21.15.28:0/4178566027 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f10680b8670 con 0x7f10780d0c90 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f1074c00640 1 -- 172.21.15.28:0/4178566027 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10680b8a80 con 0x7f10780d0c90 2024-04-23T18:28:18.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f107d400640 1 -- 172.21.15.28:0/4178566027 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1078159aa0 con 0x7f10780d0c90 2024-04-23T18:28:18.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f107d400640 1 -- 172.21.15.28:0/4178566027 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107815a060 con 0x7f10780d0c90 2024-04-23T18:28:18.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f106d600640 1 -- 172.21.15.28:0/4178566027 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1078068cd0 con 0x7f10780d0c90 2024-04-23T18:28:18.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f1074c00640 1 -- 172.21.15.28:0/4178566027 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10680bf020 con 0x7f10780d0c90 2024-04-23T18:28:18.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.949+0000 7f1074c00640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1054068380 0x7f105406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:18.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.953+0000 7f1074c00640 1 -- 172.21.15.28:0/4178566027 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6993+0+0 (secure 0 0 0) 0x7f1068121ff0 con 0x7f10780d0c90 2024-04-23T18:28:18.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.953+0000 7f106f400640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1054068380 0x7f105406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:18.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.953+0000 7f106f400640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1054068380 0x7f105406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f10780cea60 tx=0x7f1060008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:18.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:18.957+0000 7f1074c00640 1 -- 172.21.15.28:0/4178566027 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f10680c6030 con 0x7f10780d0c90 2024-04-23T18:28:19.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.153+0000 7f106d600640 1 -- 172.21.15.28:0/4178566027 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1078152920 con 0x7f10780d0c90 2024-04-23T18:28:19.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.761+0000 7f1074c00640 1 -- 172.21.15.28:0/4178566027 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f10680165e0 con 0x7f10780d0c90 2024-04-23T18:28:19.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 -- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1054068380 msgr2=0x7f105406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:19.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1054068380 0x7f105406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f10780cea60 tx=0x7f1060008040 comp rx=0 tx=0).stop 2024-04-23T18:28:19.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 -- 172.21.15.28:0/4178566027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10780d0c90 msgr2=0x7f10781f54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:19.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10780d0c90 0x7f10781f54d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1068019570 tx=0x7f1068019700 comp rx=0 tx=0).stop 2024-04-23T18:28:19.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 -- 172.21.15.28:0/4178566027 shutdown_connections 2024-04-23T18:28:19.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f1054068380 0x7f105406a840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:19.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f107815efb0 0x7f10781f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:19.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1078155310 0x7f107815a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:19.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 --2- 172.21.15.28:0/4178566027 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10780d0c90 0x7f10781f54d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:19.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 -- 172.21.15.28:0/4178566027 >> 172.21.15.28:0/4178566027 conn(0x7f10780759a0 msgr2=0x7f1078072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:19.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 -- 172.21.15.28:0/4178566027 shutdown_connections 2024-04-23T18:28:19.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.765+0000 7f106d600640 1 -- 172.21.15.28:0/4178566027 wait complete. 2024-04-23T18:28:19.781 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-23T18:28:19.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.977+0000 7fa90de00640 1 Processor -- start 2024-04-23T18:28:19.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.977+0000 7fa90de00640 1 -- start start 2024-04-23T18:28:19.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90de00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa908152fa0 0x7fa9080c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:19.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa908158e60 0x7fa90815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:19.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90de00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9080ca7a0 con 0x7fa9080c6d90 2024-04-23T18:28:19.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90de00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa9080c7310 con 0x7fa908152fa0 2024-04-23T18:28:19.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa9080c75f0 con 0x7fa908158e60 2024-04-23T18:28:19.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa907e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa908158e60 0x7fa90815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:19.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90ca00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa908152fa0 0x7fa9080c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:19.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90d400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa9080c6d90 0x7fa9080676e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.28:52070/0 (socket says 172.21.15.28:52070) 2024-04-23T18:28:19.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90d400640 1 -- 172.21.15.28:0/2892634819 learned_addr learned my addr 172.21.15.28:0/2892634819 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:28:19.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90ca00640 1 -- 172.21.15.28:0/2892634819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa908158e60 msgr2=0x7fa90815cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:19.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90ca00640 1 --2- 172.21.15.28:0/2892634819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa908158e60 0x7fa90815cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:19.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90ca00640 1 -- 172.21.15.28:0/2892634819 >> v1:172.21.15.137:6789/0 conn(0x7fa9080c6d90 legacy=0x7fa9080676e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:19.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.981+0000 7fa90ca00640 1 -- 172.21.15.28:0/2892634819 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9080c78d0 con 0x7fa908152fa0 2024-04-23T18:28:19.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa90ca00640 1 --2- 172.21.15.28:0/2892634819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908152fa0 0x7fa9080c54e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0097c0 tx=0x7fa8fc01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b4908ecc2b04656 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:19.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa907400640 1 -- 172.21.15.28:0/2892634819 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0b1070 con 0x7fa908152fa0 2024-04-23T18:28:19.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa907400640 1 -- 172.21.15.28:0/2892634819 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa8fc0a8050 con 0x7fa908152fa0 2024-04-23T18:28:19.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa907400640 1 -- 172.21.15.28:0/2892634819 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0ac880 con 0x7fa908152fa0 2024-04-23T18:28:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa90de00640 1 -- 172.21.15.28:0/2892634819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908152fa0 msgr2=0x7fa9080c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa90de00640 1 --2- 172.21.15.28:0/2892634819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908152fa0 0x7fa9080c54e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0097c0 tx=0x7fa8fc01c3e0 comp rx=0 tx=0).stop 2024-04-23T18:28:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa90de00640 1 -- 172.21.15.28:0/2892634819 shutdown_connections 2024-04-23T18:28:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa90de00640 1 --2- 172.21.15.28:0/2892634819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa908158e60 0x7fa90815cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa90de00640 1 --2- 172.21.15.28:0/2892634819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908152fa0 0x7fa9080c54e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa90de00640 1 -- 172.21.15.28:0/2892634819 >> 172.21.15.28:0/2892634819 conn(0x7fa90806f820 msgr2=0x7fa90806fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa90de00640 1 -- 172.21.15.28:0/2892634819 shutdown_connections 2024-04-23T18:28:19.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa90de00640 1 -- 172.21.15.28:0/2892634819 wait complete. 2024-04-23T18:28:19.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa90de00640 1 Processor -- start 2024-04-23T18:28:19.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.985+0000 7fa90de00640 1 -- start start 2024-04-23T18:28:19.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90de00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c6d90 0x7fa90814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:19.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908152fa0 0x7fa9081eb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:19.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90de00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa908158e60 0x7fa90814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:19.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90de00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa908067f70 con 0x7fa908158e60 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa908067df0 con 0x7fa908152fa0 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90de00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7fa908153380 con 0x7fa9080c6d90 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90d400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa908158e60 0x7fa90814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90d400640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa908158e60 0x7fa90814cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53278/0 (socket says 172.21.15.28:53278) 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90d400640 1 -- 172.21.15.28:0/292596064 learned_addr learned my addr 172.21.15.28:0/292596064 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90ca00640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c6d90 0x7fa90814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa907e00640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908152fa0 0x7fa9081eb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90d400640 1 -- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c6d90 msgr2=0x7fa90814f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90d400640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c6d90 0x7fa90814f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90d400640 1 -- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908152fa0 msgr2=0x7fa9081eb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90d400640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908152fa0 0x7fa9081eb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90d400640 1 -- 172.21.15.28:0/292596064 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9081ebb80 con 0x7fa908158e60 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90d400640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa908158e60 0x7fa90814cc30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa90000cab0 tx=0x7fa90000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:19.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa904c00640 1 -- 172.21.15.28:0/292596064 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900017070 con 0x7fa908158e60 2024-04-23T18:28:19.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa904c00640 1 -- 172.21.15.28:0/292596064 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa90000ac30 con 0x7fa908158e60 2024-04-23T18:28:19.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90de00640 1 -- 172.21.15.28:0/292596064 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa908157890 con 0x7fa908158e60 2024-04-23T18:28:19.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa904c00640 1 -- 172.21.15.28:0/292596064 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900012400 con 0x7fa908158e60 2024-04-23T18:28:19.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90de00640 1 -- 172.21.15.28:0/292596064 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa908157e50 con 0x7fa908158e60 2024-04-23T18:28:19.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.989+0000 7fa90de00640 1 -- 172.21.15.28:0/292596064 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa908068cd0 con 0x7fa908158e60 2024-04-23T18:28:19.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.993+0000 7fa904c00640 1 -- 172.21.15.28:0/292596064 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa90001a070 con 0x7fa908158e60 2024-04-23T18:28:19.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.993+0000 7fa904c00640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e8068380 0x7fa8e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:19.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.993+0000 7fa904c00640 1 -- 172.21.15.28:0/292596064 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6993+0+0 (secure 0 0 0) 0x7fa900086a90 con 0x7fa908158e60 2024-04-23T18:28:19.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.993+0000 7fa90ca00640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e8068380 0x7fa8e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:19.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.993+0000 7fa90ca00640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e8068380 0x7fa8e806a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0ae000 tx=0x7fa8fc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:19.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:19.997+0000 7fa904c00640 1 -- 172.21.15.28:0/292596064 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa9000564f0 con 0x7fa908158e60 2024-04-23T18:28:20.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.161+0000 7fa90de00640 1 -- 172.21.15.28:0/292596064 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa90814d720 con 0x7fa908158e60 2024-04-23T18:28:20.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa904c00640 1 -- 172.21.15.28:0/292596064 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7fa90005a7f0 con 0x7fa908158e60 2024-04-23T18:28:20.758 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2024-04-23T18:28:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 -- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e8068380 msgr2=0x7fa8e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e8068380 0x7fa8e806a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0ae000 tx=0x7fa8fc008040 comp rx=0 tx=0).stop 2024-04-23T18:28:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 -- 172.21.15.28:0/292596064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa908158e60 msgr2=0x7fa90814cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa908158e60 0x7fa90814cc30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa90000cab0 tx=0x7fa90000cf70 comp rx=0 tx=0).stop 2024-04-23T18:28:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 -- 172.21.15.28:0/292596064 shutdown_connections 2024-04-23T18:28:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7fa8e8068380 0x7fa8e806a840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa908158e60 0x7fa90814cc30 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa908152fa0 0x7fa9081eb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 --2- 172.21.15.28:0/292596064 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa9080c6d90 0x7fa90814f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 -- 172.21.15.28:0/292596064 >> 172.21.15.28:0/292596064 conn(0x7fa90806f820 msgr2=0x7fa90815a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 -- 172.21.15.28:0/292596064 shutdown_connections 2024-04-23T18:28:20.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.765+0000 7fa90de00640 1 -- 172.21.15.28:0/292596064 wait complete. 2024-04-23T18:28:20.782 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-23T18:28:20.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.933+0000 7faed2000640 1 Processor -- start 2024-04-23T18:28:20.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.933+0000 7faed2000640 1 -- start start 2024-04-23T18:28:20.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faed2000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faecc15b580 0x7faecc071730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:20.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faed2000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc15b960 0x7faecc0c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:20.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faed2000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faecc071c70 con 0x7faecc151ba0 2024-04-23T18:28:20.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faed2000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7faecc071ee0 con 0x7faecc15b580 2024-04-23T18:28:20.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faed2000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faecc072180 con 0x7faecc15b960 2024-04-23T18:28:20.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecbe00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7faecc151ba0 0x7faecc0731e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47680/0 (socket says 172.21.15.28:47680) 2024-04-23T18:28:20.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecbe00640 1 -- 172.21.15.28:0/1245859968 learned_addr learned my addr 172.21.15.28:0/1245859968 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:28:20.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecb400640 1 --2- 172.21.15.28:0/1245859968 >> v2:172.21.15.137:3300/0 conn(0x7faecc15b580 0x7faecc071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:20.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faec2a00640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc15b960 0x7faecc0c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:20.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2675785546 0 0) 0x7faecc071c70 con 0x7faecc151ba0 2024-04-23T18:28:20.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeb0003530 con 0x7faecc151ba0 2024-04-23T18:28:20.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 649090767 0 0) 0x7faeb0003530 con 0x7faecc151ba0 2024-04-23T18:28:20.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc15b960 msgr2=0x7faecc0c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:20.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc15b960 0x7faecc0c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:20.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 >> v2:172.21.15.137:3300/0 conn(0x7faecc15b580 msgr2=0x7faecc071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:20.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 --2- 172.21.15.28:0/1245859968 >> v2:172.21.15.137:3300/0 conn(0x7faecc15b580 0x7faecc071730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc072420 con 0x7faecc151ba0 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3361944888 0 0) 0x7faec4001a00 con 0x7faecc151ba0 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 >> v1:172.21.15.28:6789/0 conn(0x7faecc151ba0 legacy=0x7faecc0731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faeb00039c0 0x7faeb0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb0004810 0x7faeb0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc15b960 0x7faeb00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7faecc071ee0 con 0x7faeb00039c0 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faecc072180 con 0x7faeb0004810 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faeb000dbe0 con 0x7faecc15b960 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecb400640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faeb00039c0 0x7faeb0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faec2a00640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb0004810 0x7faeb0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecbe00640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc15b960 0x7faeb00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecb400640 1 -- 172.21.15.28:0/1245859968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc15b960 msgr2=0x7faeb00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecb400640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc15b960 0x7faeb00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecb400640 1 -- 172.21.15.28:0/1245859968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb0004810 msgr2=0x7faeb0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecb400640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb0004810 0x7faeb0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.937+0000 7faecb400640 1 -- 172.21.15.28:0/1245859968 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb0003530 con 0x7faeb00039c0 2024-04-23T18:28:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faecb400640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faeb00039c0 0x7faeb0003de0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faebc009ae0 tx=0x7faebc01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ed5161c5401e8e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:20.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc0096b0 con 0x7faeb00039c0 2024-04-23T18:28:20.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faebc0a64c0 con 0x7faeb00039c0 2024-04-23T18:28:20.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faecaa00640 1 -- 172.21.15.28:0/1245859968 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc0a68d0 con 0x7faeb00039c0 2024-04-23T18:28:20.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faed2000640 1 -- 172.21.15.28:0/1245859968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faeb00039c0 msgr2=0x7faeb0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:20.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faed2000640 1 --2- 172.21.15.28:0/1245859968 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faeb00039c0 0x7faeb0003de0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faebc009ae0 tx=0x7faebc01cab0 comp rx=0 tx=0).stop 2024-04-23T18:28:20.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faecbe00640 1 -- 172.21.15.28:0/1245859968 reap_dead start 2024-04-23T18:28:20.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faed2000640 1 -- 172.21.15.28:0/1245859968 shutdown_connections 2024-04-23T18:28:20.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faed2000640 1 -- 172.21.15.28:0/1245859968 >> 172.21.15.28:0/1245859968 conn(0x7faecc06d400 msgr2=0x7faecc0676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:20.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faed2000640 1 -- 172.21.15.28:0/1245859968 shutdown_connections 2024-04-23T18:28:20.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faed2000640 1 -- 172.21.15.28:0/1245859968 wait complete. 2024-04-23T18:28:20.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faed2000640 1 Processor -- start 2024-04-23T18:28:20.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.941+0000 7faed2000640 1 -- start start 2024-04-23T18:28:20.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faed2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00039c0 0x7faecc0c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faed2000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc1f0830 0x7faecc14d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faed2000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc145e40 0x7faecc1f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faed2000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7faecc072cc0 con 0x7faecc145e40 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faed2000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0729e0 con 0x7faeb00039c0 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faed2000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7faecc0738f0 con 0x7faecc1f0830 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faecbe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc145e40 0x7faecc1f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faecbe00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc145e40 0x7faecc1f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53294/0 (socket says 172.21.15.28:53294) 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faecbe00640 1 -- 172.21.15.28:0/1763097628 learned_addr learned my addr 172.21.15.28:0/1763097628 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faec2a00640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc1f0830 0x7faecc14d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faecb400640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00039c0 0x7faecc0c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faecbe00640 1 -- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc1f0830 msgr2=0x7faecc14d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faecbe00640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc1f0830 0x7faecc14d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faecbe00640 1 -- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00039c0 msgr2=0x7faecc0c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:20.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faecbe00640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00039c0 0x7faecc0c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faecbe00640 1 -- 172.21.15.28:0/1763097628 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc159aa0 con 0x7faecc145e40 2024-04-23T18:28:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faecbe00640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc145e40 0x7faecc1f4570 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7faec4011790 tx=0x7faec4011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faec3e00640 1 -- 172.21.15.28:0/1763097628 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4010040 con 0x7faecc145e40 2024-04-23T18:28:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faec3e00640 1 -- 172.21.15.28:0/1763097628 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faec401a070 con 0x7faecc145e40 2024-04-23T18:28:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faec3e00640 1 -- 172.21.15.28:0/1763097628 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec400fb70 con 0x7faecc145e40 2024-04-23T18:28:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faed2000640 1 -- 172.21.15.28:0/1763097628 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc1f0d70 con 0x7faecc145e40 2024-04-23T18:28:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faed2000640 1 -- 172.21.15.28:0/1763097628 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc1f1330 con 0x7faecc145e40 2024-04-23T18:28:20.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.945+0000 7faed2000640 1 -- 172.21.15.28:0/1763097628 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faecc068e50 con 0x7faecc145e40 2024-04-23T18:28:20.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.949+0000 7faec3e00640 1 -- 172.21.15.28:0/1763097628 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faec400fd10 con 0x7faecc145e40 2024-04-23T18:28:20.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.949+0000 7faec3e00640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faea80683b0 0x7faea806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:20.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.949+0000 7faec3e00640 1 -- 172.21.15.28:0/1763097628 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6555+0+0 (secure 0 0 0) 0x7faec4089cb0 con 0x7faecc145e40 2024-04-23T18:28:20.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.949+0000 7faecb400640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faea80683b0 0x7faea806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:20.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.949+0000 7faecb400640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faea80683b0 0x7faea806a870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faebc0af000 tx=0x7faebc0046d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:20.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:20.953+0000 7faec3e00640 1 -- 172.21.15.28:0/1763097628 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faec4059df0 con 0x7faecc145e40 2024-04-23T18:28:21.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.121+0000 7faed2000640 1 -- 172.21.15.28:0/1763097628 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7faecc071300 con 0x7faecc145e40 2024-04-23T18:28:21.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.769+0000 7faec3e00640 1 -- 172.21.15.28:0/1763097628 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7faec40596f0 con 0x7faecc145e40 2024-04-23T18:28:21.765 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2024-04-23T18:28:21.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 -- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faea80683b0 msgr2=0x7faea806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:21.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faea80683b0 0x7faea806a870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faebc0af000 tx=0x7faebc0046d0 comp rx=0 tx=0).stop 2024-04-23T18:28:21.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 -- 172.21.15.28:0/1763097628 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc145e40 msgr2=0x7faecc1f4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:21.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc145e40 0x7faecc1f4570 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7faec4011790 tx=0x7faec4011c50 comp rx=0 tx=0).stop 2024-04-23T18:28:21.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 -- 172.21.15.28:0/1763097628 shutdown_connections 2024-04-23T18:28:21.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7faea80683b0 0x7faea806a870 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:21.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faecc1f0830 0x7faecc14d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:21.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faecc145e40 0x7faecc1f4570 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:21.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 --2- 172.21.15.28:0/1763097628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00039c0 0x7faecc0c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:21.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 -- 172.21.15.28:0/1763097628 >> 172.21.15.28:0/1763097628 conn(0x7faecc06d400 msgr2=0x7faecc14f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:21.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 -- 172.21.15.28:0/1763097628 shutdown_connections 2024-04-23T18:28:21.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.773+0000 7faed2000640 1 -- 172.21.15.28:0/1763097628 wait complete. 2024-04-23T18:28:21.795 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-23T18:28:21.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.961+0000 7f7099000640 1 Processor -- start 2024-04-23T18:28:21.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.961+0000 7f7099000640 1 -- start start 2024-04-23T18:28:21.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.961+0000 7f7099000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7094157e30 0x7f7094071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:21.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.961+0000 7f7099000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7094071030 0x7f7094151200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:21.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.961+0000 7f7099000640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70940c7b30 con 0x7f7094067e90 2024-04-23T18:28:21.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.961+0000 7f7099000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7094071b50 con 0x7f7094157e30 2024-04-23T18:28:21.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.961+0000 7f7099000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f70941579a0 con 0x7f7094071030 2024-04-23T18:28:21.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7091e00640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7094067e90 0x7f709415b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47686/0 (socket says 172.21.15.28:47686) 2024-04-23T18:28:21.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7091e00640 1 -- 172.21.15.28:0/2470145141 learned_addr learned my addr 172.21.15.28:0/2470145141 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-04-23T18:28:21.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7091400640 1 --2- 172.21.15.28:0/2470145141 >> v2:172.21.15.137:3300/0 conn(0x7f7094157e30 0x7f7094071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:21.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7092800640 1 --2- 172.21.15.28:0/2470145141 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7094071030 0x7f7094151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:21.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7090a00640 1 -- 172.21.15.28:0/2470145141 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2817143417 0 0) 0x7f70940c7b30 con 0x7f7094067e90 2024-04-23T18:28:21.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7090a00640 1 -- 172.21.15.28:0/2470145141 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7078003530 con 0x7f7094067e90 2024-04-23T18:28:21.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7091400640 1 -- 172.21.15.28:0/2470145141 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7094071030 msgr2=0x7f7094151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T18:28:21.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7091400640 1 --2- 172.21.15.28:0/2470145141 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7094071030 0x7f7094151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:21.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7091400640 1 -- 172.21.15.28:0/2470145141 >> v1:172.21.15.28:6789/0 conn(0x7f7094067e90 legacy=0x7f709415b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:21.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7090a00640 1 -- 172.21.15.28:0/2470145141 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2533938253 0 0) 0x7f7078003530 con 0x7f7094067e90 2024-04-23T18:28:21.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7091400640 1 -- 172.21.15.28:0/2470145141 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7094157350 con 0x7f7094157e30 2024-04-23T18:28:21.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.965+0000 7f7092800640 1 --2- 172.21.15.28:0/2470145141 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7094071030 0x7f7094151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T18:28:21.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7091400640 1 --2- 172.21.15.28:0/2470145141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7094157e30 0x7f7094071610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f707c009d90 tx=0x7f707c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc96a8613bb9b162 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:21.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7090a00640 1 -- 172.21.15.28:0/2470145141 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c0ac070 con 0x7f7094157e30 2024-04-23T18:28:21.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7090a00640 1 -- 172.21.15.28:0/2470145141 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f707c0a64a0 con 0x7f7094157e30 2024-04-23T18:28:21.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7090a00640 1 -- 172.21.15.28:0/2470145141 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c001680 con 0x7f7094157e30 2024-04-23T18:28:21.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7099000640 1 -- 172.21.15.28:0/2470145141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7094157e30 msgr2=0x7f7094071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:21.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7099000640 1 --2- 172.21.15.28:0/2470145141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7094157e30 0x7f7094071610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f707c009d90 tx=0x7f707c01c890 comp rx=0 tx=0).stop 2024-04-23T18:28:21.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7099000640 1 -- 172.21.15.28:0/2470145141 shutdown_connections 2024-04-23T18:28:21.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7099000640 1 --2- 172.21.15.28:0/2470145141 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7094071030 0x7f7094151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:21.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7099000640 1 --2- 172.21.15.28:0/2470145141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7094157e30 0x7f7094071610 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:21.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7099000640 1 -- 172.21.15.28:0/2470145141 >> 172.21.15.28:0/2470145141 conn(0x7f709406d400 msgr2=0x7f70940676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:21.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7099000640 1 -- 172.21.15.28:0/2470145141 shutdown_connections 2024-04-23T18:28:21.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7099000640 1 -- 172.21.15.28:0/2470145141 wait complete. 2024-04-23T18:28:21.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7099000640 1 Processor -- start 2024-04-23T18:28:21.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.969+0000 7f7099000640 1 -- start start 2024-04-23T18:28:21.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7099000640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7094067e90 0x7f709415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:21.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7099000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7094071030 0x7f7094153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:21.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7099000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7094157e30 0x7f7094153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:21.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7099000640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 -- 0x7f709415daa0 con 0x7f7094067e90 2024-04-23T18:28:21.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7099000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70940c9ad0 con 0x7f7094071030 2024-04-23T18:28:21.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7099000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 -- 0x7f709415dc20 con 0x7f7094157e30 2024-04-23T18:28:21.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7091e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7094067e90 0x7f709415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:21.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7091e00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7094067e90 0x7f709415adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53296/0 (socket says 172.21.15.28:53296) 2024-04-23T18:28:21.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7091e00640 1 -- 172.21.15.28:0/3864871319 learned_addr learned my addr 172.21.15.28:0/3864871319 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-04-23T18:28:21.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7092800640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7094157e30 0x7f7094153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:21.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7091400640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7094071030 0x7f7094153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:21.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7091e00640 1 -- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7094157e30 msgr2=0x7f7094153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:21.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7091e00640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7094157e30 0x7f7094153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:21.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7091e00640 1 -- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7094071030 msgr2=0x7f7094153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:21.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7091e00640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7094071030 0x7f7094153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:21.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7091e00640 1 -- 172.21.15.28:0/3864871319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70941f88b0 con 0x7f7094067e90 2024-04-23T18:28:21.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7091e00640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7094067e90 0x7f709415adf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f708c00c780 tx=0x7f708c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:21.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f708a000640 1 -- 172.21.15.28:0/3864871319 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c005ae0 con 0x7f7094067e90 2024-04-23T18:28:21.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f708a000640 1 -- 172.21.15.28:0/3864871319 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f708c005ca0 con 0x7f7094067e90 2024-04-23T18:28:21.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7099000640 1 -- 172.21.15.28:0/3864871319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70941fc8c0 con 0x7f7094067e90 2024-04-23T18:28:21.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f708a000640 1 -- 172.21.15.28:0/3864871319 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c0072d0 con 0x7f7094067e90 2024-04-23T18:28:21.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7099000640 1 -- 172.21.15.28:0/3864871319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70941f8e30 con 0x7f7094067e90 2024-04-23T18:28:21.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f7099000640 1 -- 172.21.15.28:0/3864871319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7094068e50 con 0x7f7094067e90 2024-04-23T18:28:21.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.973+0000 7f708a000640 1 -- 172.21.15.28:0/3864871319 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f708c007470 con 0x7f7094067e90 2024-04-23T18:28:21.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.977+0000 7f708a000640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70700683b0 0x7f707006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:21.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.977+0000 7f708a000640 1 -- 172.21.15.28:0/3864871319 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6025+0+0 (secure 0 0 0) 0x7f708c086aa0 con 0x7f7094067e90 2024-04-23T18:28:21.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.977+0000 7f7091400640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70700683b0 0x7f707006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:21.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.977+0000 7f7091400640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70700683b0 0x7f707006a870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f707c0ae000 tx=0x7f707c0a7000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:21.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:21.981+0000 7f708a000640 1 -- 172.21.15.28:0/3864871319 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f708c088e20 con 0x7f7094067e90 2024-04-23T18:28:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.145+0000 7f7099000640 1 -- 172.21.15.28:0/3864871319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f70940c8300 con 0x7f7094067e90 2024-04-23T18:28:22.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.781+0000 7f708a000640 1 -- 172.21.15.28:0/3864871319 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f708c056e80 con 0x7f7094067e90 2024-04-23T18:28:22.776 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data_ec' removed 2024-04-23T18:28:22.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 -- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70700683b0 msgr2=0x7f707006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:22.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70700683b0 0x7f707006a870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f707c0ae000 tx=0x7f707c0a7000 comp rx=0 tx=0).stop 2024-04-23T18:28:22.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 -- 172.21.15.28:0/3864871319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7094067e90 msgr2=0x7f709415adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:22.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7094067e90 0x7f709415adf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f708c00c780 tx=0x7f708c00cc40 comp rx=0 tx=0).stop 2024-04-23T18:28:22.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 -- 172.21.15.28:0/3864871319 shutdown_connections 2024-04-23T18:28:22.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:6832/2489193639,v1:172.21.15.137:6833/2489193639] conn(0x7f70700683b0 0x7f707006a870 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:22.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7094157e30 0x7f7094153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:22.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7094071030 0x7f7094153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:22.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 --2- 172.21.15.28:0/3864871319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7094067e90 0x7f709415adf0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:22.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 -- 172.21.15.28:0/3864871319 >> 172.21.15.28:0/3864871319 conn(0x7f709406d400 msgr2=0x7f70940676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:22.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 -- 172.21.15.28:0/3864871319 shutdown_connections 2024-04-23T18:28:22.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-04-23T18:28:22.785+0000 7f7099000640 1 -- 172.21.15.28:0/3864871319 wait complete. 2024-04-23T18:28:22.800 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-23T18:28:22.801 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-23T18:28:22.801 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:22.813 INFO:tasks.ceph.mds.a:Stopped 2024-04-23T18:28:22.814 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-23T18:28:22.814 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:22.874 INFO:tasks.ceph.mds.c:Stopped 2024-04-23T18:28:22.874 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-23T18:28:22.874 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:22.929 INFO:tasks.ceph.mds.e:Stopped 2024-04-23T18:28:22.929 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-23T18:28:22.929 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:22.940 INFO:tasks.ceph.mds.b:Stopped 2024-04-23T18:28:22.940 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-23T18:28:22.940 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:22.992 INFO:tasks.ceph.mds.d:Stopped 2024-04-23T18:28:22.992 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-23T18:28:22.992 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:23.049 INFO:tasks.ceph.mds.f:Stopped 2024-04-23T18:28:23.049 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-23T18:28:23.050 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-23T18:28:23.050 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:23.139 INFO:tasks.ceph.osd.0:Stopped 2024-04-23T18:28:23.139 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-23T18:28:23.139 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:25.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-23T18:28:28.828 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:28:28.832 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:28:29.241 INFO:tasks.ceph.osd.1:Stopped 2024-04-23T18:28:29.241 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-23T18:28:29.241 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:29.321 INFO:tasks.ceph.osd.2:Stopped 2024-04-23T18:28:29.321 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-23T18:28:29.321 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:31.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-23T18:28:31.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-23T18:28:35.422 INFO:tasks.ceph.osd.3:Stopped 2024-04-23T18:28:35.423 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-23T18:28:35.423 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:35.493 INFO:tasks.ceph.osd.4:Stopped 2024-04-23T18:28:35.494 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-23T18:28:35.494 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:36.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-23T18:28:36.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-23T18:28:41.595 INFO:tasks.ceph.osd.5:Stopped 2024-04-23T18:28:41.596 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-23T18:28:41.596 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:41.687 INFO:tasks.ceph.osd.6:Stopped 2024-04-23T18:28:41.687 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-23T18:28:41.687 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:41.776 INFO:tasks.ceph.osd.7:Stopped 2024-04-23T18:28:41.776 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-23T18:28:41.776 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-23T18:28:41.776 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:41.833 INFO:tasks.ceph.mgr.y:Stopped 2024-04-23T18:28:41.833 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-23T18:28:41.833 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:41.862 INFO:tasks.ceph.mgr.x:Stopped 2024-04-23T18:28:41.862 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-23T18:28:41.863 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-23T18:28:41.863 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:41.883 INFO:tasks.ceph.mon.a:Stopped 2024-04-23T18:28:41.883 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-23T18:28:41.883 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:41.920 INFO:tasks.ceph.mon.b:Stopped 2024-04-23T18:28:41.920 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-23T18:28:41.920 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:28:41.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-23T18:28:41.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-23T18:28:41.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-23T18:28:41.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-23T18:28:41.979 INFO:tasks.ceph.mon.c:Stopped 2024-04-23T18:28:41.979 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-23T18:28:41.980 DEBUG:teuthology.orchestra.run.smithi028:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-23T18:28:42.030 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:28:42.030 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-23T18:28:42.302 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:28:42.302 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-23T18:28:42.537 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:28:42.537 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-23T18:28:42.716 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:28:42.716 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-23T18:28:42.897 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T18:28:42.897 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-23T18:28:43.291 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T18:28:43.291 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-23T18:28:43.517 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T18:28:43.517 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-23T18:28:43.703 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T18:28:43.703 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-23T18:28:43.859 INFO:tasks.ceph:Archiving mon data... 2024-04-23T18:28:43.860 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106/data/mon.a.tgz 2024-04-23T18:28:43.860 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-04-23T18:28:43.870 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.4bISahEomI 2024-04-23T18:28:43.870 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4bISahEomI 2024-04-23T18:28:44.007 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.4bISahEomI 2024-04-23T18:28:44.082 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.4bISahEomI is 345KB 2024-04-23T18:28:44.151 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.4bISahEomI 2024-04-23T18:28:44.160 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106/data/mon.b.tgz 2024-04-23T18:28:44.160 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-04-23T18:28:44.166 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.fVhcc2KyV0 2024-04-23T18:28:44.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.fVhcc2KyV0 2024-04-23T18:28:44.324 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.fVhcc2KyV0 2024-04-23T18:28:44.386 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.fVhcc2KyV0 is 461KB 2024-04-23T18:28:44.448 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.fVhcc2KyV0 2024-04-23T18:28:44.453 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106/data/mon.c.tgz 2024-04-23T18:28:44.453 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-04-23T18:28:44.501 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.Ax12P0UDHN 2024-04-23T18:28:44.502 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Ax12P0UDHN 2024-04-23T18:28:44.658 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.Ax12P0UDHN 2024-04-23T18:28:44.721 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.Ax12P0UDHN is 461KB 2024-04-23T18:28:44.783 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.Ax12P0UDHN 2024-04-23T18:28:44.789 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-23T18:28:44.789 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T18:28:44.793 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T18:28:44.861 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T18:28:44.898 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T18:28:44.898 INFO:tasks.ceph:Archiving crash dumps... 2024-04-23T18:28:44.900 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106/remote/smithi028/crash 2024-04-23T18:28:44.901 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T18:28:44.925 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106/remote/smithi137/crash 2024-04-23T18:28:44.926 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T18:28:44.953 INFO:tasks.ceph:Shutting down logrotate 2024-04-23T18:28:44.953 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:28:44.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T18:28:45.044 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-23T18:28:45.066 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-23T18:28:45.078 INFO:tasks.ceph:Compressing logs... 2024-04-23T18:28:45.078 DEBUG:teuthology.orchestra.run.smithi028:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T18:28:45.112 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T18:28:45.142 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36715.log 2024-04-23T18:28:45.142 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33193.log 2024-04-23T18:28:45.143 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36533.log 2024-04-23T18:28:45.144 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36715.log.gz 2024-04-23T18:28:45.144 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32120.log 2024-04-23T18:28:45.144 INFO:teuthology.orchestra.run.smithi028.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33193.log.gz 2024-04-23T18:28:45.145 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34802.log 2024-04-23T18:28:45.146 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36533.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36533.log.gz 2024-04-23T18:28:45.146 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33395.log 2024-04-23T18:28:45.146 INFO:teuthology.orchestra.run.smithi028.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32120.log.gz 2024-04-23T18:28:45.147 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36429.log 2024-04-23T18:28:45.147 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34802.log.gz 2024-04-23T18:28:45.148 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33395.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-23T18:28:45.148 INFO:teuthology.orchestra.run.smithi028.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33395.log.gz 2024-04-23T18:28:45.149 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36061.log 2024-04-23T18:28:45.149 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36429.log.gz 2024-04-23T18:28:45.150 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33401.log 2024-04-23T18:28:45.151 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36153.log 2024-04-23T18:28:45.151 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36061.log.gz 2024-04-23T18:28:45.151 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28090.log 2024-04-23T18:28:45.152 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34646.log 2024-04-23T18:28:45.152 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33401.log.gz 2024-04-23T18:28:45.156 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34409.log 2024-04-23T18:28:45.156 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36153.log.gz 2024-04-23T18:28:45.156 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34348.log 2024-04-23T18:28:45.156 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34646.log.gz 2024-04-23T18:28:45.156 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36845.log 2024-04-23T18:28:45.156 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34409.log.gz 2024-04-23T18:28:45.156 INFO:teuthology.orchestra.run.smithi028.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-23T18:28:45.156 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36767.log 2024-04-23T18:28:45.162 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28130.log 2024-04-23T18:28:45.162 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28202.log 2024-04-23T18:28:45.162 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28130.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28090.log.gz 2024-04-23T18:28:45.162 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28178.log 2024-04-23T18:28:45.162 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28130.log.gz 2024-04-23T18:28:45.162 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-23T18:28:45.162 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28202.log: /var/log/ceph/ceph-client.admin.28178.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28202.log.gz 2024-04-23T18:28:45.162 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-23T18:28:45.162 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28178.log.gz 2024-04-23T18:28:45.162 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28274.log 2024-04-23T18:28:45.162 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28226.log 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28274.log.gz 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28154.log 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28226.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28226.log.gz 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28154.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28154.log.gz 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.audit.log: 93.3% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-23T18:28:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-23T18:28:45.164 INFO:teuthology.orchestra.run.smithi137.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-23T18:28:45.164 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-23T18:28:45.164 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mds.b.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-23T18:28:45.166 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-23T18:28:45.168 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36845.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.34348.log.gz 2024-04-23T18:28:45.168 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33198.log 2024-04-23T18:28:45.168 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36845.log.gz 2024-04-23T18:28:45.168 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32616.log 2024-04-23T18:28:45.168 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36767.log.gz 2024-04-23T18:28:45.168 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33198.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-23T18:28:45.168 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33198.log.gz 2024-04-23T18:28:45.168 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32934.log 2024-04-23T18:28:45.168 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32616.log.gz 2024-04-23T18:28:45.168 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35981.log 2024-04-23T18:28:45.168 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31880.log 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32934.log.gz 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35088.log 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35981.log.gz 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36689.log 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31880.log.gz 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32747.log 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35088.log.gz 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34245.log 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36689.log.gz 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32590.log 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32747.log.gz 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33616.log 2024-04-23T18:28:45.169 INFO:teuthology.orchestra.run.smithi028.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34245.log.gz 2024-04-23T18:28:45.170 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33197.log 2024-04-23T18:28:45.170 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32590.log.gz 2024-04-23T18:28:45.170 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35219.log 2024-04-23T18:28:45.171 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33616.log.gz 2024-04-23T18:28:45.172 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27476.log 2024-04-23T18:28:45.172 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33197.log.gz 2024-04-23T18:28:45.172 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34219.log 2024-04-23T18:28:45.172 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35219.log.gz 2024-04-23T18:28:45.172 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.27476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36741.log 2024-04-23T18:28:45.172 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34219.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.27476.log.gz 2024-04-23T18:28:45.172 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31678.log 2024-04-23T18:28:45.172 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34219.log.gz 2024-04-23T18:28:45.173 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36819.log 2024-04-23T18:28:45.173 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36741.log.gz 2024-04-23T18:28:45.173 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32224.log 2024-04-23T18:28:45.174 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31678.log.gz 2024-04-23T18:28:45.174 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35825.log 2024-04-23T18:28:45.174 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36819.log.gz 2024-04-23T18:28:45.175 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33414.log 2024-04-23T18:28:45.175 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32224.log.gz 2024-04-23T18:28:45.176 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32066.log 2024-04-23T18:28:45.176 INFO:teuthology.orchestra.run.smithi028.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35825.log.gz 2024-04-23T18:28:45.177 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35434.log 2024-04-23T18:28:45.177 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28250.log 2024-04-23T18:28:45.178 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33414.log.gz 2024-04-23T18:28:45.178 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37028.log 2024-04-23T18:28:45.178 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32066.log.gz 2024-04-23T18:28:45.179 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36793.log 2024-04-23T18:28:45.179 INFO:teuthology.orchestra.run.smithi028.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35434.log.gz 2024-04-23T18:28:45.180 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37028.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-23T18:28:45.180 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37028.log.gz 2024-04-23T18:28:45.181 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32172.log 2024-04-23T18:28:45.181 INFO:teuthology.orchestra.run.smithi028.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36793.log.gz 2024-04-23T18:28:45.182 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36585.log 2024-04-23T18:28:45.183 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36952.log 2024-04-23T18:28:45.183 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32172.log.gz 2024-04-23T18:28:45.184 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32642.log 2024-04-23T18:28:45.184 INFO:teuthology.orchestra.run.smithi028.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36585.log.gz 2024-04-23T18:28:45.185 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36180.log 2024-04-23T18:28:45.185 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36952.log.gz 2024-04-23T18:28:45.186 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35931.log 2024-04-23T18:28:45.186 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32642.log.gz 2024-04-23T18:28:45.187 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36180.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-23T18:28:45.187 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35931.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36180.log.gz 2024-04-23T18:28:45.188 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33802.log 2024-04-23T18:28:45.189 INFO:teuthology.orchestra.run.smithi028.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35931.log.gz 2024-04-23T18:28:45.189 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32960.log 2024-04-23T18:28:45.190 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.33802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32986.log 2024-04-23T18:28:45.190 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33802.log.gz 2024-04-23T18:28:45.191 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34672.log 2024-04-23T18:28:45.192 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32960.log.gz 2024-04-23T18:28:45.192 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31797.log 2024-04-23T18:28:45.193 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32986.log.gz 2024-04-23T18:28:45.193 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32094.log 2024-04-23T18:28:45.194 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34672.log.gz 2024-04-23T18:28:45.195 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31797.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31797.log.gz 2024-04-23T18:28:45.195 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33407.log 2024-04-23T18:28:45.196 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35036.log 2024-04-23T18:28:45.196 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32094.log: /var/log/ceph/ceph-client.admin.33407.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32094.log.gz 2024-04-23T18:28:45.197 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34750.log 2024-04-23T18:28:45.197 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33407.log.gz 2024-04-23T18:28:45.198 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.28250.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28250.log.gz 2024-04-23T18:28:45.199 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31958.log 2024-04-23T18:28:45.199 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35036.log.gz 2024-04-23T18:28:45.199 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35192.log 2024-04-23T18:28:45.199 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34750.log.gz 2024-04-23T18:28:45.200 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31854.log/var/log/ceph/ceph-client.admin.31958.log: 2024-04-23T18:28:45.201 INFO:teuthology.orchestra.run.smithi137.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-23T18:28:45.201 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35192.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31958.log.gz 2024-04-23T18:28:45.202 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35355.log 2024-04-23T18:28:45.202 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35192.log.gz 2024-04-23T18:28:45.202 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31932.log 2024-04-23T18:28:45.203 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31854.log.gz 2024-04-23T18:28:45.204 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32146.log 2024-04-23T18:28:45.204 INFO:teuthology.orchestra.run.smithi028.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35355.log.gz 2024-04-23T18:28:45.205 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34115.log 2024-04-23T18:28:45.205 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31932.log.gz 2024-04-23T18:28:45.206 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.32146.log: -- /var/log/ceph/ceph-client.admin.32721.log 2024-04-23T18:28:45.206 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32146.log.gz 2024-04-23T18:28:45.207 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33880.log 2024-04-23T18:28:45.207 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34115.log.gz 2024-04-23T18:28:45.208 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33014.log 2024-04-23T18:28:45.208 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32721.log.gz 2024-04-23T18:28:45.209 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33880.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33880.log.gz 2024-04-23T18:28:45.209 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36088.log 2024-04-23T18:28:45.210 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34698.log 2024-04-23T18:28:45.211 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33014.log.gz 2024-04-23T18:28:45.211 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35062.log 2024-04-23T18:28:45.212 INFO:teuthology.orchestra.run.smithi028.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36088.log.gz 2024-04-23T18:28:45.213 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36897.log 2024-04-23T18:28:45.213 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34698.log.gz 2024-04-23T18:28:45.213 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34193.log 2024-04-23T18:28:45.214 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35062.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35062.log.gz 2024-04-23T18:28:45.215 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36284.log 2024-04-23T18:28:45.215 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36897.log.gz 2024-04-23T18:28:45.216 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32799.log 2024-04-23T18:28:45.216 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34193.log.gz 2024-04-23T18:28:45.217 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31906.log 2024-04-23T18:28:45.217 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36284.log.gz 2024-04-23T18:28:45.218 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31622.log 2024-04-23T18:28:45.218 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32799.log.gz 2024-04-23T18:28:45.219 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34568.log 2024-04-23T18:28:45.219 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31906.log.gz 2024-04-23T18:28:45.220 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32882.log 2024-04-23T18:28:45.221 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31622.log.gz 2024-04-23T18:28:45.221 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37080.log 2024-04-23T18:28:45.222 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34568.log.gz 2024-04-23T18:28:45.223 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36310.log 2024-04-23T18:28:45.223 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32882.log.gz 2024-04-23T18:28:45.223 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33598.log 2024-04-23T18:28:45.224 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37080.log: /var/log/ceph/ceph-client.admin.36310.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37080.log.gz 2024-04-23T18:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-23T18:28:45.225 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36310.log.gz 2024-04-23T18:28:45.226 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34958.log 2024-04-23T18:28:45.226 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33598.log.gz 2024-04-23T18:28:45.227 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33186.log 2024-04-23T18:28:45.228 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.34958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36232.log 2024-04-23T18:28:45.228 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34958.log.gz 2024-04-23T18:28:45.229 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37054.log 2024-04-23T18:28:45.230 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33186.log.gz 2024-04-23T18:28:45.230 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36362.log 2024-04-23T18:28:45.231 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36232.log.gz 2024-04-23T18:28:45.231 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27688.log 2024-04-23T18:28:45.232 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37054.log.gz 2024-04-23T18:28:45.232 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33621.log 2024-04-23T18:28:45.233 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36362.log.gz 2024-04-23T18:28:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.27688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35490.log 2024-04-23T18:28:45.234 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27688.log.gz 2024-04-23T18:28:45.234 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32250.log 2024-04-23T18:28:45.235 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33621.log.gz 2024-04-23T18:28:45.236 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35114.log 2024-04-23T18:28:45.236 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35490.log.gz 2024-04-23T18:28:45.237 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33932.log 2024-04-23T18:28:45.237 INFO:teuthology.orchestra.run.smithi028.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32250.log.gz 2024-04-23T18:28:45.238 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34906.log 2024-04-23T18:28:45.238 INFO:teuthology.orchestra.run.smithi028.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35114.log.gz 2024-04-23T18:28:45.239 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33828.log 2024-04-23T18:28:45.239 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33932.log.gz 2024-04-23T18:28:45.240 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34906.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-23T18:28:45.240 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34906.log.gz 2024-04-23T18:28:45.241 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31986.log 2024-04-23T18:28:45.242 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33828.log.gz 2024-04-23T18:28:45.242 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34880.log 2024-04-23T18:28:45.244 INFO:teuthology.orchestra.run.smithi137.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-23T18:28:45.244 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35255.log 2024-04-23T18:28:45.244 INFO:teuthology.orchestra.run.smithi028.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31986.log.gz 2024-04-23T18:28:45.245 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34880.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34880.log.gz 2024-04-23T18:28:45.246 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34037.log 2024-04-23T18:28:45.247 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36976.log 2024-04-23T18:28:45.247 INFO:teuthology.orchestra.run.smithi028.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.35255.log.gz 2024-04-23T18:28:45.248 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35140.log 2024-04-23T18:28:45.248 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34037.log.gz 2024-04-23T18:28:45.249 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36976.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36976.log.gz 2024-04-23T18:28:45.250 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36481.log 2024-04-23T18:28:45.251 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35140.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35140.log.gz 2024-04-23T18:28:45.251 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36507.log 2024-04-23T18:28:45.252 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27585.log 2024-04-23T18:28:45.253 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36481.log.gz 2024-04-23T18:28:45.253 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35305.log 2024-04-23T18:28:45.254 INFO:teuthology.orchestra.run.smithi028.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36507.log.gz 2024-04-23T18:28:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.27585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35715.log 2024-04-23T18:28:45.255 INFO:teuthology.orchestra.run.smithi028.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27585.log.gz 2024-04-23T18:28:45.256 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33597.log 2024-04-23T18:28:45.257 INFO:teuthology.orchestra.run.smithi028.stderr: 91.3%/var/log/ceph/ceph-client.admin.35715.log: -- replaced with /var/log/ceph/ceph-client.admin.35305.log.gz 2024-04-23T18:28:45.257 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31714.log 2024-04-23T18:28:45.257 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35715.log.gz 2024-04-23T18:28:45.258 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34620.log 2024-04-23T18:28:45.258 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33597.log.gz 2024-04-23T18:28:45.260 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33397.log 2024-04-23T18:28:45.260 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31714.log.gz 2024-04-23T18:28:45.261 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37177.log 2024-04-23T18:28:45.261 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34620.log.gz 2024-04-23T18:28:45.262 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33397.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T18:28:45.262 INFO:teuthology.orchestra.run.smithi028.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33397.log.gz 2024-04-23T18:28:45.263 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35407.log 2024-04-23T18:28:45.263 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37177.log.gz 2024-04-23T18:28:45.264 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37002.log 2024-04-23T18:28:45.266 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35407.log: 86.3% 89.0% -- replaced with /var/log/ceph/ceph.log.gz -- replaced with /var/log/ceph/ceph-client.admin.35407.log.gz 2024-04-23T18:28:45.266 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-04-23T18:28:45.267 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37002.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37002.log.gz 2024-04-23T18:28:45.267 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34984.log 2024-04-23T18:28:45.268 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32538.log 2024-04-23T18:28:45.270 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32773.log 2024-04-23T18:28:45.270 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34984.log.gz 2024-04-23T18:28:45.271 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36258.log 2024-04-23T18:28:45.271 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32538.log.gz 2024-04-23T18:28:45.272 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33906.log 2024-04-23T18:28:45.272 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32773.log.gz 2024-04-23T18:28:45.274 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36258.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36258.log.gz 2024-04-23T18:28:45.274 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33906.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33906.log.gz 2024-04-23T18:28:45.275 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32564.log 2024-04-23T18:28:45.276 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32856.log 2024-04-23T18:28:45.277 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36455.log 2024-04-23T18:28:45.277 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32564.log.gz 2024-04-23T18:28:45.278 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32856.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32856.log.gz 2024-04-23T18:28:45.279 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33609.log 2024-04-23T18:28:45.280 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36455.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36455.log.gz 2024-04-23T18:28:45.280 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33619.log 2024-04-23T18:28:45.282 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34932.log 2024-04-23T18:28:45.282 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33609.log.gz 2024-04-23T18:28:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34063.log 2024-04-23T18:28:45.283 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33619.log.gz 2024-04-23T18:28:45.284 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34932.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34932.log.gz 2024-04-23T18:28:45.285 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36403.log 2024-04-23T18:28:45.285 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34063.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34063.log.gz 2024-04-23T18:28:45.286 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36663.log 2024-04-23T18:28:45.287 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37106.log 2024-04-23T18:28:45.288 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36403.log.gz 2024-04-23T18:28:45.288 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36663.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36663.log.gz 2024-04-23T18:28:45.289 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37106.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37106.log.gz 2024-04-23T18:28:45.290 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37151.log 2024-04-23T18:28:45.291 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32198.log 2024-04-23T18:28:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32276.log 2024-04-23T18:28:45.293 INFO:teuthology.orchestra.run.smithi028.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37151.log.gz 2024-04-23T18:28:45.293 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32198.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32198.log.gz 2024-04-23T18:28:45.295 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32276.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.32276.log.gz 2024-04-23T18:28:45.296 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34525.log 2024-04-23T18:28:45.297 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33958.log 2024-04-23T18:28:45.298 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.34525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35594.log 2024-04-23T18:28:45.298 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34525.log.gz 2024-04-23T18:28:45.299 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33958.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33958.log.gz 2024-04-23T18:28:45.301 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35594.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.35594.log.gz 2024-04-23T18:28:45.301 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34298.log 2024-04-23T18:28:45.302 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33854.log 2024-04-23T18:28:45.303 INFO:teuthology.orchestra.run.smithi137.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-23T18:28:45.305 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37203.log 2024-04-23T18:28:45.305 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33854.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34298.log.gz 2024-04-23T18:28:45.305 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36559.log 2024-04-23T18:28:45.305 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33854.log.gz 2024-04-23T18:28:45.307 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37203.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37203.log.gz 2024-04-23T18:28:45.307 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33183.log 2024-04-23T18:28:45.308 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36559.log.gz 2024-04-23T18:28:45.308 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32830.log 2024-04-23T18:28:45.310 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32326.log 2024-04-23T18:28:45.310 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33183.log.gz 2024-04-23T18:28:45.310 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32830.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32830.log.gz 2024-04-23T18:28:45.312 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32326.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32326.log.gz 2024-04-23T18:28:45.312 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T18:28:45.313 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-23T18:28:45.316 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-23T18:28:45.316 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mds.c.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-23T18:28:45.317 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mds.a.log: 93.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-23T18:28:45.321 INFO:teuthology.orchestra.run.smithi028.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-23T18:28:45.322 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36871.log 2024-04-23T18:28:45.322 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36923.log 2024-04-23T18:28:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35852.log 2024-04-23T18:28:45.323 INFO:teuthology.orchestra.run.smithi028.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36871.log.gz 2024-04-23T18:28:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36923.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36923.log.gz 2024-04-23T18:28:45.324 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35852.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35852.log.gz 2024-04-23T18:28:45.324 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33985.log 2024-04-23T18:28:45.325 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32014.log 2024-04-23T18:28:45.327 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32669.log 2024-04-23T18:28:45.327 INFO:teuthology.orchestra.run.smithi028.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33985.log.gz 2024-04-23T18:28:45.328 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32014.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32014.log.gz 2024-04-23T18:28:45.329 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32669.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32669.log.gz 2024-04-23T18:28:45.330 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34724.log 2024-04-23T18:28:45.331 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32908.log 2024-04-23T18:28:45.332 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2024-04-23T18:28:45.333 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34724.log.gz 2024-04-23T18:28:45.333 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32908.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32908.log.gz 2024-04-23T18:28:45.334 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32695.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2024-04-23T18:28:45.335 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33118.log 2024-04-23T18:28:45.336 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34776.log 2024-04-23T18:28:45.338 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36637.log 2024-04-23T18:28:45.338 INFO:teuthology.orchestra.run.smithi028.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33118.log.gz 2024-04-23T18:28:45.338 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34776.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34776.log.gz 2024-04-23T18:28:45.340 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36637.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36637.log.gz 2024-04-23T18:28:45.340 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33040.log 2024-04-23T18:28:45.341 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33066.log 2024-04-23T18:28:45.343 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32040.log 2024-04-23T18:28:45.343 INFO:teuthology.orchestra.run.smithi028.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33040.log.gz 2024-04-23T18:28:45.344 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33066.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33066.log.gz 2024-04-23T18:28:45.345 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32040.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32040.log.gz 2024-04-23T18:28:45.345 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33404.log 2024-04-23T18:28:45.346 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36008.log 2024-04-23T18:28:45.348 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33178.log 2024-04-23T18:28:45.348 INFO:teuthology.orchestra.run.smithi028.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33404.log.gz 2024-04-23T18:28:45.349 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34828.log 2024-04-23T18:28:45.350 INFO:teuthology.orchestra.run.smithi028.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.36008.log.gz 2024-04-23T18:28:45.351 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33178.log: /var/log/ceph/ceph-client.admin.34828.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33178.log.gz 2024-04-23T18:28:45.351 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33092.log 2024-04-23T18:28:45.351 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34828.log.gz 2024-04-23T18:28:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31823.log 2024-04-23T18:28:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35742.log 2024-04-23T18:28:45.354 INFO:teuthology.orchestra.run.smithi137.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-23T18:28:45.356 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31823.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33092.log.gz 2024-04-23T18:28:45.356 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34594.log 2024-04-23T18:28:45.356 INFO:teuthology.orchestra.run.smithi028.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31823.log.gz 2024-04-23T18:28:45.357 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35742.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35742.log.gz 2024-04-23T18:28:45.357 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34594.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34594.log.gz 2024-04-23T18:28:45.358 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33190.log 2024-04-23T18:28:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36336.log 2024-04-23T18:28:45.361 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33409.log 2024-04-23T18:28:45.361 INFO:teuthology.orchestra.run.smithi028.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33190.log.gz 2024-04-23T18:28:45.361 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36336.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36336.log.gz 2024-04-23T18:28:45.363 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33409.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33409.log.gz 2024-04-23T18:28:45.364 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32512.log 2024-04-23T18:28:45.364 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35166.log 2024-04-23T18:28:45.366 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33195.log 2024-04-23T18:28:45.367 INFO:teuthology.orchestra.run.smithi028.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32512.log.gz 2024-04-23T18:28:45.367 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35166.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35166.log.gz 2024-04-23T18:28:45.368 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33195.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33195.log.gz 2024-04-23T18:28:45.368 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35567.log 2024-04-23T18:28:45.369 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34011.log 2024-04-23T18:28:45.371 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33144.log 2024-04-23T18:28:45.372 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35567.log.gz 2024-04-23T18:28:45.372 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34011.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34011.log.gz 2024-04-23T18:28:45.373 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35517.log 2024-04-23T18:28:45.374 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33144.log.gz 2024-04-23T18:28:45.374 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32454.log 2024-04-23T18:28:45.375 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35517.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-23T18:28:45.376 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32454.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35517.log.gz 2024-04-23T18:28:45.376 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34854.log 2024-04-23T18:28:45.379 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.34854.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.32454.log.gz 2024-04-23T18:28:45.379 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35010.log 2024-04-23T18:28:45.379 INFO:teuthology.orchestra.run.smithi028.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34854.log.gz 2024-04-23T18:28:45.380 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22670.log 2024-04-23T18:28:45.382 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35010.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35010.log.gz 2024-04-23T18:28:45.382 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.tmp-client.admin.22670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2024-04-23T18:28:45.383 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22670.log.gz 2024-04-23T18:28:45.383 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33618.log 2024-04-23T18:28:45.385 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.36611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33622.log 2024-04-23T18:28:45.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gz 2024-04-23T18:28:45.386 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33618.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33618.log.gz 2024-04-23T18:28:45.387 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33622.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33622.log.gz 2024-04-23T18:28:45.388 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34167.log 2024-04-23T18:28:45.389 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35904.log 2024-04-23T18:28:45.391 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34167.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34167.log.gz 2024-04-23T18:28:45.392 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.35904.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35904.log.gz 2024-04-23T18:28:45.392 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34141.log 2024-04-23T18:28:45.393 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34089.log 2024-04-23T18:28:45.395 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34141.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34141.log.gz 2024-04-23T18:28:45.396 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.34089.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34089.log.gz 2024-04-23T18:28:45.396 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33410.log 2024-04-23T18:28:45.399 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33410.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33410.log.gz 2024-04-23T18:28:45.432 INFO:teuthology.orchestra.run.smithi028.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-23T18:28:45.693 INFO:teuthology.orchestra.run.smithi028.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-23T18:28:46.359 INFO:teuthology.orchestra.run.smithi137.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-23T18:28:46.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-23T18:28:46.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-23T18:28:46.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-23T18:28:51.226 INFO:teuthology.orchestra.run.smithi137.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-23T18:28:51.237 INFO:teuthology.orchestra.run.smithi028.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-23T18:28:51.595 INFO:teuthology.orchestra.run.smithi137.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-23T18:28:52.322 INFO:teuthology.orchestra.run.smithi028.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-23T18:28:53.080 INFO:teuthology.orchestra.run.smithi137.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-23T18:28:53.453 INFO:teuthology.orchestra.run.smithi137.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-23T18:28:53.455 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-23T18:28:53.455 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m8.330s 2024-04-23T18:28:53.455 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m29.309s 2024-04-23T18:28:53.455 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m1.082s 2024-04-23T18:28:54.749 INFO:teuthology.orchestra.run.smithi028.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-23T18:28:56.147 INFO:teuthology.orchestra.run.smithi028.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-23T18:28:56.149 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-04-23T18:28:56.149 INFO:teuthology.orchestra.run.smithi028.stderr:real 0m11.034s 2024-04-23T18:28:56.149 INFO:teuthology.orchestra.run.smithi028.stderr:user 0m31.904s 2024-04-23T18:28:56.149 INFO:teuthology.orchestra.run.smithi028.stderr:sys 0m2.882s 2024-04-23T18:28:56.150 INFO:tasks.ceph:Archiving logs... 2024-04-23T18:28:56.151 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106/remote/smithi028/log 2024-04-23T18:28:56.152 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T18:29:00.433 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106/remote/smithi137/log 2024-04-23T18:29:00.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T18:29:04.125 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-23T18:29:04.135 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-23T18:29:04.135 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T18:29:04.139 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T18:29:04.212 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-23T18:29:04.222 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-23T18:29:04.222 DEBUG:teuthology.orchestra.run.smithi028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T18:29:04.225 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T18:29:04.238 INFO:teuthology.orchestra.run.smithi028.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T18:29:04.238 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================== 2024-04-23T18:29:04.239 INFO:teuthology.orchestra.run.smithi028.stdout:*hv01.front.sepi 44.4.53.2 2 u 37 64 377 0.105 -2.910 1.017 2024-04-23T18:29:04.239 INFO:teuthology.orchestra.run.smithi028.stdout:+hv02.front.sepi 63.231.80.2 3 u 44 64 377 0.079 -0.863 1.283 2024-04-23T18:29:04.239 INFO:teuthology.orchestra.run.smithi028.stdout:+hv03.front.sepi 74.6.168.72 3 u 43 64 377 0.105 -1.811 0.969 2024-04-23T18:29:04.239 INFO:teuthology.orchestra.run.smithi028.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-23T18:29:04.240 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T18:29:04.240 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-04-23T18:29:04.240 INFO:teuthology.orchestra.run.smithi137.stdout:*hv01.front.sepi 44.4.53.2 2 u 35 64 377 0.082 -2.017 0.741 2024-04-23T18:29:04.240 INFO:teuthology.orchestra.run.smithi137.stdout:+hv02.front.sepi 63.231.80.2 3 u 45 64 377 0.094 -0.812 0.608 2024-04-23T18:29:04.240 INFO:teuthology.orchestra.run.smithi137.stdout:+hv03.front.sepi 74.6.168.72 3 u 42 64 377 0.075 -0.827 0.806 2024-04-23T18:29:04.241 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-23T18:29:04.241 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-23T18:29:04.250 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-23T18:29:04.251 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-23T18:29:04.260 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-23T18:29:04.270 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-23T18:29:04.280 INFO:teuthology.task.internal:Duration was 1105.443233 seconds 2024-04-23T18:29:04.280 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-23T18:29:04.290 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-23T18:29:04.290 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T18:29:04.294 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T18:29:04.386 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-23T18:29:04.386 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi028.front.sepia.ceph.com 2024-04-23T18:29:04.387 DEBUG:teuthology.orchestra.run.smithi028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T18:29:04.407 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-04-23T18:29:04.408 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T18:29:04.417 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-23T18:29:04.417 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T18:29:04.455 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T18:29:04.497 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-23T18:29:04.497 DEBUG:teuthology.orchestra.run.smithi028:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T18:29:04.547 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T18:29:04.628 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-23T18:29:04.638 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-23T18:29:04.639 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T18:29:04.659 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T18:29:04.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-23T18:29:04.684 DEBUG:teuthology.orchestra.run.smithi028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T18:29:04.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T18:29:04.720 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = core 2024-04-23T18:29:04.731 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-04-23T18:29:04.756 DEBUG:teuthology.orchestra.run.smithi028:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T18:29:04.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:29:04.793 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T18:29:04.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:29:04.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-23T18:29:04.815 INFO:teuthology.task.internal:Transferring archived files... 2024-04-23T18:29:04.815 DEBUG:teuthology.misc:Transferring archived files from smithi028:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106/remote/smithi028 2024-04-23T18:29:04.816 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T18:29:04.864 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-23_17:44:29-fs-wip-lusov-quiescer-distro-default-smithi/7670106/remote/smithi137 2024-04-23T18:29:04.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T18:29:04.885 INFO:teuthology.task.internal:Removing archive directory... 2024-04-23T18:29:04.886 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T18:29:04.903 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T18:29:04.934 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-23T18:29:04.946 INFO:teuthology.task.internal:Not uploading archives. 2024-04-23T18:29:04.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-23T18:29:04.957 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-23T18:29:04.957 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T18:29:04.960 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T18:29:04.966 INFO:teuthology.orchestra.run.smithi028.stdout: 658123 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 18:29 /home/ubuntu/cephtest 2024-04-23T18:29:04.981 INFO:teuthology.orchestra.run.smithi137.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 18:29 /home/ubuntu/cephtest 2024-04-23T18:29:04.983 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-23T18:29:04.993 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-23T18:29:05.018 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} duration: 1105.4432332515717 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-04-23T18:29:05.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T18:29:05.099 INFO:teuthology.run:pass